Blog

Notes on systems, papers, and open-source work.

Hybrid KV Cache, Illustrated (Chinese)

How vLLM, SGLang and Marconi do prefix caching for hybrid attention + recurrent (GDN / Mamba) models, with interactive labs. Written in Chinese.

SGLang PR Notes: What I Learned

A placeholder note for future reflections on SGLang PRs, debugging, documentation, and LLM serving systems.