Continuous Batching on Hellokitty's Blog https://yangyang233333.github.io/tags/continuous-batching/ Recent content in Continuous Batching on Hellokitty's Blog Hugo zh-CN Tue, 25 Aug 2026 20:40:00 +0800 Mini-SGLang 源码阅读（二）：Scheduler、Continuous Batching 与 Chunked Prefill https://yangyang233333.github.io/posts/mini-sglang-source-reading-scheduler/ Tue, 25 Aug 2026 20:40:00 +0800 https://yangyang233333.github.io/posts/mini-sglang-source-reading-scheduler/ 先解释在线推理调度的资源约束，再分析 Mini-SGLang 如何组织 Prefill、Decode 和 CPU/GPU 重叠执行。