Chain-Flow
A flow-matching hidden-state drafter for lossless speculative decoding in vLLM.
Chain-Flow is a flow-matching hidden-state drafter for lossless speculative decoding in vLLM. Flow-Drafter runs a conditional flow over the target model's final hidden states and drafts multiple tokens in a single forward pass, then verifies with vLLM's own verifier so the output distribution matches the target exactly. With fused CUDA kernels and English/Turkish Flow-Drafter checkpoints for Qwen3.5 (4B, 9B, 27B), we report speedups up to about 2.51× in English and 2.48× in Turkish on the 27B model.