Speculative Decoding: Drafting, Verification, and Real Speed Gains
Check how to turn on speculative decoding in a local runtime, then work through probability correction and timing examples to see when it really speeds things up, and compare chains, trees, and self-speculation.