#LLM

Google Research introduced speculative decoding, a technique that can reduce inference times by 2-4x without compromising output quality. This blog post explores how it works, why it matters, and how you can use it today.