Up to 3.2x Faster Inference with LFM2.5-DSpark
- ID
- 16160
- Status
- summarized
- Published
- 21 Aug 2026, 12:52 AM
- Fetched
- 21 Aug 2026, 2:57 AM
- Provider
- Hugging Face Blog
- Category
- developer-ai
- Original URL
- https://huggingface.co/blog/LiquidAI/lfm25-dspark
- Source URL
- https://huggingface.co/blog/feed.xml
Summary
- Score
- 7.0
- Created
- 21 Aug 2026, 2:57 AM
- Tags
- Audience
- developersai_ml_learnersai_agent_users
What happened
LiquidAI released DSpark speculative decoding draft models (~300M params each) for three LFM2.5 models (1.2B, 2.6B, 8B-A1B), achieving up to 3.18x throughput on GPU and 2.87x on-device with no quality loss. The draft models use a DFlash-style parallel backbone plus a Markov-chain sequential head and a confidence-scheduled verifier, with day-one open-source support in llama.cpp and SGLang.
Why it matters
If you're shipping on-device or latency-sensitive LLM inference—especially agentic function-calling, where this cuts latency 57% on average for the 2.6B model—DSpark is a drop-in speedup you can test today via llama.cpp or SGLang without changing output quality. Evaluate whether swapping your current small-model serving path for LFM2.5 + DSpark beats your existing setup on your hardware.
Discussion angle
Speculative decoding is becoming practical for small models—compare DSpark's approach (Markov head + confidence pruning) against EAGLE-3 and whether the 57% function-calling latency cut matters enough to switch serving frameworks.