news.volyx.in

Speculative KV coding: losslessly compressing KV cache by up to ~4× (fergusfinn.com)

155 points by kkm · 39 days ago · 48 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.