news.volyx.in

Real-time LLM Inference on Standard GPUs: 3k tokens/s per request (blog.kog.ai)

219 points by NicoConstant · 45 days ago · 97 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.