news.volyx.in

Serving 70B-scale LLMs efficiently on low-resource edge devices [pdf] (arxiv.org)

248 points by simonpure · 674 days ago · 58 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.