news.volyx.in

FlexGen: Running large language models on a single GPU (github.com)

192 points by behnamoh · 1254 days ago · 43 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.