news.volyx.in

Running a 180B parameter LLM on a single Apple M2 Ultra (twitter.com)

255 points by tbruckner · 1083 days ago · 141 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.