news.volyx.in

Fast and Portable Llama2 Inference on the Heterogeneous Edge (secondstate.io)

313 points by 3Sophons · 1014 days ago · 98 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.