news.volyx.in

Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA (github.com)

205 points by yu3zhou4 · 45 days ago · 18 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.