news.volyx.in

The Pile: An 800GB dataset of diverse text for language modeling (2020) (arxiv.org)

184 points by charlysl · 1143 days ago · 70 comments on HN

The AI summary for this story hasn't been generated yet — it's produced hourly. Check back soon. Meanwhile, read the discussion on HN.