news.volyx.in

Congrats! Web scraping is legal! (US precedent) (parsers.me)

1057 points by ehurynovich · 2448 days ago · 388 comments on HN

Article summary

A US court precedent has been set regarding web scraping, with implications for data-driven startups and companies. The ruling suggests that web scraping may be legal in certain cases. However, the decision does not necessarily make web scraping 100% legal, and the issue is still being debated. The case is ongoing, with LinkedIn planning to appeal to the Supreme Court.

Main themes

  • web scraping legality
  • copyright law
  • data ownership
  • fair use
  • technical measures
  • public data
  • corporate interests
  • regulatory implications

What commenters say

  • Web scraping is not necessarily 100% legal, despite the recent court precedent.
  • Companies like LinkedIn should not be able to block web scraping if they make their data publicly available.
  • Copyright law still applies to creative works, even if they are scraped from public websites.
  • Scraping public data for personal use or analysis may be considered fair use, but redistributing it without permission is not allowed.
  • Technical measures like CAPTCHAs and rate limiting can be used to protect against malicious web scraping, but may not be discriminatory.
  • The distinction between creative works and factual data is important in determining what can be scraped and used.
  • The ruling may have implications for companies that rely on web scraping, such as search engines and data analytics firms.
  • The issue of web scraping is complex and multifaceted, with different perspectives on what is legal and what is not.