news.volyx.in

Google is the only search engine that works on Reddit now, thanks to AI deal (404media.co)

515 points by turkeytotal · 747 days ago · 356 comments on HN

Article summary

Google is now the only search engine that can surface results from Reddit due to a deal that allows Google to scrape Reddit for AI training data. This means that alternative search engines like Bing and DuckDuckGo can no longer crawl Reddit, making Google the sole provider of Reddit search results. The deal is reportedly worth millions of dollars and has raised concerns about Google's monopoly on search. Reddit's decision to restrict access to its site has also sparked debate about the company's priorities and the impact on users.

Main themes

  • Search engine monopoly
  • AI training data
  • Reddit's business model
  • Web scraping
  • Data ownership
  • Internet freedom

What commenters say

  • Reddit's decision to restrict access to its site is a clear attempt to monetize its data and favor Google, its partner in the AI deal.
  • The move will ultimately harm users who rely on alternative search engines and will further entrench Google's dominance in the search market.
  • Reddit's actions are a betrayal of its original mission to provide a platform for free and open discussion, and are driven by a desire for profit over community interests.
  • The restriction on web scraping is necessary to prevent the misuse of Reddit's data and to protect its users' privacy, but it may also stifle innovation and limit access to information.
  • The deal between Google and Reddit highlights the tension between the need to protect intellectual property and the need to preserve the open nature of the internet.
  • The fact that Google is willing to pay millions of dollars for access to Reddit's data suggests that the data has significant value, and that Reddit is making a rational business decision.
  • The use of robots.txt to restrict access to Reddit's site is ineffective and can be easily circumvented, rendering the restriction meaningless.
  • The debate over Reddit's decision reflects a broader struggle between competing values of openness, privacy, and profit in the digital age.