news.volyx.in

AI 2040 and the cult of intelligence (geohot.github.io)

147 points by rvz · 4 hours ago · 171 comments on HN

Article summary

The article discusses the author's shift in perspective on AI, from believing in the possibility of a hard takeoff to a more nuanced view that considers the complexities of reality. The author argues that intelligence is not the only factor in achieving goals and that AI systems are subject to the same laws of the universe and ecology as humans. The author also emphasizes the importance of local AI models that are aligned with the user's interests, rather than centralized models controlled by corporations or governments. The article uses a provocative example to illustrate the potential risks of centralized AI systems.

Main themes

  • AI alignment
  • Centralized vs local AI
  • AI safety
  • Corporate control
  • Government surveillance
  • Free speech

What commenters say

  • The author's example of asking a local AI model to help with a hypothetical crime is a valid test of AI alignment and highlights the risks of centralized AI systems.
  • Local AI models are necessary to ensure that users have control over their data and can use AI systems without being subject to corporate or government surveillance.
  • The development of AI systems is not just a technical issue, but also a philosophical and societal one that requires careful consideration of the potential consequences.
  • Some commenters argue that the author's views on AI are overly pessimistic and that the benefits of AI outweigh the risks, while others agree that the risks of centralized AI systems are significant.
  • The idea of a hard takeoff, where AI systems rapidly become superintelligent, is not supported by current evidence and is unlikely to occur in the near future.
  • The importance of free speech and the potential risks of AI systems being used to suppress dissenting views are major concerns in the development of AI systems.
  • The use of AI systems to manipulate public opinion and shape societal norms is a significant risk that needs to be addressed through careful regulation and oversight.
  • The development of local AI models that are aligned with user interests is a crucial step in ensuring that AI systems are used for the benefit of society as a whole.