news.volyx.in

OpenAI is walking away from expanding its Stargate data center with Oracle (cnbc.com)

424 points by spenvo · 175 days ago · 247 comments on HN

Article summary

OpenAI is ending its plans to expand its Stargate data center with Oracle due to the desire for newer Nvidia chips. Oracle had invested heavily in the project, but the rapid advancement of AI technology and the need for the latest hardware has made the current plans obsolete. The decision highlights the challenges of building and maintaining data centers with rapidly evolving technology. Oracle's debt-fueled expansion strategy is also under scrutiny.

Main themes

  • AI technology advancements
  • Data center infrastructure
  • Oracle's debt-fueled expansion
  • Nvidia chip upgrades
  • Data center hardware depreciation

What commenters say

  • The rapid improvement in AI chips makes it necessary for companies to constantly upgrade their hardware to remain competitive.
  • The cost and logistics of repurposing or recycling old datacenter GPUs make it unlikely that there will be a significant secondary market for them.
  • Some commenters believe that it is possible to run datacenter-level GPUs in a home setup with the right adapters and equipment, while others think it is not feasible.
  • The high failure rate of datacenter GPUs, reportedly around 9% per year, is a significant concern for companies investing in this technology.
  • There is a debate about whether the performance-per-watt improvements in new GPU generations justify the cost of constantly upgrading hardware.
  • Some argue that the CEO of Nvidia has a vested interest in promoting the idea of frequent hardware upgrades, and that this perspective may not be entirely objective.
  • The idea of running older hardware is not viable due to the significant performance improvements in new generations of GPUs, making it necessary to upgrade regularly.
  • The secondary market for used datacenter hardware, including GPUs, may be viable for some components, but not for others due to their specialized nature.