
Explained: What are dark GPUs and how are they holding back the AI boom?
What Happened?
The AI boom faces a challenge as powerful chips, termed 'dark GPUs', remain unused due to insufficient electricity in data centres. This gap highlights the disparity between AI investment and power availability.
Key points
- Dark GPUs are powerful chips purchased but remain idle due to lack of electricity.
- Amazon is investing billions in Nvidia systems while facing power shortages.
- AI data centres require significant electricity for operation and cooling.
- Building necessary infrastructure can take years, delaying chip usage.
- Dark GPUs lead to financial pressure and delays in AI service deployment.
Key insights
- The financial investment in dark GPUs may not yield immediate returns for companies.
- Delays in AI infrastructure could impact the overall tech supply chain.
- Increased demand for AI computing capacity may strain existing resources.
Why it matters
The issue of dark GPUs could hinder the rapid growth of AI technologies and services.
Tags
Entities
Source
Business Standard