Silicon Valley is moving from simple chatbot interactions toward agentic AI systems that require more computing resources. This shift is helping drive a buildout of data centers to meet the added power and infrastructure demands. The trend raises questions about energy use as AI agents become more capable and widely deployed.
OpenAI published an engineering account of how its storage system, Habitat, grew from an internal Python library into a distributed platform spanning multiple regions. The company says the system now handles roughly 22 million requests per second while supporting more than 1 billion ChatGPT users. The post describes the architectural changes made to keep pace with that growth.
WHY IT MATTERS ↘As frontier model quality converges, the ability to serve billions of users at tens of millions of requests per second increasingly determines cost per interaction and uptime, making bespoke storage and serving infrastructure a competitive moat rather than a back-end detail. For practitioners, it signals that data-layer architecture—not just model design—is now a primary constraint on scaling AI products, and that OpenAI is publishing this to set expectations for what production-scale deployment requires.
A new arXiv paper introduces Φ-Bench, a benchmark that measures how well large language models can help develop and optimize the computing infrastructure used to run AI systems. The authors argue that existing benchmarks do not adequately cover these infrastructure-engineering tasks, which go beyond typical code generation. The work aims to gauge whether LLMs can realistically contribute to the specialized systems engineering that underpins their own operation.
Google is committing more than 13 billion euros to build out AI infrastructure in Finland, marking its largest single investment in Europe to date. The arrangement also includes a power purchase agreement covering nuclear-generated electricity for the sites.
Google plans to spend a minimum of €13 billion on Finnish operations across 2027-2028, contingent on a long-term power purchase agreement with utility Fortum. The 22-year contract is linked to extending the Loviisa nuclear plant, giving Google stable low-carbon electricity for its planned data centres in the country.