NVIDIA and Google's new coalition wants to speed up AI data center power grid connections

NVIDIA, Google, and Emerald AI have launched a new coalition called the AI Energy Management Alliance (AEMA), aiming to promote more flexible AI data centers that won't be disruptive to electricity grids or require massive, taxpayer-funded upgrades. In exchange, the coalition wants utility operators to connect their data centers faster.

The Problem with Current Power Infrastructure

As NVIDIA explains in its own blog post, US power infrastructure was built for "flat, static electricity demand" and not for computing centers that can moderate power usage. New US data centers can wait a decade or more for a grid connection, because utilities need to ensure they have enough capacity to serve everyone when demand is highest, "including on sweltering afternoons when air conditioners are running full tilt," wrote Emerald AI CEO Varun Sivaram in a Fortune article.

The Case for Flexible Data Centers

At the same time, the grid is only 50 percent utilized on average. Sivaram argued that if "AI data centers were flexible during the grid's worst hours of the year, America could unlock 100GW on our existing grid for flexible data centers." The goal is to set a standard for flexible data centers that can shift computing workloads, discharge storage, and respond to system contingencies - making them a "controllable resource rather than an inflexible load."

Proposed Principles and Standards

AEMA is suggesting principles including:

• Setting clear rules for facilities regarding staying connected during brief grid disturbances
• Reducing power use when needed
• Responding to emergencies
• Standardizing technical requirements, performance metrics, and operational data sharing

Proposed Technologies

Some of the technology the group is proposing includes:

• Batteries that carry facilities through peaks
• On-site generation to support demand
• Software that can "slow, pause or shift less urgent computing"

The Deal with Grid Operators

As a tit-for-tat, grid operators would connect data centers to the grid more quickly while potentially sharing costs.

Political and Lobbying Dimensions

The coalition is likely a response to a massive public backlash against AI data centers that politicians are starting to realize could affect their future electability. AEMA will also serve as a lobbying arm for big tech. Sivaram wrote:

"AEMA will press this case in state capitals and in Washington. Our ask of governors, regulators and federal policymakers is simple: offer data centers that commit to flexibility a faster and larger grid connection - and hold them to it."

Limitations

AEMA doesn't really address the massive amounts of pollution created by these data centers thanks to their energy demands, nor the noise and general disturbance to neighboring communities. Rather, it wants to ensure that it gets data centers connected more quickly, in exchange for creating less of a hassle for regional electrical grids. Given current anger in communities over AI data centers, the public may not quite see it that way.