AI SIGNAL · COMPLETE DAILY EDITION

Compute + energyAugust 25, 2026

OpenAI reports more AI work per watt and lower latency from its first custom inference chip

OpenAI's vendor-run tests report 1.5 to 1.9 times more AI work per watt and 1.7 to 3.6 times lower end-to-end latency; production qualification is still underway.

TODAY'S SIGNAL

OpenAI disclosed the first measured results for Jalapeño, its custom inference chip. In OpenAI's tests across three public models, the system delivered 1.5 to 1.9 times more AI work per watt at peak throughput and 1.7 to 3.6 times lower end-to-end latency than the comparison systems.

Why it matters: the cost and speed of running a model increasingly determine which AI uses are practical. Faster, more power-efficient inference can make multi-step agents and high-volume services cheaper to operate—even when the underlying model does not change.

The honest boundary: these are OpenAI-run results on the public InferenceX benchmark, normalized with published chip power ratings. They are not an independent production test, a customer-bill comparison or proof that the chip can yet run reliably at scale.

OpenAI says production qualification is still underway and plans to begin deploying Jalapeño in its own infrastructure by year-end.

The honest limit

These are OpenAI-run benchmark results, not an independent production test, customer-bill comparison or proof of reliable operation at scale.

WHAT TO WATCH

Independent reproduction, measured system-level energy use, production reliability, deployment volume and whether lower serving cost reaches customers or mostly expands usage.

Pilot boundary: Public prototype review copy only. It is not professional advice or an approved service offering.