AI Weekly Malaysia

Back to items Summaries

OpenAI’s 700W Jalapeño ASIC outpaces 1,400W Nvidia flagship GPU — claims up to 1.9x throughput per kilowatt and 3.6x lower latency, co-developed with Broadcom

ID
17773
Status
summarized
Published
26 Aug 2026, 2:05 AM
Fetched
26 Aug 2026, 2:57 AM
Provider
Tom's Hardware
Category
technology
Original URL
https://www.tomshardware.com/tech-industry/semiconductors/openai-says-its-jalapeno-chip-beats-nvidias-gb300-in-first-published-benchmarks
Source URL
https://www.tomshardware.com/feeds/all

Summary

Score
6.5
Created
26 Aug 2026, 2:58 AM
Tags
Audience
developersai-ml-learnerssaas-startup-founders

What happened

OpenAI claims its 700W 'Jalapeño' ASIC, co-developed with Broadcom, delivers up to 1.9x throughput per kilowatt and 3.6x lower latency compared to Nvidia's 1,400W GB300 flagship GPU, based on first-published benchmarks. The chip runs at half the power envelope of Nvidia's part.

Why it matters

If these numbers hold under independent testing, inference cost-per-query could shift significantly toward custom ASICs over Nvidia GPUs — builders pricing AI features should watch whether OpenAI passes efficiency gains downstream via API pricing, and whether Broadcom-backed custom silicon accelerates the trend of large AI labs going in-house on chips rather than buying Nvidia.

Discussion angle

These are OpenAI's own benchmark claims for its own chip — how much should builders trust vendor-published benchmarks, and what would independent verification look like for ASIC vs GPU inference workloads?

Top