Lead story
OpenAI's "Jalapeño" Chip Is the Moment It Stops Renting Its Own Brain
For years, OpenAI has been paying Nvidia rent on its own ambitions. That changes today. The company has unveiled Jalapeño, its first custom inference chip, built in partnership with Broadcom — and it's a signal that the AI infrastructure war has moved from software to silicon.
What it is. Jalapeño is an ASIC — an application-specific integrated circuit — optimised specifically for running large language model inference, the process of generating responses to prompts. It's not a training chip. OpenAI isn't trying to replace the H100s it uses to teach its models; it's trying to dramatically cut the cost of serving the answers those models produce. Every token you generate costs OpenAI money, and right now that money largely flows to Nvidia.
Why it matters. Inference is where AI companies live or die commercially. Training happens once (or a few times). Inference happens billions of times a day. By owning that layer of the stack, OpenAI can lower its per-token cost, pass some of that on to customers, and — crucially — stop being structurally dependent on a hardware supplier whose chips are also sold to every competitor OpenAI has. Think of it like a restaurant that has finally stopped renting its kitchen from the same company supplying everyone else on the street.
The Broadcom angle. Choosing Broadcom as the manufacturing partner is notable. Broadcom has become the go-to custom chip partner for hyperscalers — Google's TPUs are a Broadcom collaboration. OpenAI is essentially following the playbook Google wrote a decade ago. The difference is that Google had armies of chip engineers in-house before it went down this path. OpenAI is moving faster and leaning harder on the partnership model.
What it doesn't tell us. OpenAI hasn't released performance benchmarks, hasn't said when Jalapeño will be powering production traffic at scale, and hasn't disclosed whether this changes its Nvidia procurement plans in the near term. The announcement is strategic positioning as much as it is a product launch. Expect the gap between "unveiled" and "widely deployed" to be measured in quarters, not weeks.
The broader picture. This is the third major AI lab to go custom silicon in the last 18 months. Google has TPUs, Amazon has Trainium and Inferentia, and now OpenAI has Jalapeño. Microsoft — OpenAI's biggest backer and cloud partner — has its own Maia chip. The implication for Nvidia is not immediate pain, but it's structural pressure. The hyperscaler custom silicon playbook reduces Nvidia's total addressable market over time by carving out the most predictable, highest-volume inference workloads.
Watch for: whether OpenAI's API pricing drops in the next two quarters, which would be the clearest signal that Jalapeño is doing real work. If prices stay flat, the chip is either still in testing or the cost savings are being reinvested in capacity rather than passed on.
