Nvidia built the AI boom around the graphics processing unit (GPU), a flexible chip capable of handling many different computing tasks.
But flexibility is not always the cheapest option.
As AI moves from training models towards repeatedly running them for millions of users, known as inference, efficiency matters more. Google, Meta, OpenAI and other large technology companies increasingly want processors designed around their own workloads.
Think of the difference between a Swiss Army knife and a factory machine. Nvidia sells an exceptionally capable Swiss Army knife. Custom silicon is the machine built to perform one job repeatedly and efficiently.
This creates an expanding market for companies such as Broadcom and Marvell. They help customers turn their own chip ideas into products and also supply much of the networking technology connecting thousands of processors inside data centres.
The race is becoming more competitive. Google recently expanded its relationship with Marvell across custom processors, networking and memory technologies. The agreement could eventually generate up to 120 billion USD of orders through fiscal 2033. Importantly, Google appears to be adding Marvell alongside Broadcom rather than simply replacing Broadcom.
Broadcom, meanwhile, is helping Meta develop its Meta Training and Inference Accelerator (MTIA), with production of the latest generation expected to start in September. It has also developed OpenAI’s first custom inference processor, Jalapeño, which is expected to begin deployment by the end of 2026.
The important point is not that custom chips replace Nvidia. Big technology companies increasingly use several types of processors. The AI semiconductor market is becoming larger and more specialised at the same time.