Report: Anthropic is in talks to use Microsoft’s custom AI chips
Anthropic is in talks to rent custom AI chips from Microsoft, according to a report from The Information, as the Claude-coder's scramble for compute continues.
During the first wave of the generative-AI boom, companies scrambled to get their hands on Nvidia’s GPUs, as they were the only game in town if you wanted to build new models.
But as the role of inference has shifted to a top priority, with companies focusing on actually running models to make money, they’ve started shopping around, buying chips tailored for the task, and in some cases decided to make their own.
Additionally, Anthropic has become something of a victim of its own success at rolling out products that can be quickly adopted by enterprise clients. That rapid, wide-scale adoption has revealed significant compute constraints. Anthropic is now, effectively, looking for any and all compute capacity it can find, striking deals with CoreWeave, Amazon, Google and Broadcom, and even xAI.
Amazon and Google have both seen hot demand for their custom inference chips. But Microsoft is still trying to get its custom Maia chips into the mix, after encountering delays.
If Microsoft lands Anthropic as a customer for its Azure-based Maia computing services, it could open the door for other companies seeking another option for meeting the sky-high demand for AI inference, as agentic models gobble up trillions of tokens.
But as the role of inference has shifted to a top priority, with companies focusing on actually running models to make money, they’ve started shopping around, buying chips tailored for the task, and in some cases decided to make their own.
Additionally, Anthropic has become something of a victim of its own success at rolling out products that can be quickly adopted by enterprise clients. That rapid, wide-scale adoption has revealed significant compute constraints. Anthropic is now, effectively, looking for any and all compute capacity it can find, striking deals with CoreWeave, Amazon, Google and Broadcom, and even xAI.
Amazon and Google have both seen hot demand for their custom inference chips. But Microsoft is still trying to get its custom Maia chips into the mix, after encountering delays.
If Microsoft lands Anthropic as a customer for its Azure-based Maia computing services, it could open the door for other companies seeking another option for meeting the sky-high demand for AI inference, as agentic models gobble up trillions of tokens.