Home » Markets » AI

MS Gen2 inference processor software available to developers

Yesterday, Microsoft made the software for its Maia 200 chip – its second generation inference processor – available to developers.

MS AI chief Scott Guthrie called the Maia 200 “the most efficient inference system Microsoft has ever deployed.”

MS Gen2 inference processor software available to developersIt is made on TSMC’s 3nm process.

Developers, academics, AI labs and people contributing to open-source AI models can apply for a preview of a software development kit.



The MS  superintelligence team, led by Mustafa Suleyman, will use the new chip.

Also the 365 Copilot add-on for commercial productivity software bundles and the MS Foundry service, for building on top of AI models, will use the chip..

Microsoft is installing the processor in its US Central region of datacentres first and then in the U.S. West 3 region datacentres.

According to Guthrie,  the chip delivers 30% higher performance than alternatives for the same price,

MS can connect up to 6,144 Maia 200s.

Read all our AI stories.

David Manners

David Manners

David Manners has more than forty-years experience writing about the electronics industry, its major trends and leading players. As well as writing business, components and research news, he is the author of the site's most popular blog, Mannerisms. This features series of posts such as Fables, Markets, Shenanigans, and Memory Lanes, across a wide range of topics.

Leave a Reply

Your email address will not be published. Required fields are marked *

*