Amazon’s AWS unveils new supercomputer with its AI chips in a challenge to Nvidia

Amazon.com’s cloud unit on Tuesday showed new data center servers packed with its own AI chips that will challenge Nvidia, with Apple coming aboard as a customer to use them.

The new servers, based on 64 of Amazon Web Services’ Trainium2 chips, will be strung together in a massive supercomputer with hundreds of thousands of chips, with the help AI startup Anthropic, which will be the first to use it. Apple executive Benoit Dupin also said that Apple is using Trainium2 chips.

With more than 70% market share, Nvidia dominates the sale of AI chips, and traditional chip industry rivals such as Advanced Micro Devices are rushing to catch up.

But some of Nvidia’s most formidable competitors are also its customers: Meta Platforms, Microsoft and Alphabet’s Google all have their own custom AI chips. While Meta’s chip powers internal operations, Amazon and Google use their chips internally but also market them to paying customers.

AWS Chief Executive Matt Garman also said that Trainium3, the company’s next generation of AI chip, will debut next year.

The new offerings “are purpose-built for the demanding workloads of cutting edge generative AI training and inference,” said Garman at the event in Las Vegas on Tuesday.

The new servers, which AWS calls Trn2 UltraServers, will compete against Nvidia’s flagship server packing 72 of its latest “Blackwell” chips. Both companies also offer proprietary technology for connecting the chips, though Gadi Hutt, who leads business development for the AI chips at AWS, said that AWS will be able to connect a greater number of chips together than Nvidia.

“We think with Trainium2, (customers) get more compute than what’s available from Nvidia today, and they will be able to save cost,” Hutt told Reuters in an interview, adding that some AI models can be trained at 40% lower cost than on Nvidia chips.

AWS executives said the new servers and huge supercomputer would come online next year but did not give a specific date. Both AWS and Nvidia are rushing to get their flagship offerings to market amid booming demand, though Nvidia shipments have been limited by supply chain constraints.

Both Nvidia and AWS use Taiwan Semiconductor Manufacturing to manufacture their chips.

“From a supply standpoint, we are in a pretty good shape across all of the supply chain,” Hutt told Reuters. “When we do the systems, the only item that we cannot dual source is the Trainium chips.”

—Stephen Nellis and Greg Bensinger, Reuters

https://www.fastcompany.com/91239754/amazon-aws-supercomputer-ai-chips-nvidia-amd?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Erstellt 7mo | 03.12.2024, 23:10:06


Melden Sie sich an, um einen Kommentar hinzuzufügen

Andere Beiträge in dieser Gruppe

How your data is collected and what you can do about it

You wake up in the morning and, first thing, you open your weather app. You close that pesky ad that opens first and check the forecast. You like your weather app, which shows hourly weather forec

03.07.2025, 10:10:05 | Fast company - tech
Crypto is about to get even bigger thanks to millennials

How the Boomer wealth transfer could reshape global finance.

Born too late to ride the wave of postwar prosperity, but just early enough to watch the 2008 financial crisis decimate some

03.07.2025, 10:10:04 | Fast company - tech
Is the Velvet Sundown an AI band? Many on the internet sure think so

The Velvet Sundown is the most-talked-about band of the moment, but not for the reason you might expect.

The “indie rock band,” which has gained more than 634,000 Spotify lis

03.07.2025, 10:10:04 | Fast company - tech
U.K.’s Bytes Technology stock plunged over 27%. Here’s why

Shares of U.K.’s Bytes Technology plunged over 27% on Wednesday after the IT firm said its operating profit for the first half of fiscal 2026 would be marginally lower due to delayed custome

02.07.2025, 17:50:03 | Fast company - tech