Amazon Web Services unveiled a new tool on Monday called TorchNeuron, designed to make it simple for AI startups to migrate their applications onto Amazon's own AI chip, Trainium. This move directly challenges the software advantage that has made Nvidia the go-to hardware provider for AI applications and fueled its dominance in the AI hardware market.

TorchNeuron is compatible with PyTorch, the free, open-source toolkit developers use to build, train, and run AI models. According to Amazon, it enables AI apps built with PyTorch to run on Trainium by changing just a single line of configuration—no code rewriting necessary. Amazon notes that roughly 85% of AI applications are written using PyTorch. Originally developed by Facebook, PyTorch has been part of the Linux Foundation since 2022, which oversees open-source projects.

Nvidia has invested years in ensuring its CUDA software—the infrastructure that allows applications to run on Nvidia GPUs and other hardware—works seamlessly with PyTorch-built AI apps. Consequently, Nvidia's hardware has become deeply integrated into the toolkit, essentially by default. Since TorchNeuron is adapted from PyTorch, developers already familiar with PyTorch will know how to use it.

Amazon isn't the first to attempt making it easy to bring other chips onto the platform. PyTorch users can already port their apps to AMD GPUs or even Apple's chips with a simple configuration change. However, Amazon contends that porting to Trainium isn't just straightforward—it also gives AI startups access to Amazon's entire cloud ecosystem. Unsurprisingly, AWS argues this is a superior choice for startups compared to neoclouds, many of which are tied to Nvidia and its hardware, such as Coreweave, Nebius, and Firmus.

"You're building on AWS," the company stated. "On AWS," the spokesperson continued, "the infrastructure to go from prototype to production is already there, allowing a founder to move fast and scale when they need to."

AWS says that because the same chip handles both training (teaching the AI model) and inference (putting the finished model to work, such as when it answers a user's question), and is tightly integrated with the cloud infrastructure startups require, its cloud will save them money—even if AWS doesn't offer the cheapest per-token price.

"Trainium's value is price-performance plus the fact that it's one platform for both training and inference, which improves the economics across a full workload," Brace said. "Look at Deepgram—they moved to Trainium using native PyTorch support and they're processing 70% more audio per dollar at production-grade accuracy." Deepgram is an AI voice app provider and a competitor to ElevenLabs.

But Amazon isn't satisfied with merely giving PyTorch app developers an easy option to move to its cloud. Amazon also says it is pushing PyTorch to be less automatically centered on Nvidia, and it will contribute the code to accomplish that to the main PyTorch project. In the blog post announcing the new tool, the company wrote:

"Amazon's approach extends beyond its own hardware. The company is contributing changes upstream to PyTorch itself, working with the PyTorch community to remove code that ties the framework to specific chips. The goal is to make PyTorch more hardware-agnostic for the entire developer community, not just Trainium users."

While such a tactic is undoubtedly beneficial for those selling hardware and cloud services that compete with Nvidia, one of PyTorch's purposes is to hide all the troublesome difficulties of getting AI code to run on hardware. We'll have to wait and see whether pushing Nvidia out that far gives developers more choice and more affordable options, as Amazon promises, or just more configuration headaches. Either way, if Amazon succeeds in deeply uncoupling PyTorch from Nvidia, this could have much bigger ramifications for the GPU giant than simply dealing with chip competitors. As Brace said: "The real story is removing the lock-in that kept developers from having a real choice at all."