Hugging Face launches a lookup to check which models run on AWS Trainium

A new Hugging Face page shows whether popular models run unmodified on Amazon’s Trainium chips, with the exact script to reproduce each test.

1 min read

Hugging Face

At a glance

tokens generated in each test
32
Trainium cores at most per tested model
16
What’s new
The torch-neuronx model support Space lists test results for top Hub models, with the cores used, run time and peak memory, built on the new TorchNeuron backend.
Who it affects
Developers deciding whether to run open models on AWS Trainium instead of other hardware.

Each test loads a model on a Trainium2 instance, split across the fewest cores that can hold it, then checks a short piece of generated text. Single-core results are compared with a run on an ordinary processor; larger models are checked by a small judge model for fluent English. Developers can copy precompiled graphs from a public cache to skip the slow first compile. For now only Transformers text-generation and image-text-to-text models are covered, with diffusers and other tasks planned. All results sit in a public dataset that anyone can query.

Why it matters

Choosing hardware often comes down to one question: will my model just work? A public, reproducible answer lowers the risk of trying Trainium. A pass only means the model runs and produces sensible text, though. The page says nothing about speed or long outputs, which are what drive cost.

Does Your Model Run on AWS Trainium? Look It Up

Hugging Face

huggingface.co

Summary by Second Order AI. Full reporting is at the original source.