Subscribe
AMD says ROCm 10 is 3.3x faster than ROCm 7. Its own footnote says neither side ran ROCm 10
Hardware2 min read

AMD says ROCm 10 is 3.3x faster than ROCm 7. Its own footnote says neither side ran ROCm 10

The comparison is ROCm 7.0 against a preview of 7.2.2, on serving engines nine months apart, and the genuinely useful release is a command-line installer.

In briefAMD released ROCm 10 on August 27, 2026, making ROCm.AI generally available, and claims an average 3.3x inference and 2.4x training improvement over ROCm 7 on the same hardware1Footnote MI350-81 describes the inference test as ROCm 7.0 versus a preview version of ROCm.ai based on ROCm 7.2.2, tested on July 7, 2026 across GLM-5, Kimi-K2.5 and DeepSeek-R1-05282The baseline Kimi run used vLLM 0.16.0 and the comparison run used vLLM 0.22.0; the baseline DeepSeek-R1 container was dated 20250915 and the comparison container 202606123
Updated · Sep 11, 2026, 10:17 ETThis story was revised after publication. The sources block reflects the current version.
AMD’s headquarters in Santa Clara
Photo: Coolcaesar (CC BY-SA 4.0)

AMD printed the test conditions under its headline number, which is more than most vendors bother to do.

Then you read them.

ROCm 10 launched on 27 August with an average 3.3x inference improvement and 2.4x training improvement over ROCm 7, on the same hardware. Footnote MI350-81 says the measurement is an eight-GPU MI355X system running ROCm 7.0 against a similarly configured system running "a preview version of AMD ROCm.ai (ROCm 7.2.2 with optimizations such as Optimized Kernels, Parallelism and Scheduling)."

So it is one point release against a preview of another, measured on 7 July, six weeks before the product being announced existed.

That alone would be pedantry.

The serving stacks are nine months apart

Look at what actually ran on either side. Kimi was measured on vLLM v0.16.0 in the baseline and v0.22.0 in the new run. DeepSeek ran on an SGLang container built in September 2025 against one built in June 2026.

Nine months of upstream inference work sits inside that gap, and none of it is AMD's. The release attributes the whole delta to "AI-driven optimization of kernels, memory management and scheduling."

So how much of the speed-up is the compiler and how much is vLLM? Nobody can tell from these tables. AMD is the only party that could have separated the two, by holding the engine version fixed, and doing that is cheap. Not doing it is a choice.

The footnotes lose track of themselves

The training test is headed ROCm 7.2.2 and then lists "ROCm 7.2.1 + Primus v26.3" for all three models.

In the inference table, the DeepSeek baseline names a container image tagged sgl-dev-v0.5.2 while the version text beside it reads V0.5.13, which is the version of the run it is being compared against.

Somebody assembled this from two spreadsheets (we have all done it, just not in a launch release).

Which is a shame, because the product is better than the number

ROCm Hyperloom is an agentic optimiser. It profiles a workload, finds the bottleneck, implements the change, benchmarks the result and validates correctness, targeting HIP, Triton and FlyDSL, with support for vLLM and SGLang.

AMD Skills pushes curated AMD knowledge into Claude Code, Codex and Cursor through their own marketplaces, and each skill passes structural and behavioural testing before release.

And the ROCm CLI, a technology preview on Windows as well as Linux, installs as a prebuilt binary onto a machine with no ROCm on it at all, manages side-by-side runtimes with rollback, and serves models from a single interface.

That last one is the real fix

AMD's software reputation was never mainly a compiler problem. It was a which-container-do-I-run problem.

If you have ever lost an afternoon to that, a version-agnostic CLI that installs and rolls back runtimes is probably worth more to you than any multiplier on a slide.

We would put the honest same-engine gain between an old stack and a new one on that hardware at well under one and a half times, and we would expect an independent benchmark to land near there once somebody runs it with the serving version held fixed. If a third party reproduces the full claim under those conditions, we were unfair and will say so here.

Ten years of ROCm, and the thing most likely to win AMD developers this year is a command that installs it.

Sources

01
AMD released ROCm 10 on August 27, 2026, making ROCm.AI generally available, and claims an average 3.3x inference and 2.4x training improvement over ROCm 7 on the same hardware“Today, AMD released AMD ROCm™ 10, marking 10 years of the AMD software stack and making ROCm.AI generally available for users. ... Through AI-driven optimization of kernels, memory management and scheduling, a system configured with…” — newsroom.amd.com · primary · Sep 10
02
Footnote MI350-81 describes the inference test as ROCm 7.0 versus a preview version of ROCm.ai based on ROCm 7.2.2, tested on July 7, 2026 across GLM-5, Kimi-K2.5 and DeepSeek-R1-0528“(MI350-81) Testing by AMD Performance Labs as of July 7, 2026, measuring the inference performance in tokens per second (TPS) of a system configured with an AMD Instinct MI355x 8x GPU platform and AMD ROCm 7.0 software vs a similarly…” — newsroom.amd.com · primary · Sep 10
03
The baseline Kimi run used vLLM 0.16.0 and the comparison run used vLLM 0.22.0; the baseline DeepSeek-R1 container was dated 20250915 and the comparison container 20260612“Kimi ROCm Docker Image: vllm/vllm-openai-rocm:v0.16.0, vLLM version 0.16.0 DeepSeek-R1 Docker Image: rocm/7.0:...sgl-dev-v0.5.2-rocm7.0-mi35x-20250915, SGLang version V0.5.13 vs ... Kimi ROCm Docker Image: vllm/vllm-openai-rocm:v0.22.0,…” — newsroom.amd.com · primary · Sep 10
Show all 7 sources
04
The training footnote is headed ROCm 7.2.2 but lists ROCm 7.2.1 with Primus v26.3 for all three models“(MI350-82) Testing by AMD Performance Labs as of July 7, 2026, measuring the training performance in tokens per second (TPS) of AMD ROCm 7.0 software vs a preview version of AMD ROCm.ai (ROCm 7.2.2 with optimizations such as Optimized…” — newsroom.amd.com · primary · Sep 10
05
ROCm Hyperloom is an autonomous agentic system that profiles workloads, identifies bottlenecks, implements changes, benchmarks and validates, targeting HIP, Triton and FlyDSL with vLLM and SGLang support“ROCm Hyperloom, a key component of ROCm.AI, is an autonomous agentic system for optimizing end-to-end inference workloads across host code and GPU kernels. Hyperloom profiles workloads, identifies bottlenecks, explores optimization…” — newsroom.amd.com · primary · Sep 10
06
AMD Skills ships into Claude Code, Cursor and Codex marketplaces and an open GitHub catalog, with each skill passing structural and behavioral testing“AMD Skills brings curated AMD knowledge and validated workflows into supported AI coding agents like Claude Code, Cursor and Codex, giving developers AMD-specific guidance within the tools they already use. ... The skills previewed at…” — newsroom.amd.com · primary · Sep 10
07
The ROCm CLI is a technology preview available on Windows and Linux as a prebuilt binary that does not require an existing ROCm installation, with side-by-side runtimes and rollback“The CLI is available on Windows as well as Linux as a prebuilt binary and does not require an existing ROCm installation. It delivers managed ROCm environments, supports multiple side-by-side runtimes including runtime activation and…” — newsroom.amd.com · primary · Sep 10
More on AMD and BenchmarksAll AMD stories →
You’re 60% through. Stories like this one, Mon · Wed · Fri, with every claim sourced.