Subscribe
18:00Tao calls OpenAI’s Navier–Stokes push “resource extraction”17:10LAPTOP memecoin hits $190.81, then loses 99% inside an hour17:05Hubinger puts the odds of AI killing everyone above 10%; a colleague resigns16:39CancerBench launches; five frontier models tied at zero cancer types cured16:30ElevenLabs preparing 2028 IPO after $11bn round, The Information reports16:30Anthropic retracts its July explanation: Mythos 5 attacked systems knowingly
Hardware2 min read

AMD says ROCm 10 is 3.3x faster than ROCm 7. Its own footnote says neither side ran ROCm 10

The comparison is ROCm 7.0 against a preview of 7.2.2, and the baseline containers are up to nine months behind upstream vLLM and SGLang.

In briefAMD released ROCm 10 on August 27, 2026, making ROCm.AI generally available, and claims an average 3.3x inference and 2.4x training improvement over ROCm 7 on the same hardware1Footnote MI350-81 describes the inference test as ROCm 7.0 versus a preview version of ROCm.ai based on ROCm 7.2.2, tested on July 7, 2026 across GLM-5, Kimi-K2.5 and DeepSeek-R1-05282The baseline Kimi run used vLLM 0.16.0 and the comparison run used vLLM 0.22.0; the baseline DeepSeek-R1 container was dated 20250915 and the comparison container 202606123

AMD launched ROCm 10 on August 27th and led with a number: an average 3.3× inference improvement and 2.4× training improvement over ROCm 7, on the same hardware. Then it printed the test conditions underneath, which is more than most vendors do, and the test conditions do not describe ROCm 10.

What AMD claims ROCm.AI delivers over ROCm 7 (multiple)
Inference3.3Training2.4

Footnote MI350-81 says the measurement is an eight-GPU MI355X system running ROCm 7.0 against a similarly configured system running "a preview version of AMD ROCm.ai (ROCm 7.2.2 with optimizations such as Optimized Kernels, Parallelism and Scheduling)." So it is 7.0 versus a 7.2.2 preview, run on 7 July, six weeks before the product being announced existed.

That alone would be pedantry. What follows is not.

So look at the serving stacks on either side of the comparison. Kimi-K2.5 was measured on vLLM 0.16.0 in the baseline and vLLM 0.22.0 in the new run. DeepSeek-R1 ran on an SGLang container built on 15 September 2025 against one built on 12 June 2026. Nine months of upstream inference work sits inside that gap, none of it AMD's, and the release attributes the whole delta to "AI-driven optimization of kernels, memory management and scheduling."

How much of 3.3× is the compiler and how much is vLLM? Nobody can say from these tables, and AMD is the only party who could have separated them by holding the engine version fixed. Doing so is cheap. Not doing so is a choice.

And the footnotes lose track of themselves. The training test is headed ROCm 7.2.2 and then lists "ROCm 7.2.1 + Primus v26.3" for all three models. In the inference table, the DeepSeek-R1 baseline names a container image tagged sgl-dev-v0.5.2 while the version text beside it reads V0.5.13, which is the version of the run it is being compared against. Somebody assembled this from two spreadsheets.

All of which is a shame, because the actual product is more interesting than the number.

ROCm Hyperloom is an agentic optimiser that profiles a workload, finds the bottleneck, writes the change, benchmarks it and checks correctness, targeting HIP, Triton and FlyDSL, with production support for vLLM and SGLang. AMD Skills ships curated AMD knowledge into Claude Code, Codex and Cursor through their own marketplaces, with each skill passing structural and behavioural tests before release. And the ROCm CLI — a technology preview, on Windows as well as Linux — installs as a prebuilt binary with no existing ROCm on the machine, manages side-by-side runtimes with rollback, and serves models from one interface.

That last one is the real fix. AMD's software reputation was never mainly a compiler problem. It was a which-container-do-I-run problem, and if you have ever lost an afternoon to that, a version-agnostic CLI that installs and rolls back runtimes is worth more to you than any multiplier on a slide.

We would put the honest same-engine gain between a ROCm 7-era and a ROCm 10 stack on MI355X at well under 1.5×, and we would expect an independent benchmark to land somewhere near that once someone runs it with the serving version held fixed. If a third party reproduces 3.3× under those conditions, we will have been unfair and will say so.

Ten years of ROCm, and the thing most likely to win AMD developers this year is a command that installs it.

Sources

01
AMD released ROCm 10 on August 27, 2026, making ROCm.AI generally available, and claims an average 3.3x inference and 2.4x training improvement over ROCm 7 on the same hardwareToday, AMD released AMD ROCm™ 10, marking 10 years of the AMD software stack and making ROCm.AI generally available for users. ... Through AI-driven optimization of kernels, memory management and scheduling, a system configured with…” — newsroom.amd.com · primary · Sep 10
02
Footnote MI350-81 describes the inference test as ROCm 7.0 versus a preview version of ROCm.ai based on ROCm 7.2.2, tested on July 7, 2026 across GLM-5, Kimi-K2.5 and DeepSeek-R1-0528(MI350-81) Testing by AMD Performance Labs as of July 7, 2026, measuring the inference performance in tokens per second (TPS) of a system configured with an AMD Instinct MI355x 8x GPU platform and AMD ROCm 7.0 software vs a similarly…” — newsroom.amd.com · primary · Sep 10
03
The baseline Kimi run used vLLM 0.16.0 and the comparison run used vLLM 0.22.0; the baseline DeepSeek-R1 container was dated 20250915 and the comparison container 20260612Kimi ROCm Docker Image: vllm/vllm-openai-rocm:v0.16.0, vLLM version 0.16.0 DeepSeek-R1 Docker Image: rocm/7.0:...sgl-dev-v0.5.2-rocm7.0-mi35x-20250915, SGLang version V0.5.13 vs ... Kimi ROCm Docker Image: vllm/vllm-openai-rocm:v0.22.0,…” — newsroom.amd.com · primary · Sep 10
Show all 8 sources
04
The training footnote is headed ROCm 7.2.2 but lists ROCm 7.2.1 with Primus v26.3 for all three models(MI350-82) Testing by AMD Performance Labs as of July 7, 2026, measuring the training performance in tokens per second (TPS) of AMD ROCm 7.0 software vs a preview version of AMD ROCm.ai (ROCm 7.2.2 with optimizations such as Optimized…” — newsroom.amd.com · primary · Sep 10
05
ROCm Hyperloom is an autonomous agentic system that profiles workloads, identifies bottlenecks, implements changes, benchmarks and validates, targeting HIP, Triton and FlyDSL with vLLM and SGLang supportROCm Hyperloom, a key component of ROCm.AI, is an autonomous agentic system for optimizing end-to-end inference workloads across host code and GPU kernels. Hyperloom profiles workloads, identifies bottlenecks, explores optimization…” — newsroom.amd.com · primary · Sep 10
06
AMD Skills ships into Claude Code, Cursor and Codex marketplaces and an open GitHub catalog, with each skill passing structural and behavioral testingAMD Skills brings curated AMD knowledge and validated workflows into supported AI coding agents like Claude Code, Cursor and Codex, giving developers AMD-specific guidance within the tools they already use. ... The skills previewed at…” — newsroom.amd.com · primary · Sep 10
07
The ROCm CLI is a technology preview available on Windows and Linux as a prebuilt binary that does not require an existing ROCm installation, with side-by-side runtimes and rollbackThe CLI is available on Windows as well as Linux as a prebuilt binary and does not require an existing ROCm installation. It delivers managed ROCm environments, supports multiple side-by-side runtimes including runtime activation and…” — newsroom.amd.com · primary · Sep 10
08
AMD's X account announced ROCm 10 with the 3.3x inference and 2.4x training figuresMeet ROCm 10. Here are 10 things #AMDevs need to know. 1️⃣ ROCm 10 brings AI-driven development to AMD platforms 2️⃣ ️https://t.co/qLPOj1RZsV is the AI-native software experience on AMD hardware 3️⃣ https://t.co/qLPOj1RZsV delivers…” — x.com · primary · Sep 10
Up next · Keep readingHardware · 3 min read

A20 Pro is the first 2nm phone chip. The number that matters is 32 Neural Engine cores after three years at 16

Apple doubled the Neural Engine, widened memory bandwidth 50 percent, moved the DRAM off the thermal path and tripled the vapor chamber. Every one of those decisions is about running models on the phone.

Continue ↓