Subscribe
MiniCPM5-2B lands on stable vLLM the day it ships, because it invented nothing
Developers3 min read

MiniCPM5-2B lands on stable vLLM the day it ships, because it invented nothing

OpenBMB's small model tops its size class on a third of the tokens, and declines to answer seven out of ten questions it is asked.

In briefThe vLLM recipe launches the model with one command on a single GPU and uses a minicpm5 tool-call parser merged as PR #431751vLLM announced day-0 support for MiniCPM5-2B on stable vLLM on September 7, 2026, crediting the stock LlamaForCausalLM architecture and open training data2It uses the standard LlamaForCausalLM architecture so vLLM loads it with no custom kernels or model-code fork3
Updated · Sep 11, 2026, 02:58 ETThis story was revised after publication. The sources block reflects the current version.
An Nvidia graphics chip on a circuit board
Photo: Hyins (public domain)

OpenBMB shipped a small model this week and vLLM supported it the same day, on the stable branch. No fork, no nightly build, no custom kernels.

That was 7 September, and the serving project said why in its own announcement, and the thank-you is the interesting part: "thanks for keeping it on stock LlamaForCausalLM and opening the training data alongside the weights."

Day-zero support usually gets written up as a favour the serving project does the lab. We would put it closer to the other way round.

Restraint ships faster

MiniCPM5-2B is a 2.6B dense model on the standard Llama architecture, so there is no model code to write, no kernel to tune, no reviewer's weekend to spend. The recipe is one line, vllm serve openbmb/MiniCPM5-2B, on a single GPU. Tool calling needed one parser, merged as a single pull request into the same stable branch that made Model Runner V2 the default last month.

That is the entire integration cost, and OpenBMB paid most of it by declining to be clever (a decision nobody gets credit for).

Artificial Analysis scored the model the same morning at 15 on its Intelligence Index, the highest of any open-weights model under four billion total parameters. The next one down its size class sits at 11. Ling 3.0 Tiny beats it by a single point, with roughly three times the parameters.

Hold on to that last one.

The token bill matters more than the leaderboard place

OpenBMB's model used 19k output tokens per Intelligence Index task, joint-lowest in its comparison set. Ling spent 56k to earn that extra point.

So the model one place above it costs about three times as much to run per task. And if you are paying for reasoning tokens rather than reading benchmark tables, one index point is not obviously worth thirty-seven thousand of them.

The second number is stranger, and we had to work it out

Artificial Analysis published the inputs and not the ratio. On its omniscience test the model attempts only 29 percent of questions, with an accuracy of 8 percent and a non-hallucination rate of 78 percent.

Divide the accuracy by the attempt rate. Of the questions it chooses to answer, it gets roughly 28 percent right. So it is wrong about seven times in ten when it opens its mouth.

But it mostly keeps quiet. That is probably what its score of -12 is measuring, against -53 for Qwen3.5 9B and -63 for gpt-oss-20b (both of which answer far more and pay for it). Not more knowledge. A much stricter policy on guessing.

Which is the right trade at this size, and worth saying out loud. A small model that abstains is usable inside an agent loop. A small model that confabulates is a liability with a tool call attached.

Every other score follows the same shape

Its agentic numbers lead the size class. Joint-first on a banking agent benchmark at 21 percent, against 8 percent for the next model up, and a GDPval Elo of 831 at the head of its size class.

Its knowledge numbers do not follow at all. Nine percent on Humanity's Last Exam. Nine percent on Terminal-Bench, where the Qwen model gets three times as many. Zero on CritPt. One percent on a new professional document-reasoning set.

What the bar for deployability has become

Architectural restraint plus a tool parser, and it is worth more than a leaderboard place. An Apache licence, a 131K native context, Think and No-Think from a single checkpoint, and open training data. Easy to adopt in every direction at once.

We would expect the pattern to hold. Releases on stock architectures keep landing in stable vLLM on day zero through the rest of this year, while anything with bespoke attention keeps taking weeks. A custom-architecture model getting same-day stable support is the thing that would change our minds.

The counter-argument is that restraint has a ceiling. You cannot build sparse attention, a novel router or a linear-attention hybrid out of stock LlamaForCausalLM, and the models winning on long context this year are all doing exactly that. True.

But almost nobody deploys a model this small for its long context. They deploy it because it fits on the GPU they already own, and because it starts working in one command. How many models released this year can you say that about?

The open training data is the part we want other labs to copy first.

Sources

01
The vLLM recipe launches the model with one command on a single GPU and uses a minicpm5 tool-call parser merged as PR #43175“The baseline is simply: vllm serve openbmb/MiniCPM5-2B --port 8000 At ~2B params the model fits on a single GPU (TP=1). ... MiniCPM5-2B emits XML-style tool calls. The minicpm5 parser ( PR #43175 ) is natively supported in vLLM.” — recipes.vllm.ai · primary · Sep 10
02
vLLM announced day-0 support for MiniCPM5-2B on stable vLLM on September 7, 2026, crediting the stock LlamaForCausalLM architecture and open training data“Day-0 support for MiniCPM5-2B on stable vLLM. Dense 2.6B model with 131K native context Think / No-Think from the same checkpoint Tool Calling support via vLLM's minicpm5 parser Congrats @OpenBMB on the release, and thanks for keeping…” — x.com · primary · Sep 10
03
It uses the standard LlamaForCausalLM architecture so vLLM loads it with no custom kernels or model-code fork“It uses the standard LlamaForCausalLM architecture , so vLLM loads it natively with no custom kernels or model-code fork.” — recipes.vllm.ai · primary · Sep 10
Show all 9 sources
04
Artificial Analysis scored MiniCPM5-2B at 15 on Intelligence Index v4.2, the highest of any open-weights model under 4B parameters, one point behind Ling 3.0 Tiny at roughly three times the size“OpenBMB's MiniCPM5-2B scores 15 on the Artificial Analysis Intelligence Index v4.2, the highest of any open weights model under 4B total parameters ... Scoring 15 on the Intelligence Index, MiniCPM5-2B sits one point behind Ling 3.0 Tiny…” — x.com · primary · Sep 10
05
It used 19k output tokens per Intelligence Index task, joint-lowest with Granite 4.2 3B, against Ling 3.0 Tiny's 56k“It is token-efficient for a reasoning model: MiniCPM5-2B used 19k output tokens per Intelligence Index task, joint-lowest in the comparison model set with Granite 4.2 3B (19k). Ling 3.0 Tiny spends 56k, roughly 3x as many, for 1 more…” — x.com · primary · Sep 10
06
It attempts only 29% of AA-Omniscience questions with 8% accuracy and a 78% non-hallucination rate, scoring -12 against -53 for Qwen3.5 9B and -63 for gpt-oss-20b“Its AA-Omniscience score of -12 is earned by abstaining from answering rather than accuracy: MiniCPM5-2B attempts only 29% of AA-Omniscience questions, giving it a Non-Hallucination Rate of 78%. Its accuracy of 8% is a point below Ling…” — x.com · primary · Sep 10
07
Agentic scores lead the size class while knowledge and long-context scores lag“Its GDPval-AA v2 Elo of 831 leads <4B models, and on τ³-Banking it is joint-first with Ling 3.0 Tiny at 21%, compared to 8% for the next best model, Granite 4.2 8B. ... MiniCPM5-2B places 7th in the set on Humanity's Last Exam (9%,…” — x.com · primary · Sep 10
08
MiniCPM5-2B is a 2.6B dense text model with a 131k context window under Apache 2.0“Parameters: 2.6B (dense) Context window: 131k tokens Input modalities: Text only License: Apache 2.0” — x.com · primary · Sep 10
09
A single checkpoint serves both Think and No-Think modes through the chat template's enable_thinking flag“Its headline feature is hybrid reasoning : a single checkpoint serves as both a fast assistant (No-Think) and a deliberate reasoner (Think), toggled by the chat template's enable_thinking flag.” — recipes.vllm.ai · primary · Sep 10
More on Developer tools and Open-weight modelsAll Developer tools stories →
You’re 60% through. Stories like this one, Mon · Wed · Fri, with every claim sourced.