Nemotron 3 Ultra

nvidia/nemotron-3-ultra-550b-a55b:free

openrouter1 build benchmarkedbest build nvidia21 tok/s
best build

Scores at a glance

overall47
Tool Calling469/27
Structured Output4111/27
RAG / Retrieval QA226/27
Context Recall7814/18
Coding7416/27
Reasoning & Math329/28
Instruction Following298/28
Classification4112/29
Summarization5616/27
0255075100

0–100 per task · n/m = cases passed (scores credit partial passes) · overall = mean across tasks

best build
config
deployment

nvidia

quantization
harness
openrouter
context
1M
memory
throughput
21 tok/s
cost / run
$0
provider
openrouter
run
2026-08-06
run this buildOpenRouterhosted
curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"nvidia/nemotron-3-ultra-550b-a55b:free","messages":[{"role":"user","content":"Hello"}]}'

Hosted API — not self-hostable. This is the call the benchmark made; try it live in the Playground.

record
per-test results

Full run record

Per-test scores, full transcripts, and the reproduce recipe.

open the run record →