Leaderboard

Muse Spark 1.3 Contributor

meta/muse-spark-1.3-contributor

Hostedmeta107 tok/sopenrouterserved by Meta1M context
Run recordCompare
Overall score
66

108 of 153 test cases fully passed

Scores by task

Scores give partial credit. Passed counts fully correct answers only. Select a task to read its test cases.

  1. 57Agents12 of 21 passedp90 latency 8m 42s
  2. 90Structured Extraction19 of 21 passedp90 latency 1m 21s
  3. 48Coding10 of 21 passedp90 latency 3m 5s
  4. 81Grounded Answers17 of 21 passedp90 latency 1m 12s
  5. 84Instruction Following17 of 21 passedp90 latency 2m 5s
  6. 76Business Logic16 of 21 passedp90 latency 1m 47s
  7. 76Security & permissions16 of 21 passedp90 latency 5m 57s
  8. 17Diagnosis & investigation1 of 6 passedp90 latency 5m 52s

Run it yourself

The API call the benchmark made, and the settings behind this score.

Deployment
Hosted
API
OpenRouter
Serving provider
Meta
Precision
Provider default
Context window
1M
Throughput
107 tok/s
Cost of a suite run
$0.41
Cost per case
$0.0027
Time per case
1m 42s
Measured
2026-10-05
Run this buildOpenRouterHosted
curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"meta/muse-spark-1.3-contributor","provider":{"order":["meta"],"allow_fallbacks":false},"service_tier":"default","messages":[{"role":"user","content":"Hello"}]}'

The request the benchmark sent, pinned to the provider that served it.

One email when a new model lands on the board or in the showcase. Unsubscribe anytime.