Testing, measuring and developing Welsh AI
Evaluations → Muse Wonder

Muse Wonder commercial tested

Fourth on the extended CymraegBench leaderboard with an overall score of 86.23.

Four evaluators studying abstract models in a transparent testing arena

The facts

DeveloperMeta
OpenRouter IDmeta/muse-wonder
Test pricing$4 / $20 per million tokens (input/output)
Context1,048,576 tokens
Full run cost$17.79

CymraegBench result

Overall scoreWelsh reasoningPractical WelshTranslation BLEU
86.2386.6885.7871.41

Up to 100 cases from each of the 19 core suites were used, with reasoning_effort=low. The model completed all 2,053 cases without invalid output or unresolved infrastructure errors. The parameter seed was not sent because the model’s OpenRouter route does not support it; seed 1 was still used to select cases.

Muse Wonder is fourth: 1.18 points behind Gemini 4 Argon and 1.07 points ahead of Claude Opus 5.

CCC Language Audit

SubsetScore
Correction and explanation87.66
Idiom90.63
Terminology100.00
Summarisation and quotation90.60
References90.16
Welsh prompt65.00
English prompt73.33
Average across the seven subsets85.34

Muse Wonder scored 90.63 for correction and 62.50 for explanation. Its profile was strong on terminology and references, but weaker on following the source-selection instruction in both languages.

See the full leaderboard, CCC Language Audit, or download the summary, scores by suite, CCC dimensions and the metadata.