Testing, measuring and developing Welsh AI

Resources

A directory of corpora, test suites, models, tools and papers for everyone working on Welsh technology and language models. Send suggestions to aisteddfod@bangor.ai.

Four people exploring an open landscape of resources and knowledge

New catalogue: 104 items from Techiaith and Dewi Bryn Jones. The full list contains 47 models, 43 datasets, seven demos and seven Hugging Face collections covering voice, translation, language models and evaluation. Open the catalogue →

Text corpora

ResourceWhat it isLicence
CorCenCCThe National Corpus of Contemporary Welsh — over 11 million words of spoken, written and electronic WelshCC BY-NC-SA
HPLT 2.0 (cym_Latn)Web data collected and cleaned from the Internet ArchiveCC0
FineWeb-2 (cym_Latn)96 Common Crawl snapshots in over 1,000 languagesODC-By
FinePDFs (cym_Latn)Long texts from PDFs on the web, including books and reportsODC-By
Welsh Newspapers Online (National Library of Wales)1.1 million pages and 15 million articles from 1804–1919Public domain (before 1919)
Banc Trawsgrifiadau BangorAround 59,000 transcribed speech recordssee the card
Cardiff TM en–cy1.45 million translation pairsCC-BY-4.0
Llyw Cymru en–cy980,000 bilingual pairs from the Welsh GovernmentOGL
Jupiter-N datasets (Locai)nemotron-chat-welsh, Assembly Record, en–cy legislation, wikimedia_welsh and morevarious, open

Test suites and evaluations

SuiteWhat it measuresSource
arc_welsh, piqa_welsh, truthfulqa_welshScience, common sense, truthfulness (BritEval)UCL / BritLLM
llm-evals-cyA package of ten tests: vocabulary, grammar, mutations, registers, translation…techiaith, Bangor
mgsm_cyMathematical word problems (258 rows)techiaith · CC-BY-SA
COPA-cyCause-and-effect reasoning (1,500 rows)techiaith · CC-BY
welsh-cefrClassifying learning materials by CEFR level (2,658 rows + two classifiers)Cardiff
AIsteddfod’s cynghanedd testing protocolStrict-metre Welsh poetry — seven syllables, valid, original and appropriateAIsteddfod

Models trained on Welsh data

Language tools

Traditional texts (public domain)

Key papers and documents

Last updated on 5 August 2026. All links were working on that date.