Datasets:
Request access to MooreFrenchParallel
This repository is publicly accessible, but you have to accept the conditions to access its files and content.
MooreFrenchParallel collects publicly available French-Mooré parallel text for machine translation research. The texts belong to their publishers (listed on the card) and are shared for non-commercial research only; our work is CC BY-NC 4.0. Please read the card, its terms and licenses before requesting access, and make sure you understand them.
Log in or Sign Up to review the conditions and access this dataset content.
MooreFrenchParallel
Publicly available French-Mooré parallel text for machine translation.
MooreFrenchParallel gathers the publicly available French-Mooré parallel text we know of: news, three Bibles, dictionary examples, proverbs, word lists and the UDHR.
Access is gated and requests are reviewed by hand. Collecting and cleaning Mooré parallel text takes a lot of time and resources, and we do it mostly out of passion. Please read this card, its terms and licenses before requesting access, and make sure you understand them. Respecting them keeps this work useful to the community and helps move our local languages forward.
Résumé en français. Textes parallèles français-mooré disponibles publiquement, pour la traduction automatique : presse, trois Bibles, exemples de dictionnaire, proverbes, lexiques et la Déclaration universelle des droits de l'homme. Accès sur demande, examinée à la main, réservé à la recherche non commerciale. Collecter et nettoyer ces textes demande beaucoup de temps et de moyens, et nous le faisons surtout par passion : lisez cette carte, ses conditions et ses licences avant de demander l'accès.
Overview
| Subset | Content | Source | Terms | Pairs |
|---|---|---|---|---|
mafand-news |
News | MAFAND-MT fr-mos (Adelani et al., NAACL 2022), Masakhane | CC BY-NC 4.0 | 2,520 (MAFAND train) |
bible-mpbu |
Bible, verse-aligned | Mooré: WẼNNAAM SEBRE 2014, © Bible Society of Burkina Faso (bible.com). French: Louis Segond 1910, public domain | bible.com: personal, non-commercial use | 30,771 |
bible-sebr-songo |
Bible with deuterocanon, verse-aligned | Mooré: SEBR SÕNGO, © Alliance Biblique du Burkina Faso, 1998. French: Louis Segond 1910 (public domain); deuterocanon néo-Crampon 2022 (CC BY-SA 4.0) and Crampon 1923 (public domain) | Mooré: all rights reserved; néo-Crampon: CC BY-SA 4.0 | 34,897 |
webonary-examples |
Dictionary example sentences | Dictionnaire Mooré - français - English avec images, compiled by Urs Niggli, © 2016 SIL International | No license stated | 4,236 |
smol |
Words and sentences | Google SMOL / GATITOS (Mooré side, CC BY 4.0); French from GATITOS for words, added by us for older rows (flagged) | CC BY 4.0 | 9,147 |
udhr |
Universal Declaration of Human Rights | UN OHCHR translation, via the Unicode UDHR project | Free use | 160 |
razamwende |
Reading lessons | razamwende reading site | No terms found | 34 |
proverbs-kabore |
Proverbs | Proverbes en mooré vol. 1 to 8, French by Timothée Kaboré, published by Urs Niggli (Sagesse Africaine) | No license stated | 322 |
webonary-dictionary |
Dictionary words and glosses | Urs Niggli's Mooré dictionaries (Webonary 2021, © 2016 SIL International; Mooré Lexique 2017) | No license stated | 34,940 |
lexicon-old-spelling |
Word lists in old spelling | Probably the montivilliersnassere.fr lexicon (to confirm) | No terms found | 1,298 |
118,325 unique pairs in 10 subsets, one per source. Each pair appears once, under its primary source. default holds the 82,087 sentence-level training pairs of the first 8 subsets; dictionaries, word lists and lower-quality subsets load on their own.
Quick start
from datasets import load_dataset
ds = load_dataset("anyantudre/MooreFrenchParallel", split="train") # default
bible = load_dataset("anyantudre/MooreFrenchParallel", "bible-mpbu", split="train") # one subset
Log in first (hf auth login) with an account that has access.
Columns
| Column | Description |
|---|---|
id |
Stable id (hash of the normalized pair) |
fr, mos |
French and Mooré text |
source |
Subset of the pair |
unit |
word, phrase, sentence, verse or paragraph |
ref |
Bible reference (e.g. GEN.1.1) or entry id, when known |
french_version |
French Bible of verse pairs (lsg1910, nwt-fr-2018, ...) |
fr_note |
Explanation that came with a proverb, split off the French |
in_mafand_eval |
True if the French or Mooré equals a MAFAND dev or test sentence (here only short phrases like "Bonjour") |
flags |
Quality notes, e.g. swapped_fixed, ratio_extreme, license_pending, lower_confidence |
origins |
Earlier datasets or URLs the pair came from |
How it was built
Input: all French-Mooré collections we have been gathering since 2024, plus Bibles and dictionary examples collected in November 2026.
- Normalize: Unicode NFC, spacing, escaped quotes, swapped languages and PDF ligatures fixed; empty and URL-only rows dropped.
- Label: each pair gets its real source, public sources first when a pair is in several.
- Deduplicate: one row per pair, ignoring case and punctuation.
- Remove test data: MAFAND dev and test, FLORES+ and BOUQuET are left out and published as released in MooreMTBench. Removed: rows that repeat one of their sentences (4+ words) or share at least half of their 6-word sequences with one (9+ words), 45 rows (list in
decontamination/). Short common phrases ("Bonjour") were kept. - Align Bibles verse by verse: versification differences merged, verse bridges kept as one pair.
Evaluation
Training only: every subset has one train split. Evaluate with MooreMTBench.
Limits
- Bible verses are most of the data, so the vocabulary leans religious.
- Dictionary subsets are mostly single words; leave them out of sentence-level training if you do not want them.
- Some Mooré text uses older spellings, and some French was machine-translated (flagged).
Access
Fill in the form on this page. We approve people and institutions that say who they are, describe a research use and accept the terms. Anonymous or vague requests will not be approved.
License
- Texts: property of the owners listed above, with no license granted; shared for non-commercial research, and owners can ask for removal.
- MAFAND-MT: CC BY-NC 4.0. SMOL / GATITOS: CC BY 4.0. néo-Crampon French rows: CC BY-SA 4.0.
- Our work (alignment, cleaning, labels, metadata): CC BY-NC 4.0.
For other uses or questions, contact us: Wendyellé A. Alban NYANTUDRE (nyantudrealban@gmail.com). By accessing this dataset you agree to these terms.
Citation
@misc{nyantudre2026moorefrenchparallel,
title = {MooreFrenchParallel: Publicly available French-Mooré parallel text for machine translation},
author = {Nyantudre, Wendyellé Abubakrh Alban and Bandaogo, Aristide},
year = {2026},
howpublished = {Hugging Face Datasets (gated access)},
url = {https://huggingface.co/datasets/anyantudre/MooreFrenchParallel}
}
If you use a subset, please also cite its source (see Overview).
- Downloads last month
- 546