Request access to MooreFrenchParallel

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

MooreFrenchParallel collects publicly available French-Mooré parallel text for machine translation research. The texts belong to their publishers (listed on the card) and are shared for non-commercial research only; our work is CC BY-NC 4.0. Please read the card, its terms and licenses before requesting access, and make sure you understand them.

Log in or Sign Up to review the conditions and access this dataset content.

MooreFrenchParallel

Publicly available French-Mooré parallel text for machine translation.
Language: Mooré and French 118,325 pairs License: see card

MooreFrenchParallel gathers the publicly available French-Mooré parallel text we know of: news, three Bibles, dictionary examples, proverbs, word lists and the UDHR.

Access is gated and requests are reviewed by hand. Collecting and cleaning Mooré parallel text takes a lot of time and resources, and we do it mostly out of passion. Please read this card, its terms and licenses before requesting access, and make sure you understand them. Respecting them keeps this work useful to the community and helps move our local languages forward.

Résumé en français. Textes parallèles français-mooré disponibles publiquement, pour la traduction automatique : presse, trois Bibles, exemples de dictionnaire, proverbes, lexiques et la Déclaration universelle des droits de l'homme. Accès sur demande, examinée à la main, réservé à la recherche non commerciale. Collecter et nettoyer ces textes demande beaucoup de temps et de moyens, et nous le faisons surtout par passion : lisez cette carte, ses conditions et ses licences avant de demander l'accès.

Overview

Subset Content Source Terms Pairs
mafand-news News MAFAND-MT fr-mos (Adelani et al., NAACL 2022), Masakhane CC BY-NC 4.0 2,520 (MAFAND train)
bible-mpbu Bible, verse-aligned Mooré: WẼNNAAM SEBRE 2014, © Bible Society of Burkina Faso (bible.com). French: Louis Segond 1910, public domain bible.com: personal, non-commercial use 30,771
bible-sebr-songo Bible with deuterocanon, verse-aligned Mooré: SEBR SÕNGO, © Alliance Biblique du Burkina Faso, 1998. French: Louis Segond 1910 (public domain); deuterocanon néo-Crampon 2022 (CC BY-SA 4.0) and Crampon 1923 (public domain) Mooré: all rights reserved; néo-Crampon: CC BY-SA 4.0 34,897
webonary-examples Dictionary example sentences Dictionnaire Mooré - français - English avec images, compiled by Urs Niggli, © 2016 SIL International No license stated 4,236
smol Words and sentences Google SMOL / GATITOS (Mooré side, CC BY 4.0); French from GATITOS for words, added by us for older rows (flagged) CC BY 4.0 9,147
udhr Universal Declaration of Human Rights UN OHCHR translation, via the Unicode UDHR project Free use 160
razamwende Reading lessons razamwende reading site No terms found 34
proverbs-kabore Proverbs Proverbes en mooré vol. 1 to 8, French by Timothée Kaboré, published by Urs Niggli (Sagesse Africaine) No license stated 322
webonary-dictionary Dictionary words and glosses Urs Niggli's Mooré dictionaries (Webonary 2021, © 2016 SIL International; Mooré Lexique 2017) No license stated 34,940
lexicon-old-spelling Word lists in old spelling Probably the montivilliersnassere.fr lexicon (to confirm) No terms found 1,298

118,325 unique pairs in 10 subsets, one per source. Each pair appears once, under its primary source. default holds the 82,087 sentence-level training pairs of the first 8 subsets; dictionaries, word lists and lower-quality subsets load on their own.

Quick start

from datasets import load_dataset

ds = load_dataset("anyantudre/MooreFrenchParallel", split="train")                         # default
bible = load_dataset("anyantudre/MooreFrenchParallel", "bible-mpbu", split="train")       # one subset

Log in first (hf auth login) with an account that has access.

Columns

Column Description
id Stable id (hash of the normalized pair)
fr, mos French and Mooré text
source Subset of the pair
unit word, phrase, sentence, verse or paragraph
ref Bible reference (e.g. GEN.1.1) or entry id, when known
french_version French Bible of verse pairs (lsg1910, nwt-fr-2018, ...)
fr_note Explanation that came with a proverb, split off the French
in_mafand_eval True if the French or Mooré equals a MAFAND dev or test sentence (here only short phrases like "Bonjour")
flags Quality notes, e.g. swapped_fixed, ratio_extreme, license_pending, lower_confidence
origins Earlier datasets or URLs the pair came from

How it was built

Input: all French-Mooré collections we have been gathering since 2024, plus Bibles and dictionary examples collected in November 2026.

  1. Normalize: Unicode NFC, spacing, escaped quotes, swapped languages and PDF ligatures fixed; empty and URL-only rows dropped.
  2. Label: each pair gets its real source, public sources first when a pair is in several.
  3. Deduplicate: one row per pair, ignoring case and punctuation.
  4. Remove test data: MAFAND dev and test, FLORES+ and BOUQuET are left out and published as released in MooreMTBench. Removed: rows that repeat one of their sentences (4+ words) or share at least half of their 6-word sequences with one (9+ words), 45 rows (list in decontamination/). Short common phrases ("Bonjour") were kept.
  5. Align Bibles verse by verse: versification differences merged, verse bridges kept as one pair.

Evaluation

Training only: every subset has one train split. Evaluate with MooreMTBench.

Limits

  • Bible verses are most of the data, so the vocabulary leans religious.
  • Dictionary subsets are mostly single words; leave them out of sentence-level training if you do not want them.
  • Some Mooré text uses older spellings, and some French was machine-translated (flagged).

Access

Fill in the form on this page. We approve people and institutions that say who they are, describe a research use and accept the terms. Anonymous or vague requests will not be approved.

License

  • Texts: property of the owners listed above, with no license granted; shared for non-commercial research, and owners can ask for removal.
  • MAFAND-MT: CC BY-NC 4.0. SMOL / GATITOS: CC BY 4.0. néo-Crampon French rows: CC BY-SA 4.0.
  • Our work (alignment, cleaning, labels, metadata): CC BY-NC 4.0.

For other uses or questions, contact us: Wendyellé A. Alban NYANTUDRE (nyantudrealban@gmail.com). By accessing this dataset you agree to these terms.

Citation

@misc{nyantudre2026moorefrenchparallel,
  title        = {MooreFrenchParallel: Publicly available French-Mooré parallel text for machine translation},
  author       = {Nyantudre, Wendyellé Abubakrh Alban and Bandaogo, Aristide},
  year         = {2026},
  howpublished = {Hugging Face Datasets (gated access)},
  url          = {https://huggingface.co/datasets/anyantudre/MooreFrenchParallel}
}

If you use a subset, please also cite its source (see Overview).

Downloads last month
546