D 2023

Evaluating Sentence Alignment Methods in a Low-Resource Setting: An English-YorùBá Study Case

SIGNORONI, Edoardo a Pavel RYCHLÝ

Základní údaje

Originální název

Evaluating Sentence Alignment Methods in a Low-Resource Setting: An English-YorùBá Study Case

Autoři

SIGNORONI, Edoardo a Pavel RYCHLÝ

Vydání

Stroudsburg, PA 18360, Proceedings of the Sixth Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2023), od s. 123-129, 7 s. 2023

Nakladatel

Association for Computational Linguistics

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Stát vydavatele

Spojené státy

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

elektronická verze "online"

Odkazy

Označené pro přenos do RIV

Ne

Organizace

Fakulta informatiky – Masarykova univerzita – Repozitář

ISBN

978-1-959429-55-5

EID Scopus

Klíčová slova anglicky

NLP;low-resource;sentence alignment

Návaznosti

LM2023062, projekt VaV.
Změněno: 5. 4. 2025 00:52, RNDr. Daniel Jakubík

Anotace

V originále

Parallel corpora are still crucial to train effective Machine Translation systems. This is even more true for low-resource language pairs, for which Neural Machine Translation has been shown to be less robust to domain mismatch and noise. Due to time and resource constraints, parallel corpora are mostly created with sentence alignment methods which automatically infer alignments. Recent work focused on state-of-the-art pre-trained sentence embeddings-based methods which are available only for a tiny fraction of the world’s languages. In this paper, we evaluate the performance of four widely used algorithms on the low-resource English-Yorùbá language pair against a multidomain benchmark parallel corpus on two experiments involving 1-to-1 alignments with and without reordering. We find that, at least for this language pair, earlier and simpler methods are more suited to the task, all the while not requiring additional data or resources. We also report that the methods we evaluated perform differently across distinct domains, thus indicating that some approach may be better for a specific domain or textual structure.

Přiložené soubory