eng-mkh

opus-2020-06-28.zip

• dataset: opus
• model: transformer
• source language(s): eng
• target language(s): kha khm khm_Latn mnw vie vie_Hani
• model: transformer
• pre-processing: normalization + SentencePiece (spm32k,spm32k)
• a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
• download: opus-2020-06-28.zip
• test set translations: opus-2020-06-28.test.txt
• test set scores: opus-2020-06-28.eval.txt

Benchmarks

testset	BLEU	chr-F
Tatoeba-test.eng-kha.eng.kha	0.4	0.054
Tatoeba-test.eng-khm.eng.khm	0.2	0.240
Tatoeba-test.eng-mnw.eng.mnw	0.9	0.003
Tatoeba-test.eng.multi	20.1	0.354
Tatoeba-test.eng-vie.eng.vie	33.6	0.512

opus-2020-07-27.zip

• dataset: opus
• model: transformer
• source language(s): eng
• target language(s): kha khm khm_Latn mnw vie vie_Hani
• model: transformer
• pre-processing: normalization + SentencePiece (spm32k,spm32k)
• a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
• download: opus-2020-07-27.zip
• test set translations: opus-2020-07-27.test.txt
• test set scores: opus-2020-07-27.eval.txt

Benchmarks

testset	BLEU	chr-F
Tatoeba-test.eng-kha.eng.kha	0.1	0.015
Tatoeba-test.eng-khm.eng.khm	0.2	0.226
Tatoeba-test.eng-mnw.eng.mnw	0.7	0.003
Tatoeba-test.eng.multi	16.5	0.330
Tatoeba-test.eng-vie.eng.vie	33.7	0.513