translate-cat-glg / model_description.txt
jordimas's picture
Update 2024-09-04 model
3b3b9a9
raw
history blame contribute delete
748 Bytes
Model description: cat-glg
Date: 2024-09-04
TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.22.0
Test data set
BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 69.4 (μ = 69.4 ± 0.9) 84.0/73.4/66.3/60.6 (BP = 0.984 ratio = 0.984 hyp_len = 194271 ref_len = 197468)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 82.6 (μ = 82.5 ± 0.7)
Flores data set
BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 32.2 (μ = 32.1 ± 0.9) 63.7/39.5/26.3/17.7 (BP = 0.977 ratio = 0.977 hyp_len = 25983 ref_len = 26582)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 59.7 (μ = 59.7 ± 0.7)