itzune
/

argostranslate_en_eu_1_0

Text2Text Generation

Model card Files Files and versions Community

urtzai commited on Nov 9, 2024

Commit

e5ba936

·

verified ·

1 Parent(s): 66df461

Update README.md

Files changed (1) hide show

README.md +10 -9

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ tags:
 # Itzune EN -> EU machine translation argos model
-This model was trained using [argostrain](https://github.com/argosopentech/argos-train) training scripts with ~12M English to Basque parallel string datasets obtained directly from the [Opus project](https://opus.nlpl.eu/).
 ## Model description
@@ -23,21 +23,22 @@ This model was trained using [argostrain](https://github.com/argosopentech/argos
 - **Target Language:** Basque
 - **License:** MIT
-<!-- ## Training Data
 The English-Basque parallel sentences were collected from the following datasets:
 | Dataset       	   | Sentences before cleaning |
 |----------------------|--------------------------:|
 | CCMatrix v1          | 7,788,871  	           |
-| EhuHac v1            | 585,210	               |
-| bible-uedin v1       | 15,893                    |
 | GNOME v1             | 652,298                   |
 | HPLT v1.1            | 610,694                   |
-| KDE4 v2              | 100,160                   |
-| OpenSubtitles	v2018  | 805,780                   |
-| Tatoeba v2023-04-12  | 2,070                     |
 | WikiMatrix v1	       | 119,480                   |
 | wikimedia v20230407  | 60,990                    |
-| XLEnt v1.2           | 800,631                   |
-| **Total**     	   | **15,653,108**            | -->

 # Itzune EN -> EU machine translation argos model
+This model was trained using [argostrain](https://github.com/argosopentech/argos-train) training scripts with 11,542,706 English to Basque parallel strings extracted from datasets obtained directly from the [Opus project](https://opus.nlpl.eu/).
 ## Model description
 - **Target Language:** Basque
 - **License:** MIT
+## Training Data
 The English-Basque parallel sentences were collected from the following datasets:
 | Dataset       	   | Sentences before cleaning |
 |----------------------|--------------------------:|
 | CCMatrix v1          | 7,788,871  	           |
+| OpenSubtitles	v2018  | 805,780                   |
+| XLEnt v1.2           | 800,631                   |
 | GNOME v1             | 652,298                   |
 | HPLT v1.1            | 610,694                   |
+| EhuHac v1            | 585,210	               |
 | WikiMatrix v1	       | 119,480                   |
+| KDE4 v2              | 100,160                   |
 | wikimedia v20230407  | 60,990                    |
+| bible-uedin v1       | 15,893                    |
+| Tatoeba v2023-04-12  | 2,070                     |
+| Wiktionary           | 629                       |
+| **Total**     	   | **11,542,706**            |