---
language: 
- ca
- eu

tags:
- translation

library_name: opennmt
license: mit
metrics:
- bleu

inference: false
---

### Introduction

Catalan - Basque translation model for OpenNMT. These are the same models that we have in production at https://www.softcatala.org/traductor/.
The models are quantified for low latency.

### Usage

Install the necessary dependencies:


```bash
pip3 install ctranslate2 pyonmttok
```


Simple tokenization & translation using Python:


```python
import ctranslate2
import pyonmttok
from huggingface_hub import snapshot_download
model_dir = snapshot_download(repo_id="softcatala/translate-cat-eus", revision="main")

tokenizer=pyonmttok.Tokenizer(mode="none", sp_model_path = model_dir + "/sp_m.model")
tokenized=tokenizer.tokenize("Hola amics")

translator = ctranslate2.Translator(model_dir)
translated = translator.translate_batch([tokenized[0]])
print(tokenizer.detokenize(translated[0][0]['tokens']))
```
## Data used 

Build using https://huggingface.co/datasets/projecte-aina/CA-EU_Parallel_Corpus corpus.

## Benchmarks

| testset                               | BLEU  |
|---------------------------------------|-------|
| test dataset (from train/dev/test)   	| 27.3	|
| Flores200 dataset                     | 17.1	|

## Additional information
* https://github.com/Softcatala/nmt-models
* https://github.com/Softcatala/parallel-catalan-corpus