Hugging Face's logo

sophiebui
/
ru-en_mtmodel

Text2Text Generation
Transformers
Safetensors
m2m_100
Generated from Trainer
Inference Endpoints
Model card Files Community
ru-en_mtmodel / README.md
sophiebui's picture
sophiebui
Model save
687acab verified
preview code
|
raw
history blame contribute delete
1.56 kB
metadata
library_name: transformers
license: mit
base_model: facebook/m2m100_418M
tags:
  - generated_from_trainer
metrics:
  - bleu
model-index:
  - name: ru-en_mtmodel
    results: []

ru-en_mtmodel

This model is a fine-tuned version of facebook/m2m100_418M on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.2755
  • Bleu: 70.991
  • Gen Len: 11.4903

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 3

Training results

Training Loss Epoch Step Validation Loss Bleu Gen Len
0.3823 1.0 15389 0.3364 66.7745 11.4427
0.2888 2.0 30778 0.2932 69.5309 11.4803
0.2336 3.0 46167 0.2755 70.991 11.4903

Framework versions

  • Transformers 4.45.2
  • Pytorch 2.4.1+cu121
  • Datasets 3.0.1
  • Tokenizers 0.20.1