ayameRushia
commited on
Commit
Β·
2cd2df2
1
Parent(s):
4fe64b9
update model card README.md
Browse files
README.md
ADDED
@@ -0,0 +1,71 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- generated_from_trainer
|
5 |
+
datasets:
|
6 |
+
- common_voice
|
7 |
+
model-index:
|
8 |
+
- name: ''
|
9 |
+
results: []
|
10 |
+
---
|
11 |
+
|
12 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
13 |
+
should probably proofread and complete it, then remove this comment. -->
|
14 |
+
|
15 |
+
#
|
16 |
+
|
17 |
+
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the common_voice dataset.
|
18 |
+
It achieves the following results on the evaluation set:
|
19 |
+
- Loss: 0.3205
|
20 |
+
- Wer: 0.3084
|
21 |
+
|
22 |
+
## Model description
|
23 |
+
|
24 |
+
More information needed
|
25 |
+
|
26 |
+
## Intended uses & limitations
|
27 |
+
|
28 |
+
More information needed
|
29 |
+
|
30 |
+
## Training and evaluation data
|
31 |
+
|
32 |
+
More information needed
|
33 |
+
|
34 |
+
## Training procedure
|
35 |
+
|
36 |
+
### Training hyperparameters
|
37 |
+
|
38 |
+
The following hyperparameters were used during training:
|
39 |
+
- learning_rate: 5e-05
|
40 |
+
- train_batch_size: 32
|
41 |
+
- eval_batch_size: 8
|
42 |
+
- seed: 42
|
43 |
+
- gradient_accumulation_steps: 2
|
44 |
+
- total_train_batch_size: 64
|
45 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
46 |
+
- lr_scheduler_type: linear
|
47 |
+
- lr_scheduler_warmup_steps: 400
|
48 |
+
- num_epochs: 80.0
|
49 |
+
- mixed_precision_training: Native AMP
|
50 |
+
|
51 |
+
### Training results
|
52 |
+
|
53 |
+
| Training Loss | Epoch | Step | Validation Loss | Wer |
|
54 |
+
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
55 |
+
| 6.3683 | 8.77 | 500 | 3.1280 | 1.0 |
|
56 |
+
| 1.9915 | 17.54 | 1000 | 0.6600 | 0.6444 |
|
57 |
+
| 0.6565 | 26.32 | 1500 | 0.4208 | 0.4486 |
|
58 |
+
| 0.4484 | 35.09 | 2000 | 0.3885 | 0.4006 |
|
59 |
+
| 0.3573 | 43.86 | 2500 | 0.3548 | 0.3626 |
|
60 |
+
| 0.3063 | 52.63 | 3000 | 0.3375 | 0.3430 |
|
61 |
+
| 0.2751 | 61.4 | 3500 | 0.3359 | 0.3241 |
|
62 |
+
| 0.2511 | 70.18 | 4000 | 0.3222 | 0.3108 |
|
63 |
+
| 0.2361 | 78.95 | 4500 | 0.3205 | 0.3084 |
|
64 |
+
|
65 |
+
|
66 |
+
### Framework versions
|
67 |
+
|
68 |
+
- Transformers 4.17.0.dev0
|
69 |
+
- Pytorch 1.10.1+cu102
|
70 |
+
- Datasets 1.18.3
|
71 |
+
- Tokenizers 0.11.0
|
wandb/run-20220204_170031-gzsqxey3/files/output.log
CHANGED
@@ -4851,3 +4851,27 @@ Configuration saved in ./preprocessor_config.json
|
|
4851 |
Saving model checkpoint to ./
|
4852 |
Configuration saved in ./config.json
|
4853 |
Model weights saved in ./pytorch_model.bin
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4851 |
Saving model checkpoint to ./
|
4852 |
Configuration saved in ./config.json
|
4853 |
Model weights saved in ./pytorch_model.bin
|
4854 |
+
Configuration saved in ./preprocessor_config.json
|
4855 |
+
|
4856 |
+
|
4857 |
+
|
4858 |
+
|
4859 |
+
|
4860 |
+
|
4861 |
+
|
4862 |
+
|
4863 |
+
|
4864 |
+
|
4865 |
+
|
4866 |
+
|
4867 |
+
|
4868 |
+
|
4869 |
+
|
4870 |
+
|
4871 |
+
|
4872 |
+
|
4873 |
+
|
4874 |
+
Upload file pytorch_model.bin: 98%|βββββββββββββββββββββββββββββββββ| 1.15G/1.18G [00:40<00:00, 29.7MB/s]To https://huggingface.co/ayameRushia/wav2vec2-large-xls-r-300m-el
|
4875 |
+
d144cd4..4fe64b9 main -> main
|
4876 |
+
Upload file pytorch_model.bin: 100%|βββββββββββββββββββββββββββββββββ| 1.18G/1.18G [00:41<00:00, 30.5MB/s]
|
4877 |
+
02/04/2022 20:59:39 - WARNING - huggingface_hub.repository - To https://huggingface.co/ayameRushia/wav2vec2-large-xls-r-300m-el
|
wandb/run-20220204_170031-gzsqxey3/logs/debug-internal.log
CHANGED
@@ -8465,3 +8465,34 @@
|
|
8465 |
2022-02-04 20:58:33,145 DEBUG SenderThread:622748 [sender.py:send():234] send: stats
|
8466 |
2022-02-04 20:58:40,211 DEBUG HandlerThread:622748 [handler.py:handle_request():130] handle_request: stop_status
|
8467 |
2022-02-04 20:58:40,211 DEBUG SenderThread:622748 [sender.py:send_request():248] send_request: stop_status
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
8465 |
2022-02-04 20:58:33,145 DEBUG SenderThread:622748 [sender.py:send():234] send: stats
|
8466 |
2022-02-04 20:58:40,211 DEBUG HandlerThread:622748 [handler.py:handle_request():130] handle_request: stop_status
|
8467 |
2022-02-04 20:58:40,211 DEBUG SenderThread:622748 [sender.py:send_request():248] send_request: stop_status
|
8468 |
+
2022-02-04 20:58:55,378 DEBUG HandlerThread:622748 [handler.py:handle_request():130] handle_request: stop_status
|
8469 |
+
2022-02-04 20:58:55,379 DEBUG SenderThread:622748 [sender.py:send_request():248] send_request: stop_status
|
8470 |
+
2022-02-04 20:59:01,230 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8471 |
+
2022-02-04 20:59:03,232 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8472 |
+
2022-02-04 20:59:03,357 DEBUG SenderThread:622748 [sender.py:send():234] send: stats
|
8473 |
+
2022-02-04 20:59:05,233 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8474 |
+
2022-02-04 20:59:07,234 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8475 |
+
2022-02-04 20:59:09,236 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8476 |
+
2022-02-04 20:59:10,605 DEBUG HandlerThread:622748 [handler.py:handle_request():130] handle_request: stop_status
|
8477 |
+
2022-02-04 20:59:10,606 DEBUG SenderThread:622748 [sender.py:send_request():248] send_request: stop_status
|
8478 |
+
2022-02-04 20:59:11,237 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8479 |
+
2022-02-04 20:59:13,239 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8480 |
+
2022-02-04 20:59:15,240 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8481 |
+
2022-02-04 20:59:17,242 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8482 |
+
2022-02-04 20:59:19,244 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8483 |
+
2022-02-04 20:59:21,246 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8484 |
+
2022-02-04 20:59:23,247 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8485 |
+
2022-02-04 20:59:25,249 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8486 |
+
2022-02-04 20:59:25,776 DEBUG HandlerThread:622748 [handler.py:handle_request():130] handle_request: stop_status
|
8487 |
+
2022-02-04 20:59:25,776 DEBUG SenderThread:622748 [sender.py:send_request():248] send_request: stop_status
|
8488 |
+
2022-02-04 20:59:27,250 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8489 |
+
2022-02-04 20:59:29,251 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8490 |
+
2022-02-04 20:59:31,252 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8491 |
+
2022-02-04 20:59:33,254 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8492 |
+
2022-02-04 20:59:33,537 DEBUG SenderThread:622748 [sender.py:send():234] send: stats
|
8493 |
+
2022-02-04 20:59:35,255 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8494 |
+
2022-02-04 20:59:37,259 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8495 |
+
2022-02-04 20:59:39,261 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
8496 |
+
2022-02-04 20:59:40,934 DEBUG HandlerThread:622748 [handler.py:handle_request():130] handle_request: stop_status
|
8497 |
+
2022-02-04 20:59:40,934 DEBUG SenderThread:622748 [sender.py:send_request():248] send_request: stop_status
|
8498 |
+
2022-02-04 20:59:41,262 INFO Thread-8 :622748 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-el/wandb/run-20220204_170031-gzsqxey3/files/output.log
|
wandb/run-20220204_170031-gzsqxey3/run-gzsqxey3.wandb
CHANGED
Binary files a/wandb/run-20220204_170031-gzsqxey3/run-gzsqxey3.wandb and b/wandb/run-20220204_170031-gzsqxey3/run-gzsqxey3.wandb differ
|
|