Model Card for Model ID

Model Details

Fine tuned with LoRa and merged. Parla Speech HR dataset + augmented additions. Full fine-tuned version is still in training.

LoRa adapters: slsolucije/whisper-large-v3-turbo-hr-parla-lora-adapters

WER comparsion

Dataset Model WER (%)
google/fleurs hr_hr test openai/whisper-base 65.99
google/fleurs hr_hr test openai/whisper-large-v3-turbo 12.73
google/fleurs hr_hr test slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged 9.93
GoranS/stt-croatian_99k_265_2 test openai/whisper-large-v3-turbo 22.93
GoranS/stt-croatian_99k_265_2 test slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged 19.02
GoranS/stt-croatian-sl-31k test openai/whisper-large-v3-turbo 21.62
GoranS/stt-croatian-sl-31k test slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged 17.07
parla_867k_2483_0.5 test openai/whisper-large-v3-turbo 10.23
parla_867k_2483_0.5 test slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged 4.58

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Language(s): Croatian (hr)
  • Finetuned from model: openai/whisper-large-v3-turbo
Downloads last month
48
Safetensors
Model size
809M params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged

Finetuned
(137)
this model