--- license: apache-2.0 language: - ja library_name: nemo pipeline_tag: automatic-speech-recognition --- # ASR Model Card: parakeet-ctc-1.1b-ja ## Model Details - **Model Name**: parakeet-ctc-1.1b-ja - **Type**: Automatic Speech Recognition (ASR) - **Language**: Japanese - **Framework**: NVIDIA NeMo ## Installation To use this model, you need to install the NeMo toolkit: ```bash pip install nemo-toolkit==2.0.0rc0 nemo-toolkit[asr]==2.0.0rc0 ``` ## Usage Here's a basic example of how to use the model: ```python import nemo.collections.asr as nemo_asr # Load the model nemo_model = nemo_asr.models.ASRModel.restore_from("/path/to/parakeet-ja.nemo") # Transcribe audio files audio_files = ["path/to/audio1.wav", "path/to/audio2.wav"] transcriptions = nemo_model.transcribe(audio_files) # Print transcriptions for audio_file, transcription in zip(audio_files, transcriptions): print(f"Transcription for {audio_file}: {transcription}") ``` ## Limitations - This model is specifically trained for Japanese language and may not perform well on other languages. - The accuracy of transcription may vary depending on the audio quality, background noise, and speaker accent. - The model may struggle with specialized vocabulary or technical terms not encountered during training. ## Performance The following table compares the performance of the NeMo model (Parakeet-JA) with Whisper v2 large and Whisper v3 large across different Japanese ASR datasets: | Model | Dataset | WER | CER | |----------------|-----------------------------------|--------|--------| | Whisper v2 large | japanese-asr/ja_asr.reazonspeech_test | 1.1378 | 0.3472 | | | japanese-asr/ja_asr.jsut_basic5000 | 0.8988 | 0.1063 | | | japanese-asr/ja_asr.common_voice_8_0 | 1.0314 | 0.1594 | | Whisper v3 large | japanese-asr/ja_asr.reazonspeech_test | 0.9685 | 0.2107 | | | japanese-asr/ja_asr.jsut_basic5000 | 0.9936 | 0.1360 | | | japanese-asr/ja_asr.common_voice_8_0 | 1.0178 | 0.1548 | | NeMo (parakeet-ctc-1.1b-ja) | japanese-asr/ja_asr.reazonspeech_test | 0.7785 | 0.1521 | | | japanese-asr/ja_asr.jsut_basic5000 | 0.9462 | 0.1291 | | | japanese-asr/ja_asr.common_voice_8_0 | 1.0002 | 0.1290 | ## Ethical Considerations - Ensure that you have the necessary permissions and comply with local laws when recording and transcribing audio. - Be aware of potential biases in the model, especially regarding different Japanese dialects or accents. - Consider the privacy implications of transcribing personal or sensitive conversations. ## Additional Information For more detailed information on using ASR models with the NeMo toolkit, please refer to the [NeMo ASR documentation](https://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit/asr/intro.html).