openbmb
/

MiniCPM-o-2_6

Model card Files Files and versions Community

bokesyo commited on 18 days ago

Commit

8670477

verified ·

1 Parent(s): 1939b37

Update README.md

Browse files

Files changed (1) hide show

README.md +7 -7

README.md CHANGED Viewed

@@ -1129,7 +1129,7 @@ else:
 ```
-#### Speech and Audio Mode
 Model initialization
@@ -1149,7 +1149,7 @@ model.tts.float()
 <hr/>
-##### Mimick
 `Mimick` task reflects a model's end-to-end speech modeling capability. The model takes audio input, and outputs an ASR transcription and subsequently reconstructs the original audio with high similarity. The higher the similarity between the reconstructed audio and the original audio, the stronger the model's foundational capability in end-to-end speech modeling.
@@ -1175,7 +1175,7 @@ res = model.chat(
 <hr/>
-##### General Speech Conversation with Configurable Voices
 A general usage scenario of MiniCPM-o 2.6 is role-playing a specific character based on the audio prompt. It will mimic the voice of the character to some extent and act like the character in text, including language style. In this mode, MiniCPM-o-2.6 will sounds **more natural and human-like**. Self-defined audio prompts can be used to customize the voice of the character in an end-to-end manner.
@@ -1217,7 +1217,7 @@ print(res)
 <hr/>
-##### Speech Conversation as an AI Assistant
 An enhanced feature of MiniCPM-o-2.6 is to act as an AI assistant, but only with limited choice of voices. In this mode, MiniCPM-o-2.6 is **less human-like and more like a voice assistant**. But it is more instruction-following.
@@ -1257,7 +1257,7 @@ print(res)
 <hr/>
-##### Instruction-to-Speech
 MiniCPM-o-2.6 can also do Instruction-to-Speech, aka **Voice Creation**. You can describe a voice in detail, and the model will generate a voice that matches the description. For more Instruction-to-Speech sample instructions, you can refer to https://voxinstruct.github.io/VoxInstruct/.
@@ -1286,7 +1286,7 @@ res = model.chat(
 <hr/>
-##### Voice Cloning
 MiniCPM-o-2.6 can also do zero-shot text-to-speech, aka **Voice Cloning**. With this mode, model will act like a TTS model.
@@ -1315,7 +1315,7 @@ res = model.chat(
 <hr/>
-##### Addressing Various Audio Understanding Tasks
 MiniCPM-o-2.6 can also be used to address various audio understanding tasks, such as ASR, speaker analysis, general audio captioning, and sound scene tagging.

 ```
+### Speech and Audio Mode
 Model initialization
 <hr/>
+#### Mimick
 `Mimick` task reflects a model's end-to-end speech modeling capability. The model takes audio input, and outputs an ASR transcription and subsequently reconstructs the original audio with high similarity. The higher the similarity between the reconstructed audio and the original audio, the stronger the model's foundational capability in end-to-end speech modeling.
 <hr/>
+#### General Speech Conversation with Configurable Voices
 A general usage scenario of MiniCPM-o 2.6 is role-playing a specific character based on the audio prompt. It will mimic the voice of the character to some extent and act like the character in text, including language style. In this mode, MiniCPM-o-2.6 will sounds **more natural and human-like**. Self-defined audio prompts can be used to customize the voice of the character in an end-to-end manner.
 <hr/>
+#### Speech Conversation as an AI Assistant
 An enhanced feature of MiniCPM-o-2.6 is to act as an AI assistant, but only with limited choice of voices. In this mode, MiniCPM-o-2.6 is **less human-like and more like a voice assistant**. But it is more instruction-following.
 <hr/>
+#### Instruction-to-Speech
 MiniCPM-o-2.6 can also do Instruction-to-Speech, aka **Voice Creation**. You can describe a voice in detail, and the model will generate a voice that matches the description. For more Instruction-to-Speech sample instructions, you can refer to https://voxinstruct.github.io/VoxInstruct/.
 <hr/>
+#### Voice Cloning
 MiniCPM-o-2.6 can also do zero-shot text-to-speech, aka **Voice Cloning**. With this mode, model will act like a TTS model.
 <hr/>
+#### Addressing Various Audio Understanding Tasks
 MiniCPM-o-2.6 can also be used to address various audio understanding tasks, such as ASR, speaker analysis, general audio captioning, and sound scene tagging.