|
--- |
|
datasets: |
|
- IlyaGusev/ru_turbo_alpaca |
|
- IlyaGusev/ru_turbo_saiga |
|
- IlyaGusev/ru_sharegpt_cleaned |
|
language: |
|
- ru |
|
pipeline_tag: conversational |
|
--- |
|
|
|
Colab: [link](https://colab.research.google.com/drive/1IBh4FMJPOGZAkX7DYWnIKdav_ZcKatlP) |
|
|
|
v1: |
|
- revision 1ad1cb364e3e245a7a376884111e107cfc013911 |
|
- wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/kx2uytey/overview) |
|
- 3 datasets: ru_turbo_alpaca, ru_turbo_saiga, ru_sharegpt_cleaned |
|
- Loss: 0.883 |
|
- Context length: 2000 |
|
- Conversational template: `"<start>{role}\n{content} <end>\n"` |
|
- Possible roles: `["system", "user", "bot"]`. |
|
- System prompt: `"Ты — Сайга, русскоязычный автоматический ассистент. Ты разговариваешь с людьми и помогаешь им."` |
