File size: 1,775 Bytes
326df11 43d24f9 326df11 147cdea 326df11 cee5a94 326df11 b5b0db3 5b8d6eb 326df11 dd6d077 326df11 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 |
---
license: mit
tags:
- french
- french-alpaca
- français
datasets:
- jpacifico/French-Alpaca-dataset-Instruct-110K
---
### French-Alpaca-Phi-3-mini-4k-instruct-v1.0-GGUF (q4_k_m)
*May 2024 : currently the fastest and most efficient version of French-Alpaca, the general SLM in French*
4k tokens of window context
French-Alpaca is a 3.82B params Small Language Model (SLM) based on microsoft/Phi-3-mini-4k-instruct,
fine-tuned from the original French-Alpaca-dataset entirely generated with OpenAI GPT-3.5-turbo.
The fine-tuning method is inspired from https://crfm.stanford.edu/2023/03/13/alpaca.html
This quantized q4_k_m GGUF version can be used on a CPU device, compatible llama.cpp
Now supported architecture by LM Studio.
Ready for Raspberry Pi 5 8Gb
**Usage**
* **ollama**: https://ollama.com/jpacifico/french-alpaca-3b
```bash
ollama run jpacifico/french-alpaca-3b
```
Ollama *Modelfile* best example I tested yet:
```bash
FROM ./french-alpaca-phi-3-mini-4k-instruct-Q4-v1.gguf
TEMPLATE """{{ if .System }}<|system|>
{{ .System }}<|end|>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>
"""
PARAMETER num_keep 4
PARAMETER stop "<|user|>"
PARAMETER stop "<|assistant|>"
PARAMETER stop "<|system|>"
PARAMETER stop "<|end|>"
PARAMETER stop "<|endoftext|>"
PARAMETER stop "###"
PARAMETER stop "<|fin|>"
```
**Limitations** :
The French-Alpaca models family is a quick demonstration that a small LM ( < 8B params )
can be easily fine-tuned to specialize in a particular language. It does not have any moderation mechanisms.
Developed by: Jonathan Pacifico, 2024
Model type: LLM
Language(s) (NLP): French
License: MIT
Finetuned from model : microsoft/Phi-3-mini-4k-instruct |