README.md

---
license: other
---
# Join our Discord! https://discord.gg/Nbv9pQ88Xb

### Works on [Kobold 1.72](https://github.com/LostRuins/koboldcpp/releases/tag/v1.72) and [Layla (iOS / Android)](https://www.layla-network.ai/)

---

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/HjVYV2h_YTL9P-insb7fz.png)

[BeaverAI](https://huggingface.co/BeaverAI) team proudly presents

# Gemmasutra Mini 2B v1 🧘

*Gemma's been training for ALL of you.*

![image/webp](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/w0Oi8TReoQNT3ljm5Wf6c.webp)

*A tiny RP model packing an unbelievable PUNCH. Finetuned by yours truly.*

## Description

Gone are the days when models below 7B were too small to give you a satisfying RP experience.

Gemmasutra Mini 2B v1 marks the beginning of a new chapter in our local LLM community.

Be it in your browser, your crappy laptop, your mid-tier phone running [Layla](https://www.layla-network.ai/), or your Raspberry Pi...

This lil 2B will give you a playthrough worth having.

A model for thee, a model for all!

*(And yes, it is uncensored and unaligned. Enjoy!)*

## Links

- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
- iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1_iMatrix_GGUF
- Mobile (ARM) (Q4_0_X_X): https://huggingface.co/SicariusSicariiStuff/TheDrummer_Gemmasutra-Mini-2B-v1_ARM
## Usage

- For the best experience, use the Gemma Instruct template and modify it to support the `system` role (e.g., `<start_of_turn>system`)
- Chat Completion works well too
- Don't use it for Math

## Examples

A big thanks to @kurgan1138 for most of the logs!

### SFW

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/IstS_eSV_Z52jII1UkZ7d.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/eLU-AlpTd8VCI9H7gOmX2.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/Rnpwj1XE0CflOnOyJtJSK.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/7Y9x9A2HYoyfMkrBpBeO4.png)

#### 4K context

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/te_wnC9Tcg2BVeLrtARjr.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/oTiXmVmK7KiI26wgHmS1u.png)

### NSFW NSFW NSFW NSFW NSFW
### NSFW NSFW NSFW NSFW NSFW
### NSFW NSFW NSFW NSFW NSFW

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/J9SwuYQBULHY9Wobljv5V.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/qhCgIEAeXJqA0Msq5mAFA.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/RkgOg_mvjADiXgb5859gm.png)

#### Forgiveness Meter

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/_NnPS-kwD7ZpoWUa3wvux.png)

#### Group Character

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/TxF2YbcUwJOtcqxWSKybZ.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/CQKkSq6lXj7yKuwcoPdeQ.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/4uWEjHylkhgPOu1UTkg8w.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/q0KFuHhh3ybz51DQze89G.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/Ll8CA5RR7ugTi72P2HBb8.png)