README.md

---
base_model:
- ChaoticNeutrals/BuRP_7B
- Endevor/InfinityRP-v1-7B
library_name: transformers
tags:
- mergekit
- merge
- roleplay
license: other
inference: false
language:
- en
---

This repository hosts GGUF-IQ-Imatrix quants for [jeiku/BuRPInfinity_9B](https://huggingface.co/jeiku/BuRPInfinity_9B).

Thanks @jeiku for merging this!

This is an experimental model. Feedback is appreciated as always.

**Steps:**

```
Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
```
*Using the latest llama.cpp at the time.*

```python
    quantization_options = [
        "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
        "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
    ]
```

---

# BuRPInfinity_9B

![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/626dfb8786671a29c715f8a9/l8WTAhHEV-SKQ8_BZs_ZH.jpeg)

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the passthrough merge method.

### Models Merged

The following models were included in the merge:
* [ChaoticNeutrals/BuRP_7B](https://huggingface.co/ChaoticNeutrals/BuRP_7B)
* [Endevor/InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
slices:
  - sources:
      - model: Endevor/InfinityRP-v1-7B
        layer_range: [0, 20]
  - sources:
      - model: ChaoticNeutrals/BuRP_7B
        layer_range: [12, 32]
merge_method: passthrough
dtype: float16
```