README.md

---
license: llama2
pipeline_tag: text-generation
tags:
- llama
- llama2
---
# Introduction

Astramix is a merge of various Llama-2-7b finetune models, using [ties-merge method](https://github.com/cg123/ties-merge), thanks for [Chargoddard](https://huggingface.co/chargoddard). 
Subsequently, lora merge script was used, created by [zarakiquemparte](https://github.com/zarakiquemparte/zaraki-tools) ([link](https://huggingface.co/zarakiquemparte) to the Hugging Face profile).

Approximate rating for this model, noticed in short-time use:
* Great roleplay capabilities, limited only by model parameters.
* Poor quality reasoning, because of the model limitations.
* Almost censorship absence (yet some parts can be generated in the output).

Feel free to test the model.

Following base model used for merge: [Llama-2-7B-fp16](https://huggingface.co/TheBloke/Llama-2-7B-fp16)

#### List of models used for merge:
* [Nous-Hermes-llama-2-7b](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b)
* [airoboros-l2-7b-2.1](https://huggingface.co/jondurbin/airoboros-l2-7b-2.1)
* [orca_mini_v3_7b ](https://huggingface.co/psmathur/orca_mini_v3_7b)
* [Platypus2-7B](https://huggingface.co/garage-bAInd/Platypus2-7B)
* [Tulpar-7b-v0](https://huggingface.co/HyperbeeAI/Tulpar-7b-v0)

Then, two LoRAs was merged into basemix model, using script specified above:
* [limarp-llama2-v2](https://huggingface.co/lemonilia/limarp-llama2-v2) (Licensed under AGPLv3)
* [airoboros-lmoe-7b-2.1](https://huggingface.co/jondurbin/airoboros-lmoe-7b-2.1) (Utilizing creative version)

**Here is quantized versions of the model:**
* [GGUF fp16 and Q5_K_M](https://huggingface.co/androlike/astramix_l2_7b_gguf)
* [GPTQ 4bit 128g](https://huggingface.co/androlike/astramix_l2_7b_4bit_128g_gptq)

#### I suggest using Alpaca instruct format:
```
### Instruction:
(your instruct prompt is here)
### Response:
```
## Limitations and risks
Llama2 and its derivatives (finetunes) is licensed under LLama 2 Community License, various finetunes or (Q)LoRAs has appropriate licenses depending on used datasets in finetuning or training Low-Rank Adaptations.
This mix can generate heavily biased output, which aren't suitable for minors or common audience due to using limarp in the merge.