File size: 770 Bytes
794406f c76b5d3 794406f c76b5d3 794406f c76b5d3 794406f c76b5d3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
library_name: transformers
tags: []
---
# Mistral 7b Self-Alignment SFT Model
The Mistral 7b Self-Alignment SFT Model is an adapter fine-tuned specifically for self-alignment and harmlessness. It has been trained using the Mistral Self-Alignment Preference Dataset, which can be accessed [here](https://huggingface.co/datasets/August4293/Preference-Dataset).
The fine-tuning process is detailed on the corresponding [GitHub page](https://github.com/August-murr/Lab/tree/main/Mistral%20Self%20Alignment), providing insights into the methodology and purpose behind the model's adaptation.
## Model Details:
- **Base Model:** Mistral 7b
- **Fine-Tuning Purpose:** Self-Alignment and Harmlessness
- **Fine-Tuning Dataset:** Mistral Self-Alignment Preference Dataset |