Testing done.

It performs really well in complex scenario and follows the character card quite well. The char card and previous message can affect a lot to the next reply style.

The main idea is instead of merging models to create new model, I try to put these best model into mixtral so it can work together. And the result is good, every model has its uniqueness and strength.

Downside? it only support 8k (8192) context length...

Alpaca prompting format.

Downloads last month
8
Safetensors
Model size
24.2B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for R136a1/BeyondInfinity-4x7B

Finetunes
1 model
Quantizations
3 models