R136a1's picture
Create README.md
e2cfdaa verified
metadata
language:
  - en
license: apache-2.0
tags:
  - safetensors
  - mixtral
  - not-for-all-audiences
  - nsfw

InfinityLake-2x7B

Q8_0 GGUF quant forInfinityLake-2x7B. imatrix file provided for other quant if you want.

Experimental model from Endevor/InfinityRP-v1-7B and senseable/WestLake-7B-v2 models. Merged to MoE model with 2x7B parameters.

Okay enough. similar to InfinityKuno-2x7B but more creative.

Switch: FP16 - GGUF