atcsecure
/

frankenmoe-8x7b-exl2_6_0

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

frankenmoe-8x7b-exl2_6_0 / config.json

Commit History

update config.json - quantization_config - set bits to 6

f6eca26
verified

atcsecure commited on Apr 8, 2024

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0

45bbd44
verified

atcsecure commited on Apr 7, 2024