atcsecure
/

frankenmoe-8x7b-exl2_6_0

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

frankenmoe-8x7b-exl2_6_0

1 contributor

History: 3 commits

atcsecure's picture

update config.json - quantization_config - set bits to 6

f6eca26 verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

2.15 kB

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
config.json

1.08 kB

update config.json - quantization_config - set bits to 6 10 months ago
huggingface-metadata.txt

1.22 kB

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
model.safetensors.index.json

88.7 kB

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
output-00001-of-00005.safetensors

8.59 GB
LFS

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
output-00002-of-00005.safetensors

8.59 GB
LFS

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
output-00003-of-00005.safetensors

8.57 GB
LFS

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
output-00004-of-00005.safetensors

8.57 GB
LFS

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
output-00005-of-00005.safetensors

867 MB
LFS

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
special_tokens_map.json

509 Bytes

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
tokenizer.json

1.8 MB

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
tokenizer.model

493 kB
LFS

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago
tokenizer_config.json

1.06 kB

mhm-8x7B-FrankenMoE-v1.0 - exl2 6.0 10 months ago