llmixer
/

QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2 / README.md

llmixer's picture

Update README.md

97ee585 verified 11 months ago

|

history blame contribute delete

258 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 6.0bpw
  - h6
  - exl2

Exllamav2 6.0bpw h6 quant for alchemonaut/QuartetAnemoi-70B-t0.0001.

Default calibration dataset.