PrunaAI
/

togethercomputer-Llama-2-7B-32K-Instruct-HQQ-4bit-smashed

Text Generation

Inference Endpoints

Model card Files Files and versions Community

togethercomputer-Llama-2-7B-32K-Instruct-HQQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe

c6f3958 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.59 kB

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago
added_tokens.json

21 Bytes

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago
config.json

739 Bytes

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago
qmodel.pt
Detected Pickle imports (8)
- "torch.HalfStorage",
- "torch.ByteStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.uint8",
- "torch.float16",
- "torch.Size",
- "torch._utils._rebuild_parameter",
- "collections.OrderedDict"
How to fix it?
3.91 GB
LFS

c334ac11b42d12d65415b40d752dfe698096f0ac0ec5810ab8f33029a55aed90 7 months ago
smash_config.json

1.03 kB

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago
special_tokens_map.json

548 Bytes

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago
tokenizer.json

1.84 MB

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago
tokenizer.model

500 kB
LFS

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago
tokenizer_config.json

1.11 kB

a623d73ba9027e327a58bf28c9aaaffc23c7afef4fd3b82bb8e8246c4a2cacfe 7 months ago