PrunaAI
/

cognitivecomputations-dolphin-2.9-llama3-8b-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

cognitivecomputations-dolphin-2.9-llama3-8b-AWQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7

4e0a1ad verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

5.45 kB

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago
config.json

867 Bytes

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago
generation_config.json

142 Bytes

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago
model-00001-of-00002.safetensors

4.68 GB
LFS

3c04afac993e32df3f34cb20ffea540ea2a3f8de432ce27a11448ee87a0c5692 10 months ago
model-00002-of-00002.safetensors

1.05 GB
LFS

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago
model.safetensors.index.json

63.5 kB

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago
plots.png

589 kB

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago
results.json

1.75 kB

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago
smash_config.json

1.03 kB

a74efea06fd7a3af13f2f75549c24efaea4002727014e25bb4047ab04d3bf8e7 10 months ago