Hugging Face's logo

sardukar
/
openbuddy-llama3-8b-v21.1-8k-g128-q4-gemm-awq

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
sardukar commited on
Commit
158e8f2
·
verified ·
1 Parent(s): 15c5720

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ AWQ g128 4-bit version of OpenBuddy/openbuddy-llama3-8b-v21.1-8k
2
+
3
+ Check out the original model [here](https://huggingface.co/OpenBuddy/openbuddy-llama3-8b-v21.1-8k)