Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
OliP
/
Phi-3-mini-128k-instruct-awq
like
2
Text Generation
Transformers
Safetensors
phi3
conversational
custom_code
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
OliP
commited on
Jul 9, 2024
Commit
9b8ad61
·
verified
·
1 Parent(s):
5295626
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+2
-0
README.md
ADDED
Viewed
@@ -0,0 +1,2 @@
1
+
Phi-3-mini-128k-instruct-awq is a quantized version of Phi-3-mini-128k-instruct created by [AutoAWQ](https://github.com/casper-hansen/AutoAWQ).
2
+
[Requires vllm>=v0.5.1](https://github.com/vllm-project/vllm/releases).