neuralmagic
/

Phi-3.5-mini-instruct-FP8-KV

Text Generation

compressed-tensors

Model card Files Files and versions Community

mgoin commited on Sep 27, 2024

Commit

5ce2782

•

1 Parent(s): aed827e

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -2,8 +2,10 @@
 tags:
 - fp8
 - vllm
 license: mit
 license_link: https://huggingface.co/microsoft/Phi-3.5-mini-instruct/resolve/main/LICENSE
 ---
 # Phi-3.5-mini-instruct-FP8-KV

 tags:
 - fp8
 - vllm
+pipeline_tag: text-generation
 license: mit
 license_link: https://huggingface.co/microsoft/Phi-3.5-mini-instruct/resolve/main/LICENSE
+base_model: microsoft/Phi-3.5-mini-instruct
 ---
 # Phi-3.5-mini-instruct-FP8-KV