YangWang92

yangwang92's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in nvidia/Llama-3.1-Nemotron-70B-Instruct-HF 2 months ago

Will quantised version be available?

4

#9 opened 3 months ago by

angerhang

How to inference it on a 40 GB A100 and 80 GB Ram of Colab PRO?

1

#17 opened 2 months ago by

SadeghPouriyan

commented 2 papers 3 months ago

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models

Paper • 2409.17066 • Published Sep 25, 2024 • 27 •

4

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models

Paper • 2409.17066 • Published Sep 25, 2024 • 27 •

4

New activity in huggingface/HuggingDiscussions 3 months ago

[FEEDBACK] Daily Papers

104

#32 opened 7 months ago by

kramp