Robert Shaw's picture

16 6 5

Robert Shaw

robertgshaw2

·

rsnm2

AI & ML interests

None yet

Recent Activity

new activity about 7 hours ago

nm-testing/pixtral-12b-w4a16-actorder-group:What is an actorder group and what are the advantages of running this in vLLM?

new activity 21 days ago

neuralmagic/Sparse-Llama-3.1-8B-2of4:Can I apply a LoRA?

new activity 21 days ago

nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic:Nice model, any info on scripts used to quantize?

View all activity

Organizations

models 15

robertgshaw2/llama-3-act-order

Updated Oct 9, 2024 • 2

robertgshaw2/llama-3-w8a8-dynamic-per-token-test

Text Generation • Updated Jun 15, 2024 • 29

robertgshaw2/llama-3-w8a8-static-per-tensor-test

Text Generation • Updated Jun 15, 2024 • 27

robertgshaw2/tinyllama-sq-test

Text Generation • Updated Apr 14, 2024 • 12

robertgshaw2/tinyllama-24-int4

Text Generation • Updated Apr 9, 2024 • 14

robertgshaw2/tinyllama-24-int4-dequantized

Text Generation • Updated Apr 9, 2024 • 14

robertgshaw2/tinyllama-awq-marlin

Text Generation • Updated Mar 30, 2024 • 14 • 1

robertgshaw2/tinyllama-test

Text Generation • Updated Mar 24, 2024 • 11

robertgshaw2/zephyr-7b-beta-channelwise-marlin

Text Generation • Updated Feb 18, 2024 • 3.16k

robertgshaw2/zephyr-7b-beta-channelwise-gptq

Text Generation • Updated Feb 18, 2024 • 8.91k

datasets

None public yet