Exl2
Collection
Models that we have quantized to exllamav2's quantization format
•
22 items
•
Updated
•
2
TinyLlama-1.1B-ckpt-2.5T-exl2
EXL2 quants of TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T intended for use in speculative decoding.
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.