aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config

Commit History

Add Zephyr to mistral variants

9164704
verified

dacorvo HF staff commited on Mar 21, 2024

Remove variants from main mistral config

ef07aca
verified

dacorvo HF staff commited on Mar 21, 2024

Add mistral most popular variants

d3983e8
verified

dacorvo HF staff commited on Mar 21, 2024

Add most popular llama variants

594abb2
verified

dacorvo HF staff commited on Mar 21, 2024

Added teknium/OpenHermes-2.5-Mistral-7B

1518247
verified

dacorvo HF staff commited on Mar 8, 2024

Added Llama-70b batch_size 4 to inference cache

593822e
verified

dacorvo HF staff commited on Mar 8, 2024

Create mistral.json

b5d0afd
verified

philschmid commited on Mar 5, 2024

Create gpt2.json

3bdb891
verified

philschmid commited on Mar 5, 2024

Create inference-cache-config/llama.json

1960ccb
verified

philschmid commited on Mar 5, 2024