Hugging Face's logo

jinaai
/
jina-embeddings-v2-small-en

Feature Extraction
sentence-transformers
PyTorch
Core ML
ONNX
Safetensors
English
bert
sentence-similarity
mteb
custom_code
Eval Results
text-embeddings-inference
Model card Files Community
21

Using jinaai/jina-embeddings-v2-small-en crashes due to OOM whereas using BAAI/bge-small-en-v1.5 works on the same machine

#21
by LakshyAAAgrawal - opened
Discussion
LakshyAAAgrawal

As the title suggests. I am trying to use jinaai/jina-embeddings-v2-small-en with LlamaIndex locally to perform RAG. I am using trust_remote_code=True already. Is there any way to reduce the memory usage for embedding?

Sign up or log in to comment