Yibin Lei
commited on
Commit
·
f8162c5
1
Parent(s):
a0b87bd
Update readme
Browse files
README.md
CHANGED
@@ -8654,6 +8654,8 @@ model-index:
|
|
8654 |
|
8655 |
LENS is a model that produces **L**exicon-based **E**mbeddi**N**g**S** (LENS) leveraging large language models. Each dimension of the embeddings is designed to correspond to a token cluster where semantically similar tokens are grouped together. These embeddings have a similar feature size as dense embeddings, with LENS-d8000 offering 8000-dimensional representations.
|
8656 |
|
|
|
|
|
8657 |
## Usage
|
8658 |
```
|
8659 |
git clone https://huggingface.co/yibinlei/LENS-d8000
|
|
|
8654 |
|
8655 |
LENS is a model that produces **L**exicon-based **E**mbeddi**N**g**S** (LENS) leveraging large language models. Each dimension of the embeddings is designed to correspond to a token cluster where semantically similar tokens are grouped together. These embeddings have a similar feature size as dense embeddings, with LENS-d8000 offering 8000-dimensional representations.
|
8656 |
|
8657 |
+
The technical report of **LENS** is available in [Enhancing Lexicon-Based Text Embeddings with Large Language Models](https://arxiv.org/abs/2501.09749).
|
8658 |
+
|
8659 |
## Usage
|
8660 |
```
|
8661 |
git clone https://huggingface.co/yibinlei/LENS-d8000
|