doberst commited on
Commit
2d0fb3b
·
verified ·
1 Parent(s): ad749c9

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -20
README.md CHANGED
@@ -1,37 +1,34 @@
1
  ---
2
  license: apache-2.0
3
  inference: false
4
- tags: [green, llmware-rag, p3,ov]
5
  ---
6
 
7
- # bling-phi-3-ov
8
 
9
- <!-- Provide a quick summary of what the model is/does. -->
10
-
11
- **bling-phi-3-ov** is an OpenVino int4 quantized version of BLING Phi-3, providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.
12
-
13
- [**bling-phi-3**](https://huggingface.co/llmware/bling-phi-3) is a fact-based question-answering model, optimized for complex business documents.
14
-
15
- Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
16
-
17
- Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)
18
 
 
19
 
20
  ### Model Description
21
 
22
  - **Developed by:** llmware
23
- - **Model type:** phi3
24
- - **Parameters:** 3.8 billion
25
- - **Model Parent:** llmware/bling-phi-3
 
26
  - **Language(s) (NLP):** English
27
  - **License:** Apache 2.0
28
- - **Uses:** Fact-based question-answering
29
- - **RAG Benchmark Accuracy Score:** 99.5
30
- - **Quantization:** int4
31
-
32
 
33
- ## Model Card Contact
 
34
 
35
- [llmware on hf](https://www.huggingface.co/llmware)
36
 
 
 
 
 
37
  [llmware website](https://www.llmware.ai)
 
1
  ---
2
  license: apache-2.0
3
  inference: false
4
+ tags: [green, llmware-rag, p1, ov]
5
  ---
6
 
7
+ # bling-tiny-llama-ov
8
 
9
+ **bling-tiny-llama-ov** is a very small, very fast fact-based question-answering model, designed for retrieval augmented generation (RAG) with complex business documents, and quantized and packaged in OpenVino int4 for AI PCs using Intel GPU, CPU and NPU.
 
 
 
 
 
 
 
 
10
 
11
+ This model is one of the smallest and fastest in the series. For higher accuracy, look at larger models in the BLING/DRAGON series.
12
 
13
  ### Model Description
14
 
15
  - **Developed by:** llmware
16
+ - **Model type:** tinyllama
17
+ - **Parameters:** 1.1 billion
18
+ - **Quantization:** int4
19
+ - **Model Parent:** [llmware/bling-tiny-llama-v0](https://www.huggingface.co/llmware/bling-tiny-llama-v0)
20
  - **Language(s) (NLP):** English
21
  - **License:** Apache 2.0
22
+ - **Uses:** Fact-based question-answering, RAG
23
+ - **RAG Benchmark Accuracy Score:** 86.5
 
 
24
 
25
+
26
+ Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
27
 
28
+ Looking for AI PC solutions, contact us at [llmware](https://www.llmware.ai)
29
 
30
+
31
+ ## Model Card Contact
32
+ [llmware on github](https://www.github.com/llmware-ai/llmware)
33
+ [llmware on hf](https://www.huggingface.co/llmware)
34
  [llmware website](https://www.llmware.ai)