Hugging Face's logo

brittlewis12
/
TinyOpenHermes-1.1B-4k-GGUF

Text Generation
GGUF
English
Model card Files Community
TinyOpenHermes-1.1B-4k-GGUF
File size: 3,254 Bytes 
70fd602
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
 
---
base_model: Ba2han/TinyOpenHermes-1.1B-4k
license: cc-by-nc-4.0
datasets:
- teknium/openhermes
language:
- en
model_creator: stabilityai
model_name: stablelm-2-zephyr-1_6b
model_type: stablelm_epoch
inference: false
pipeline_tag: text-generation
prompt_template: |
  {{system_message}}
  
  ### Instruction:
  {{prompt}}
  
  ### Response:
  
quantized_by: brittlewis12
---

# TinyOpenHermes-1.1B-4k GGUF

![tinyopenhermes](https://cdn-uploads.huggingface.co/production/uploads/6324eabf05bd8a54c6eb1650/A_cMQgKaChl6Q9Vf6E3yM.png)

Original model: [TinyOpenHermes-1.1B-4k](https://huggingface.co/Ba2han/TinyOpenHermes-1.1B-4k)
Model creator: [Ba2han](https://huggingface.co/Ba2han)

This repo contains GGUF format model files for Ba2han’s TinyOpenHermes-1.1B-4k.

> Compared to TinyLlama-1.1B-Chat-v1.0:
> - Algebra UP **17.4%**
> - Formal Logic UP **24.2%**
> - Logical Fallacies UP **35.4%**

### What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
Converted using llama.cpp b1932 (revision [942c010](https://github.com/ggerganov/llama.cpp/commits/942c0107a7301434c0a5e7da46bc4cf2393aa556))

### Prompt template: Alpaca

```
{{system_message}}

### Instruction:
{{prompt}}

### Response:
```

---

## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!

![cnvrs.ai](https://pbs.twimg.com/profile_images/1744049151241797632/0mIP-P9e_400x400.jpg)

[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
- create & save **Characters** with custom system prompts & temperature settings
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
- make it your own with custom **Theme colors**
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date

---

## Original Model Evaluations:

|             Task              |Version| Metric |Value |   |Stderr|
|-------------------------------|------:|--------|-----:|---|-----:|
|hendrycksTest-logical_fallacies|      1|acc     |0.3067|±  |0.0362|
|                               |       |acc_norm|**0.3067**|±  |0.0362|
|hendrycksTest-global_facts     |      1|acc     |   0.3|±  |0.0461|
|                               |       |acc_norm|   0.3|±  |0.0461|
|hendrycksTest-abstract_algebra |      1|acc     |0.2700|±  |0.0446|
|                               |       |acc_norm|**0.2700**|±  |0.0446|
|hendrycksTest-college_chemistry|      1|acc     |0.3100|±  |0.0465|
|                               |       |acc_norm|**0.3100**|±  |0.0465|
|hendrycksTest-college_physics  |      1|acc     |0.2157|±  |0.0409|
|                               |       |acc_norm|**0.2157**|±  |0.0409|
|hendrycksTest-formal_logic     |      1|acc     |0.2857|±  |0.0404|
|                               |       |acc_norm|**0.2857**|±  |0.0404|