|
--- |
|
base_model: Ba2han/TinyOpenHermes-1.1B-4k |
|
license: cc-by-nc-4.0 |
|
datasets: |
|
- teknium/openhermes |
|
language: |
|
- en |
|
model_creator: stabilityai |
|
model_name: stablelm-2-zephyr-1_6b |
|
model_type: stablelm_epoch |
|
inference: false |
|
pipeline_tag: text-generation |
|
prompt_template: | |
|
{{system_message}} |
|
|
|
|
|
{{prompt}} |
|
|
|
|
|
|
|
quantized_by: brittlewis12 |
|
--- |
|
|
|
# TinyOpenHermes-1.1B-4k GGUF |
|
|
|
 |
|
|
|
Original model: [TinyOpenHermes-1.1B-4k](https://huggingface.co/Ba2han/TinyOpenHermes-1.1B-4k) |
|
Model creator: [Ba2han](https://huggingface.co/Ba2han) |
|
|
|
This repo contains GGUF format model files for Ba2han’s TinyOpenHermes-1.1B-4k. |
|
|
|
> Compared to TinyLlama-1.1B-Chat-v1.0: |
|
> - Algebra UP **17.4%** |
|
> - Formal Logic UP **24.2%** |
|
> - Logical Fallacies UP **35.4%** |
|
|
|
### What is GGUF? |
|
|
|
GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. |
|
Converted using llama.cpp b1932 (revision [942c010](https://github.com/ggerganov/llama.cpp/commits/942c0107a7301434c0a5e7da46bc4cf2393aa556)) |
|
|
|
### Prompt template: Alpaca |
|
|
|
``` |
|
{{system_message}} |
|
|
|
### Instruction: |
|
{{prompt}} |
|
|
|
### Response: |
|
``` |
|
|
|
--- |
|
|
|
## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac! |
|
|
|
 |
|
|
|
[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device: |
|
- create & save **Characters** with custom system prompts & temperature settings |
|
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)! |
|
- make it your own with custom **Theme colors** |
|
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming! |
|
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)! |
|
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date |
|
|
|
--- |
|
|
|
## Original Model Evaluations: |
|
|
|
| Task |Version| Metric |Value | |Stderr| |
|
|-------------------------------|------:|--------|-----:|---|-----:| |
|
|hendrycksTest-logical_fallacies| 1|acc |0.3067|± |0.0362| |
|
| | |acc_norm|**0.3067**|± |0.0362| |
|
|hendrycksTest-global_facts | 1|acc | 0.3|± |0.0461| |
|
| | |acc_norm| 0.3|± |0.0461| |
|
|hendrycksTest-abstract_algebra | 1|acc |0.2700|± |0.0446| |
|
| | |acc_norm|**0.2700**|± |0.0446| |
|
|hendrycksTest-college_chemistry| 1|acc |0.3100|± |0.0465| |
|
| | |acc_norm|**0.3100**|± |0.0465| |
|
|hendrycksTest-college_physics | 1|acc |0.2157|± |0.0409| |
|
| | |acc_norm|**0.2157**|± |0.0409| |
|
|hendrycksTest-formal_logic | 1|acc |0.2857|± |0.0404| |
|
| | |acc_norm|**0.2857**|± |0.0404| |
|
|
