metadata

base_model: Felladrin/TinyMistral-248M-Evol-Instruct
datasets:
  - KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
inference: false
license: apache-2.0
model_creator: Felladrin
model_name: TinyMistral-248M-Evol-Instruct
pipeline_tag: text-generation
quantized_by: afrideva
tags:
  - autotrain
  - text-generation
  - gguf
  - ggml
  - quantized
  - q2_k
  - q3_k_m
  - q4_k_m
  - q5_k_m
  - q6_k
  - q8_0
widget:
  - text: |-
      ### Instruction:
      Which places do you recommend I visit around the world?

      ### Response:
  - text: |-
      ### Instruction:
      Write a story about some magical place.

      ### Response:
  - text: |-
      ### Instruction:
      Tell me all you know about the Earth.

      ### Response:

  # Felladrin/TinyMistral-248M-Evol-Instruct-GGUF

  Quantized GGUF model files for [TinyMistral-248M-Evol-Instruct](https://huggingface.co/Felladrin/TinyMistral-248M-Evol-Instruct) from [Felladrin](https://huggingface.co/Felladrin)


  | Name | Quant method | Size |
  | ---- | ---- | ---- |
  | [tinymistral-248m-evol-instruct.fp16.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.fp16.gguf) | fp16 | 496.82 MB  |

| tinymistral-248m-evol-instruct.q2_k.gguf | q2_k | 115.26 MB | | tinymistral-248m-evol-instruct.q3_k_m.gguf | q3_k_m | 130.08 MB | | tinymistral-248m-evol-instruct.q4_k_m.gguf | q4_k_m | 155.67 MB | | tinymistral-248m-evol-instruct.q5_k_m.gguf | q5_k_m | 179.23 MB | | tinymistral-248m-evol-instruct.q6_k.gguf | q6_k | 204.26 MB | | tinymistral-248m-evol-instruct.q8_0.gguf | q8_0 | 264.32 MB |

Original Model Card:

Locutusque's TinyMistral-248M trained on the Evol Instruct dataset using AutoTrain

Base model: Locutusque/TinyMistral-248M
Dataset: KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
Training: 9.5h under these parameters

Recommended Prompt Format

### Instruction:
<instruction>

### Response: