Jan banner

Jan - Discord

Model Description

This is a GGUF version of argilla/distilabeled-Hermes-2.5-Mistral-7B

About Jan

Jan believes in the need for an open-source AI ecosystem and is building the infra and tooling to allow open-source AIs to compete on a level playing field with proprietary ones.

Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.

Jan Model Converter

This is a repository for the [open-source converter](https://github.com/janhq/model-converter. We would be grateful if the community could contribute and strengthen this repository. We are aiming to expand the repo that can convert into various types of format

Downloads last month
2
GGUF
Model size
7.24B params
Architecture
llama

3-bit

4-bit

5-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for janhq/distilabeled-hermes-2.5-mistral-7b-GGUF

Quantized
(4)
this model

Dataset used to train janhq/distilabeled-hermes-2.5-mistral-7b-GGUF