Hugging Face's logo

Supa-AI
/
llama3-8b-cpt-sahabatai-v1-instruct-gguf

GGUF
llama-cpp
Inference Endpoints
conversational
Model card Files Community
llama3-8b-cpt-sahabatai-v1-instruct-gguf
File size: 1,806 Bytes 
9809b99
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
 
---
base_model: GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct
language:
- en
- id
- jv
- su
license: llama3
tags:
- llama-cpp
- gguf
---

                # Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf
                This model was converted to GGUF format from [`GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct`](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) using llama.cpp.
                Refer to the [original model card](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) for more details on the model.

                ## Available Versions
                - `llama3-8b-cpt-sahabatai-v1-instruct.q2_k.gguf` (q2_k)
- `llama3-8b-cpt-sahabatai-v1-instruct.q3_k_m.gguf` (q3_k_m)
- `llama3-8b-cpt-sahabatai-v1-instruct.q4_0.gguf` (q4_0)
- `llama3-8b-cpt-sahabatai-v1-instruct.q4_k_m.gguf` (q4_k_m)
- `llama3-8b-cpt-sahabatai-v1-instruct.q5_0.gguf` (q5_0)
- `llama3-8b-cpt-sahabatai-v1-instruct.q5_k_m.gguf` (q5_k_m)
- `llama3-8b-cpt-sahabatai-v1-instruct.q6_k.gguf` (q6_k)
- `llama3-8b-cpt-sahabatai-v1-instruct.q8_0.gguf` (q8_0)

                ## Use with llama.cpp
                Replace `FILENAME` with one of the above filenames.

                ### CLI:
                ```bash
                llama-cli --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -p "Your prompt here"
                ```

                ### Server:
                ```bash
                llama-server --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -c 2048
                ```

                ## Model Details
                - **Original Model:** [GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct)
                - **Format:** GGUF