Text Generation
GGUF
Inference Endpoints
File size: 1,177 Bytes
3a15e7a
e636a4c
54036e8
 
 
3a15e7a
 
 
be8a175
 
400b6c8
14cb180
1cffa68
 
be8a175
def0382
 
 
 
956512a
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
license: llama3
datasets:
- DevQuasar/brainstorm_vicuna_1k
pipeline_tag: text-generation
---
# Brainstorm GGUF

![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e6d37e02dee9bcb9d9fa18/DhcuIFkUpUYqSiSNrGe2a.png)

Quantized GGUF model files for [DevQuasar/llama3_8b_chat_brainstorm](https://huggingface.co/DevQuasar/llama3_8b_chat_brainstorm)

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas.

## Usage
### LMStudio
With https://lmstudio.ai/ use the `brainstorm.preset.json` preset

### llama.cpp
`./main -m llama3_8b_chat_brainstorm.Q2_K.gguf -p "### HUMAN: I'd like to build an online marketplace\n ### ASSISTANT:" -n 400 -e -ins -r "### HUMAN:\n" -r "### ASSISTANT: "`

I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.

If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar

Also feel free to visit my website https://devquasar.com/