Hugging Face's logo

DevQuasar
/
llama3_8b_chat_brainstorm-v2.1-GGUF

Text Generation
Transformers
GGUF
llama
Inference Endpoints
Model card Files Community

Brainstorm GGUF

image/png

Quantized GGUF model files for DevQuasar/llama3_8b_chat_brainstorm-v2.1

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas. Model can summaryze the discussed ideas in Markdown format.

Usage

LMStudio

With https://lmstudio.ai/ use the brainstorm.preset.json preset

llama.cpp

./main -m llama3_8b_chat_brainstorm-v2.1.Q2_K.gguf -p "### HUMAN: I'd like to build an online marketplace\n ### ASSISTANT:" -n 400 -e -ins -r "### HUMAN:\n" -r "### ASSISTANT: "

I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.

If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar

Also feel free to visit my website https://devquasar.com/

Downloads last month
97
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train DevQuasar/llama3_8b_chat_brainstorm-v2.1-GGUF

Collections including DevQuasar/llama3_8b_chat_brainstorm-v2.1-GGUF