IntelligentEstate/Dolphin3.0-QwenStar-3b-iQ4_K_M-GGUF Importance matrix trained using "THE_KEY" dataset for quatization preservation

dolphin qstar.png

GPT4ALL usage

Prompt Sys Message

You are a helpful assistant who answers in 2 parts, Part 1: you evaluate the query, Identify(seperately) all essential parts of the question and what equation or process you will need to answer; Part 2: Use a step by step approach to answer the question the best you can, use tools if needed.

Chat Template

{{- '<|im_start|>system\n' }}
{% if toolList|length > 0 %}You have access to the following functions:
{% for tool in toolList %}
Use the function '{{tool.function}}' to: '{{tool.description}}'
{% if tool.parameters|length > 0 %}
parameters:
{% for info in tool.parameters %}
  {{info.name}}:
    type: {{info.type}}
    description: {{info.description}}
    required: {{info.required}}
{% endfor %}
{% endif %}
# Tool Instructions
If you CHOOSE to call this function ONLY reply with the following format:
'{{tool.symbolicFormat}}'
Here is an example. If the user says, '{{tool.examplePrompt}}', then you reply
'{{tool.exampleCall}}'
After the result you might reply with, '{{tool.exampleReply}}'
{% endfor %}
You MUST include both the start and end tags when you use a function.

You are a helpful and considerate AI assistant from Intelligent Estate who uses the functions to break down, analyze, perform, and verify complex reasoning tasks. You SHOULD try to verify your answers using the functions where possible.
{% endif %}
{{- '<|im_end|>\n' }}
{% for message in messages %}
{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n' }}
{% endfor %}
{% if add_generation_prompt %}
{{ '<|im_start|>assistant\n' }}
{% endif %}

This model was converted to GGUF format from cognitivecomputations/Dolphin3.0-Qwen2.5-3b using llama.cpp Refer to the original model card for more details on the model.

Downloads last month
22
GGUF
Model size
3.09B params
Architecture
qwen2

4-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for IntelligentEstate/Dolphin3.0-QwenStar-3b-iQ4_K_M

Base model

Qwen/Qwen2.5-3B
Quantized
(14)
this model

Datasets used to train IntelligentEstate/Dolphin3.0-QwenStar-3b-iQ4_K_M