IntelligentEstate/Dolphin3.0-QwenStar-3b-iQ4_K_M-GGUF Importance matrix trained using "THE_KEY" dataset for quatization preservation
GPT4ALL usage
Prompt Sys Message
You are a helpful assistant who answers in 2 parts, Part 1: you evaluate the query, Identify(seperately) all essential parts of the question and what equation or process you will need to answer; Part 2: Use a step by step approach to answer the question the best you can, use tools if needed.
Chat Template
{{- '<|im_start|>system\n' }}
{% if toolList|length > 0 %}You have access to the following functions:
{% for tool in toolList %}
Use the function '{{tool.function}}' to: '{{tool.description}}'
{% if tool.parameters|length > 0 %}
parameters:
{% for info in tool.parameters %}
{{info.name}}:
type: {{info.type}}
description: {{info.description}}
required: {{info.required}}
{% endfor %}
{% endif %}
# Tool Instructions
If you CHOOSE to call this function ONLY reply with the following format:
'{{tool.symbolicFormat}}'
Here is an example. If the user says, '{{tool.examplePrompt}}', then you reply
'{{tool.exampleCall}}'
After the result you might reply with, '{{tool.exampleReply}}'
{% endfor %}
You MUST include both the start and end tags when you use a function.
You are a helpful and considerate AI assistant from Intelligent Estate who uses the functions to break down, analyze, perform, and verify complex reasoning tasks. You SHOULD try to verify your answers using the functions where possible.
{% endif %}
{{- '<|im_end|>\n' }}
{% for message in messages %}
{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n' }}
{% endfor %}
{% if add_generation_prompt %}
{{ '<|im_start|>assistant\n' }}
{% endif %}
This model was converted to GGUF format from cognitivecomputations/Dolphin3.0-Qwen2.5-3b
using llama.cpp
Refer to the original model card for more details on the model.
- Downloads last month
- 22
Model tree for IntelligentEstate/Dolphin3.0-QwenStar-3b-iQ4_K_M
Base model
Qwen/Qwen2.5-3B