rombodawg commited on
Commit
a92e61e
·
verified ·
1 Parent(s): 1b21e70

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ # Rombo-LLM-V2.5-qwen-2.5-0.5b
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Qwen2.5-0.5B as a base.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Qwen2.5-0.5B-Instruct
22
+
23
+ ### Configuration
24
+
25
+ The following YAML configuration was used to produce this model:
26
+
27
+ ```yaml
28
+ models:
29
+ - model: E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Qwen2.5-0.5B-Instruct
30
+ parameters:
31
+ weight: 1
32
+ density: 1
33
+ merge_method: ties
34
+ base_model: E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Qwen2.5-0.5B
35
+ parameters:
36
+ weight: 1
37
+ density: 1
38
+ normalize: true
39
+ int8_mask: false
40
+ dtype: bfloat16
41
+
42
+ ```