schonsense commited on
Commit
071e7f5
·
verified ·
1 Parent(s): d94d072

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -48
README.md CHANGED
@@ -1,48 +1,49 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # flam-kit
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the SLERP merge method.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
22
- * schonsense/Flamlama_70B_della
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- models:
30
- - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
31
- - model: schonsense/Flamlama_70B_della
32
- merge_method: slerp
33
- base_model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
34
- dtype: bfloat16
35
- parameters:
36
- t: [
37
- 0, 0.0, 0.0, 0.055, 0.109, 0.127, 0.145, 0.164, 0.182, 0.2,
38
- 0.218, 0.236, 0.255, 0.273, 0.291, 0.309, 0.327, 0.345, 0.364, 0.382, 0.4,
39
- 0.418, 0.436, 0.455, 0.473, 0.491, 0.509, 0.527, 0.545, 0.564, 0.582, 0.6,
40
- 0.588, 0.576, 0.564, 0.552, 0.54, 0.527, 0.515, 0.503, 0.491, 0.479, 0.467,
41
- 0.455, 0.442, 0.43, 0.418, 0.406, 0.394, 0.382, 0.369, 0.357, 0.345, 0.333,
42
- 0.321, 0.309, 0.297, 0.285, 0.273, 0.26, 0.248, 0.236, 0.224, 0.212, 0.2,
43
- 0.188, 0.176, 0.164, 0.151, 0.139, 0.127, 0.115, 0.103, 0.091, 0.079, 0.067,
44
- 0.055, 0, 0, 0
45
- ]
46
-
47
-
48
- ```
 
 
1
+ ---
2
+ base_model:
3
+ - schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
4
+ - schonsense/Flamlama_70B_della
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ ---
10
+ # flam-kit
11
+
12
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
+
14
+ ## Merge Details
15
+ ### Merge Method
16
+
17
+ This model was merged using the SLERP merge method.
18
+
19
+ ### Models Merged
20
+
21
+ The following models were included in the merge:
22
+ * schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
23
+ * schonsense/Flamlama_70B_della
24
+
25
+ ### Configuration
26
+
27
+ The following YAML configuration was used to produce this model:
28
+
29
+ ```yaml
30
+ models:
31
+ - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
32
+ - model: schonsense/Flamlama_70B_della
33
+ merge_method: slerp
34
+ base_model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
35
+ dtype: bfloat16
36
+ parameters:
37
+ t: [
38
+ 0, 0.0, 0.0, 0.055, 0.109, 0.127, 0.145, 0.164, 0.182, 0.2,
39
+ 0.218, 0.236, 0.255, 0.273, 0.291, 0.309, 0.327, 0.345, 0.364, 0.382, 0.4,
40
+ 0.418, 0.436, 0.455, 0.473, 0.491, 0.509, 0.527, 0.545, 0.564, 0.582, 0.6,
41
+ 0.588, 0.576, 0.564, 0.552, 0.54, 0.527, 0.515, 0.503, 0.491, 0.479, 0.467,
42
+ 0.455, 0.442, 0.43, 0.418, 0.406, 0.394, 0.382, 0.369, 0.357, 0.345, 0.333,
43
+ 0.321, 0.309, 0.297, 0.285, 0.273, 0.26, 0.248, 0.236, 0.224, 0.212, 0.2,
44
+ 0.188, 0.176, 0.164, 0.151, 0.139, 0.127, 0.115, 0.103, 0.091, 0.079, 0.067,
45
+ 0.055, 0, 0, 0
46
+ ]
47
+
48
+
49
+ ```