Improve language tag

#1
by lbourdois - opened
Files changed (1) hide show
  1. README.md +62 -49
README.md CHANGED
@@ -1,49 +1,62 @@
1
- ---
2
- base_model:
3
- - Qwen/Qwen2.5-Math-7B
4
- - Qwen/Qwen2.5-7B-Instruct
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
-
10
- ---
11
- # Qwen2.5-7B-Instruct-Math-slerp
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Performance
16
- | Metric |Value|
17
- |---------------------------------|----:|
18
- |GSM8k (zero-shot) |91.05|
19
- |HellaSwag (zero-Shot) |81.01|
20
- |MBPP (zero-shot) |61.48|
21
-
22
- ## Merge Details
23
- ### Merge Method
24
-
25
- This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
26
-
27
- ### Models Merged
28
-
29
- The following models were included in the merge:
30
- * [Qwen/Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B)
31
- * [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
32
-
33
- ### Configuration
34
-
35
- The following YAML configuration was used to produce this model:
36
-
37
- ```yaml
38
- base_model: Qwen/Qwen2.5-7B-Instruct
39
- dtype: bfloat16
40
- merge_method: slerp
41
- parameters:
42
- t: 0.1
43
- slices:
44
- - sources:
45
- - layer_range: [0, 28]
46
- model: Qwen/Qwen2.5-7B-Instruct
47
- - layer_range: [0, 28]
48
- model: Qwen/Qwen2.5-Math-7B
49
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-Math-7B
4
+ - Qwen/Qwen2.5-7B-Instruct
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ language:
10
+ - zho
11
+ - eng
12
+ - fra
13
+ - spa
14
+ - por
15
+ - deu
16
+ - ita
17
+ - rus
18
+ - jpn
19
+ - kor
20
+ - vie
21
+ - tha
22
+ - ara
23
+ ---
24
+ # Qwen2.5-7B-Instruct-Math-slerp
25
+
26
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
27
+
28
+ ## Performance
29
+ | Metric |Value|
30
+ |---------------------------------|----:|
31
+ |GSM8k (zero-shot) |91.05|
32
+ |HellaSwag (zero-Shot) |81.01|
33
+ |MBPP (zero-shot) |61.48|
34
+
35
+ ## Merge Details
36
+ ### Merge Method
37
+
38
+ This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
39
+
40
+ ### Models Merged
41
+
42
+ The following models were included in the merge:
43
+ * [Qwen/Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B)
44
+ * [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
45
+
46
+ ### Configuration
47
+
48
+ The following YAML configuration was used to produce this model:
49
+
50
+ ```yaml
51
+ base_model: Qwen/Qwen2.5-7B-Instruct
52
+ dtype: bfloat16
53
+ merge_method: slerp
54
+ parameters:
55
+ t: 0.1
56
+ slices:
57
+ - sources:
58
+ - layer_range: [0, 28]
59
+ model: Qwen/Qwen2.5-7B-Instruct
60
+ - layer_range: [0, 28]
61
+ model: Qwen/Qwen2.5-Math-7B
62
+ ```