Update README.md
Browse files
README.md
CHANGED
@@ -5,8 +5,18 @@ datasets:
|
|
5 |
language:
|
6 |
- kk
|
7 |
metrics:
|
8 |
-
-
|
9 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
base_model:
|
11 |
- kz-transformers/kaz-roberta-conversational
|
12 |
new_version: Kundyzka/kaz-roberta-conversational-informatics
|
@@ -29,11 +39,15 @@ This model was developed by **Kundyz Maksutova**, PhD Candidate, as part of rese
|
|
29 |
- **Library**: `adapter-transformers`
|
30 |
|
31 |
### Performance:
|
32 |
-
The model achieves the following metrics:
|
33 |
-
- **
|
34 |
-
-
|
|
|
|
|
|
|
|
|
35 |
|
36 |
-
These metrics were evaluated on the `Kundyzka/informatics_kaz` dataset,
|
37 |
|
38 |
### Intended Use:
|
39 |
This model is designed to handle natural language questions in the Kazakh language. It is particularly well-suited for:
|
@@ -52,4 +66,4 @@ This model is designed to handle natural language questions in the Kazakh langua
|
|
52 |
- `Kazakh`
|
53 |
- `adapter-transformers`
|
54 |
|
55 |
-
This model
|
|
|
5 |
language:
|
6 |
- kk
|
7 |
metrics:
|
8 |
+
- name: F1 (Before Training)
|
9 |
+
type: F1 Score
|
10 |
+
value: 17.797
|
11 |
+
- name: Exact Match (Before Training)
|
12 |
+
type: Exact Match
|
13 |
+
value: 7.662
|
14 |
+
- name: F1 (After Training)
|
15 |
+
type: F1 Score
|
16 |
+
value: 67.788
|
17 |
+
- name: Exact Match (After Training)
|
18 |
+
type: Exact Match
|
19 |
+
value: 51.428
|
20 |
base_model:
|
21 |
- kz-transformers/kaz-roberta-conversational
|
22 |
new_version: Kundyzka/kaz-roberta-conversational-informatics
|
|
|
39 |
- **Library**: `adapter-transformers`
|
40 |
|
41 |
### Performance:
|
42 |
+
The model achieves the following performance metrics, highlighting its improvement after fine-tuning:
|
43 |
+
- **Before Training**:
|
44 |
+
- F1 Score: 17.797
|
45 |
+
- Exact Match (EM): 7.662
|
46 |
+
- **After Training**:
|
47 |
+
- F1 Score: 67.788
|
48 |
+
- Exact Match (EM): 51.428
|
49 |
|
50 |
+
These metrics were evaluated on the `Kundyzka/informatics_kaz` dataset, demonstrating a significant improvement in performance and reliability for domain-specific questions.
|
51 |
|
52 |
### Intended Use:
|
53 |
This model is designed to handle natural language questions in the Kazakh language. It is particularly well-suited for:
|
|
|
66 |
- `Kazakh`
|
67 |
- `adapter-transformers`
|
68 |
|
69 |
+
This model contributes to advancing natural language processing for low-resource languages like Kazakh, with a focus on computer science applications. For further details, fine-tuning guidelines, or customization, refer to the model repository.
|