Kundyzka commited on
Commit
dc29db0
·
verified ·
1 Parent(s): b7aaa61

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -7
README.md CHANGED
@@ -5,8 +5,18 @@ datasets:
5
  language:
6
  - kk
7
  metrics:
8
- - f1
9
- - exact_match
 
 
 
 
 
 
 
 
 
 
10
  base_model:
11
  - kz-transformers/kaz-roberta-conversational
12
  new_version: Kundyzka/kaz-roberta-conversational-informatics
@@ -29,11 +39,15 @@ This model was developed by **Kundyz Maksutova**, PhD Candidate, as part of rese
29
  - **Library**: `adapter-transformers`
30
 
31
  ### Performance:
32
- The model achieves the following metrics:
33
- - **F1 Score**: Measures overall accuracy in generating answers.
34
- - **Exact Match (EM)**: Measures exact match between predicted and ground truth answers.
 
 
 
 
35
 
36
- These metrics were evaluated on the `Kundyzka/informatics_kaz` dataset, ensuring reliable performance in the domain of computer science.
37
 
38
  ### Intended Use:
39
  This model is designed to handle natural language questions in the Kazakh language. It is particularly well-suited for:
@@ -52,4 +66,4 @@ This model is designed to handle natural language questions in the Kazakh langua
52
  - `Kazakh`
53
  - `adapter-transformers`
54
 
55
- This model is a contribution to advancing natural language processing for low-resource languages like Kazakh, with a focus on computer science applications. For further details, fine-tuning guidelines, or customization, refer to the model repository.
 
5
  language:
6
  - kk
7
  metrics:
8
+ - name: F1 (Before Training)
9
+ type: F1 Score
10
+ value: 17.797
11
+ - name: Exact Match (Before Training)
12
+ type: Exact Match
13
+ value: 7.662
14
+ - name: F1 (After Training)
15
+ type: F1 Score
16
+ value: 67.788
17
+ - name: Exact Match (After Training)
18
+ type: Exact Match
19
+ value: 51.428
20
  base_model:
21
  - kz-transformers/kaz-roberta-conversational
22
  new_version: Kundyzka/kaz-roberta-conversational-informatics
 
39
  - **Library**: `adapter-transformers`
40
 
41
  ### Performance:
42
+ The model achieves the following performance metrics, highlighting its improvement after fine-tuning:
43
+ - **Before Training**:
44
+ - F1 Score: 17.797
45
+ - Exact Match (EM): 7.662
46
+ - **After Training**:
47
+ - F1 Score: 67.788
48
+ - Exact Match (EM): 51.428
49
 
50
+ These metrics were evaluated on the `Kundyzka/informatics_kaz` dataset, demonstrating a significant improvement in performance and reliability for domain-specific questions.
51
 
52
  ### Intended Use:
53
  This model is designed to handle natural language questions in the Kazakh language. It is particularly well-suited for:
 
66
  - `Kazakh`
67
  - `adapter-transformers`
68
 
69
+ This model contributes to advancing natural language processing for low-resource languages like Kazakh, with a focus on computer science applications. For further details, fine-tuning guidelines, or customization, refer to the model repository.