Hugging Face's logo

sarahahtee
/
t5-dialogue-classification-4

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
Sarah Tariq commited on
Commit
4cafd49
·
verified ·
1 Parent(s): 1737fe7

End of training

Browse files
Files changed (4) hide show
  1. README.md +625 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Jan14_20-20-15_99d92981338a/events.out.tfevents.1705263623.99d92981338a.466.0 +2 -2
README.md ADDED
@@ -0,0 +1,625 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: t5-dialogue-classification-4
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # t5-dialogue-classification-4
15
+
16
+ This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.4724
19
+ - Classification Report: precision recall f1-score support
20
+
21
+ ALLERGY 1.0000 0.5000 0.6667 4
22
+ ASSESSMENT 0.0000 0.0000 0.0000 4
23
+ CC 0.5000 0.7500 0.6000 4
24
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
25
+ DISPOSITION 1.0000 0.5000 0.6667 2
26
+ EDCOURSE 0.0000 0.0000 0.0000 3
27
+ EXAM 0.3333 1.0000 0.5000 1
28
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
29
+ GENHX 0.8095 0.8500 0.8293 20
30
+ GYNHX 0.0000 0.0000 0.0000 1
31
+ IMAGING 0.0000 0.0000 0.0000 1
32
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
33
+ LABS 0.0000 0.0000 0.0000 1
34
+ MEDICATIONS 0.7143 0.7143 0.7143 7
35
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
36
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
37
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
38
+ PLAN 0.6667 0.6667 0.6667 3
39
+ PROCEDURES 0.0000 0.0000 0.0000 1
40
+ ROS 0.8750 0.6364 0.7368 11
41
+
42
+ accuracy 0.7200 100
43
+ macro avg 0.4496 0.4786 0.4374 100
44
+ weighted avg 0.6919 0.7200 0.6891 100
45
+
46
+
47
+ ## Model description
48
+
49
+ More information needed
50
+
51
+ ## Intended uses & limitations
52
+
53
+ More information needed
54
+
55
+ ## Training and evaluation data
56
+
57
+ More information needed
58
+
59
+ ## Training procedure
60
+
61
+ ### Training hyperparameters
62
+
63
+ The following hyperparameters were used during training:
64
+ - learning_rate: 0.0001
65
+ - train_batch_size: 7
66
+ - eval_batch_size: 7
67
+ - seed: 42
68
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
69
+ - lr_scheduler_type: linear
70
+ - num_epochs: 20
71
+
72
+ ### Training results
73
+
74
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
+ |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | No log | 1.0 | 172 | 0.5916 | precision recall f1-score support
77
+
78
+ ALLERGY 0.6667 0.5000 0.5714 4
79
+ ASSESSMENT 0.0000 0.0000 0.0000 4
80
+ Afib 0.0000 0.0000 0.0000 0
81
+ CC 0.0000 0.0000 0.0000 4
82
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
83
+ DISPOSITION 0.0000 0.0000 0.0000 2
84
+ EDCOURSE 0.0000 0.0000 0.0000 3
85
+ EXAM 0.0000 0.0000 0.0000 1
86
+ FAM/SOCHX 0.7308 0.8636 0.7917 22
87
+ GENHX 0.4000 1.0000 0.5714 20
88
+ GYNHX 0.0000 0.0000 0.0000 1
89
+ IMAGING 0.0000 0.0000 0.0000 1
90
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
91
+ LABS 0.0000 0.0000 0.0000 1
92
+ MEDICATIONS 1.0000 0.1429 0.2500 7
93
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
94
+ PASTMEDICALHX 0.0000 0.0000 0.0000 4
95
+ PASTSURGICAL 0.4286 0.7500 0.5455 8
96
+ PLAN 0.0000 0.0000 0.0000 3
97
+ PROCEDURES 0.0000 0.0000 0.0000 1
98
+ ROS 0.0000 0.0000 0.0000 11
99
+
100
+ accuracy 0.4800 100
101
+ macro avg 0.1536 0.1551 0.1300 100
102
+ weighted avg 0.3717 0.4800 0.3724 100
103
+ |
104
+ | No log | 2.0 | 344 | 0.3963 | precision recall f1-score support
105
+
106
+ ALLERGY 1.0000 0.2500 0.4000 4
107
+ ASSESSMENT 1.0000 0.2500 0.4000 4
108
+ CC 0.1667 0.5000 0.2500 4
109
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
110
+ DISPOSITION 0.0000 0.0000 0.0000 2
111
+ EDCOURSE 0.0000 0.0000 0.0000 3
112
+ EXAM 0.0000 0.0000 0.0000 1
113
+ FAM/SOCHX 0.8077 0.9545 0.8750 22
114
+ GENHX 0.7200 0.9000 0.8000 20
115
+ GYNHX 0.0000 0.0000 0.0000 1
116
+ IMAGING 0.0000 0.0000 0.0000 1
117
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
118
+ LABS 0.0000 0.0000 0.0000 1
119
+ MEDICATIONS 0.5556 0.7143 0.6250 7
120
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
121
+ PASTMEDICALHX 0.2000 0.7500 0.3158 4
122
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
123
+ PLAN 0.0000 0.0000 0.0000 3
124
+ PROCEDURES 0.0000 0.0000 0.0000 1
125
+ ROS 0.6667 0.1818 0.2857 11
126
+
127
+ accuracy 0.6100 100
128
+ macro avg 0.3058 0.2750 0.2476 100
129
+ weighted avg 0.6086 0.6100 0.5623 100
130
+ |
131
+ | 0.6305 | 3.0 | 516 | 0.3808 | precision recall f1-score support
132
+
133
+ ALLERGY 1.0000 0.2500 0.4000 4
134
+ ASSESSMENT 0.0000 0.0000 0.0000 4
135
+ CC 0.3333 0.7500 0.4615 4
136
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
137
+ DISPOSITION 0.0000 0.0000 0.0000 2
138
+ EDCOURSE 0.0000 0.0000 0.0000 3
139
+ EXAM 1.0000 1.0000 1.0000 1
140
+ FAM/SOCHX 0.7857 1.0000 0.8800 22
141
+ GENHX 0.7826 0.9000 0.8372 20
142
+ GYNHX 0.0000 0.0000 0.0000 1
143
+ IMAGING 0.0000 0.0000 0.0000 1
144
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
145
+ LABS 0.0000 0.0000 0.0000 1
146
+ MEDICATIONS 0.5556 0.7143 0.6250 7
147
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
148
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
149
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
150
+ PLAN 0.0000 0.0000 0.0000 3
151
+ PROCEDURES 0.0000 0.0000 0.0000 1
152
+ ROS 0.8000 0.3636 0.5000 11
153
+
154
+ accuracy 0.6600 100
155
+ macro avg 0.3273 0.3489 0.3108 100
156
+ weighted avg 0.6067 0.6600 0.6024 100
157
+ |
158
+ | 0.6305 | 4.0 | 688 | 0.3441 | precision recall f1-score support
159
+
160
+ ALLERGY 1.0000 0.2500 0.4000 4
161
+ ASSESSMENT 0.0000 0.0000 0.0000 4
162
+ CC 0.2727 0.7500 0.4000 4
163
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
164
+ DISPOSITION 0.0000 0.0000 0.0000 2
165
+ EDCOURSE 0.0000 0.0000 0.0000 3
166
+ EXAM 0.5000 1.0000 0.6667 1
167
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
168
+ GENHX 0.8182 0.9000 0.8571 20
169
+ GYNHX 0.0000 0.0000 0.0000 1
170
+ IMAGING 0.0000 0.0000 0.0000 1
171
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
172
+ LABS 0.0000 0.0000 0.0000 1
173
+ MEDICATIONS 0.6250 0.7143 0.6667 7
174
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
175
+ PASTMEDICALHX 0.3333 1.0000 0.5000 4
176
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
177
+ PLAN 0.0000 0.0000 0.0000 3
178
+ PROCEDURES 0.0000 0.0000 0.0000 1
179
+ ROS 0.8750 0.6364 0.7368 11
180
+
181
+ accuracy 0.6800 100
182
+ macro avg 0.3032 0.3603 0.3005 100
183
+ weighted avg 0.6217 0.6800 0.6255 100
184
+ |
185
+ | 0.6305 | 5.0 | 860 | 0.3423 | precision recall f1-score support
186
+
187
+ ALLERGY 1.0000 0.5000 0.6667 4
188
+ ASSESSMENT 0.0000 0.0000 0.0000 4
189
+ CC 0.7500 0.7500 0.7500 4
190
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
191
+ DISPOSITION 0.1667 0.5000 0.2500 2
192
+ EDCOURSE 0.0000 0.0000 0.0000 3
193
+ EXAM 0.5000 1.0000 0.6667 1
194
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
195
+ GENHX 0.8095 0.8500 0.8293 20
196
+ GYNHX 0.0000 0.0000 0.0000 1
197
+ IMAGING 0.0000 0.0000 0.0000 1
198
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
199
+ LABS 0.0000 0.0000 0.0000 1
200
+ MEDICATIONS 0.6250 0.7143 0.6667 7
201
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
202
+ PASTMEDICALHX 0.3077 1.0000 0.4706 4
203
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
204
+ PLAN 0.0000 0.0000 0.0000 3
205
+ PROCEDURES 0.0000 0.0000 0.0000 1
206
+ ROS 0.8750 0.6364 0.7368 11
207
+
208
+ accuracy 0.7000 100
209
+ macro avg 0.3440 0.3975 0.3477 100
210
+ weighted avg 0.6587 0.7000 0.6624 100
211
+ |
212
+ | 0.1584 | 6.0 | 1032 | 0.3373 | precision recall f1-score support
213
+
214
+ ALLERGY 1.0000 0.2500 0.4000 4
215
+ ASSESSMENT 0.0000 0.0000 0.0000 4
216
+ CC 0.5000 0.7500 0.6000 4
217
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
218
+ DISPOSITION 0.0000 0.0000 0.0000 2
219
+ EDCOURSE 0.0000 0.0000 0.0000 3
220
+ EXAM 0.3333 1.0000 0.5000 1
221
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
222
+ GENHX 0.8889 0.8000 0.8421 20
223
+ GYNHX 0.0000 0.0000 0.0000 1
224
+ IMAGING 0.0000 0.0000 0.0000 1
225
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
226
+ LABS 0.0000 0.0000 0.0000 1
227
+ MEDICATIONS 0.6250 0.7143 0.6667 7
228
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
229
+ PASTMEDICALHX 0.3333 1.0000 0.5000 4
230
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
231
+ PLAN 0.0000 0.0000 0.0000 3
232
+ PROCEDURES 0.0000 0.0000 0.0000 1
233
+ ROS 0.8889 0.7273 0.8000 11
234
+
235
+ accuracy 0.6800 100
236
+ macro avg 0.3605 0.4098 0.3546 100
237
+ weighted avg 0.6548 0.6800 0.6458 100
238
+ |
239
+ | 0.1584 | 7.0 | 1204 | 0.3611 | precision recall f1-score support
240
+
241
+ ALLERGY 1.0000 0.5000 0.6667 4
242
+ ASSESSMENT 0.0000 0.0000 0.0000 4
243
+ CC 0.3750 0.7500 0.5000 4
244
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
245
+ DISPOSITION 0.0000 0.0000 0.0000 2
246
+ EDCOURSE 0.0000 0.0000 0.0000 3
247
+ EXAM 0.2500 1.0000 0.4000 1
248
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
249
+ GENHX 0.8889 0.8000 0.8421 20
250
+ GYNHX 0.0000 0.0000 0.0000 1
251
+ IMAGING 0.0000 0.0000 0.0000 1
252
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
253
+ LABS 0.0000 0.0000 0.0000 1
254
+ MEDICATIONS 0.6250 0.7143 0.6667 7
255
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
256
+ PASTMEDICALHX 0.3333 1.0000 0.5000 4
257
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
258
+ PLAN 1.0000 0.3333 0.5000 3
259
+ PROCEDURES 0.0000 0.0000 0.0000 1
260
+ ROS 0.8889 0.7273 0.8000 11
261
+
262
+ accuracy 0.7000 100
263
+ macro avg 0.4045 0.4390 0.3855 100
264
+ weighted avg 0.6860 0.7000 0.6706 100
265
+ |
266
+ | 0.1584 | 8.0 | 1376 | 0.3677 | precision recall f1-score support
267
+
268
+ ALLERGY 1.0000 0.5000 0.6667 4
269
+ ASSESSMENT 1.0000 0.2500 0.4000 4
270
+ CC 0.5000 0.7500 0.6000 4
271
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
272
+ DISPOSITION 0.0000 0.0000 0.0000 2
273
+ EDCOURSE 0.0000 0.0000 0.0000 3
274
+ EXAM 0.2000 1.0000 0.3333 1
275
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
276
+ GENHX 0.7391 0.8500 0.7907 20
277
+ GYNHX 0.0000 0.0000 0.0000 1
278
+ IMAGING 0.0000 0.0000 0.0000 1
279
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
280
+ LABS 0.0000 0.0000 0.0000 1
281
+ MEDICATIONS 0.8333 0.7143 0.7692 7
282
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
283
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
284
+ PASTSURGICAL 0.7273 1.0000 0.8421 8
285
+ PLAN 0.5000 0.3333 0.4000 3
286
+ PROCEDURES 0.0000 0.0000 0.0000 1
287
+ ROS 0.8571 0.5455 0.6667 11
288
+
289
+ accuracy 0.7000 100
290
+ macro avg 0.4335 0.4449 0.3987 100
291
+ weighted avg 0.7025 0.7000 0.6729 100
292
+ |
293
+ | 0.098 | 9.0 | 1548 | 0.3759 | precision recall f1-score support
294
+
295
+ ALLERGY 1.0000 0.5000 0.6667 4
296
+ ASSESSMENT 0.0000 0.0000 0.0000 4
297
+ CC 0.4286 0.7500 0.5455 4
298
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
299
+ DISPOSITION 0.0000 0.0000 0.0000 2
300
+ EDCOURSE 0.3333 0.3333 0.3333 3
301
+ EXAM 0.3333 1.0000 0.5000 1
302
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
303
+ GENHX 0.8421 0.8000 0.8205 20
304
+ GYNHX 0.0000 0.0000 0.0000 1
305
+ IMAGING 0.0000 0.0000 0.0000 1
306
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
307
+ LABS 0.0000 0.0000 0.0000 1
308
+ MEDICATIONS 0.6667 0.8571 0.7500 7
309
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
310
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
311
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
312
+ PLAN 0.5000 0.3333 0.4000 3
313
+ PROCEDURES 0.0000 0.0000 0.0000 1
314
+ ROS 0.8889 0.7273 0.8000 11
315
+
316
+ accuracy 0.7200 100
317
+ macro avg 0.4103 0.4628 0.4152 100
318
+ weighted avg 0.6932 0.7200 0.6932 100
319
+ |
320
+ | 0.098 | 10.0 | 1720 | 0.3918 | precision recall f1-score support
321
+
322
+ ALLERGY 1.0000 0.5000 0.6667 4
323
+ ASSESSMENT 0.0000 0.0000 0.0000 4
324
+ CC 0.5000 0.7500 0.6000 4
325
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
326
+ DISPOSITION 0.2500 0.5000 0.3333 2
327
+ EDCOURSE 0.0000 0.0000 0.0000 3
328
+ EXAM 0.3333 1.0000 0.5000 1
329
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
330
+ GENHX 0.8947 0.8500 0.8718 20
331
+ GYNHX 0.0000 0.0000 0.0000 1
332
+ IMAGING 0.0000 0.0000 0.0000 1
333
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
334
+ LABS 0.0000 0.0000 0.0000 1
335
+ MEDICATIONS 0.5714 0.5714 0.5714 7
336
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
337
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
338
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
339
+ PLAN 0.5000 0.3333 0.4000 3
340
+ PROCEDURES 0.0000 0.0000 0.0000 1
341
+ ROS 0.8889 0.7273 0.8000 11
342
+
343
+ accuracy 0.7100 100
344
+ macro avg 0.4089 0.4593 0.4104 100
345
+ weighted avg 0.6909 0.7100 0.6861 100
346
+ |
347
+ | 0.098 | 11.0 | 1892 | 0.3808 | precision recall f1-score support
348
+
349
+ ALLERGY 1.0000 0.5000 0.6667 4
350
+ ASSESSMENT 0.0000 0.0000 0.0000 4
351
+ CC 0.7500 0.7500 0.7500 4
352
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
353
+ DISPOSITION 0.2000 0.5000 0.2857 2
354
+ EDCOURSE 0.5000 0.3333 0.4000 3
355
+ EXAM 0.5000 1.0000 0.6667 1
356
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
357
+ GENHX 0.8095 0.8500 0.8293 20
358
+ GYNHX 0.0000 0.0000 0.0000 1
359
+ IMAGING 0.0000 0.0000 0.0000 1
360
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
361
+ LABS 0.0000 0.0000 0.0000 1
362
+ MEDICATIONS 0.7500 0.8571 0.8000 7
363
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
364
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
365
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
366
+ PLAN 0.5000 0.3333 0.4000 3
367
+ PROCEDURES 0.0000 0.0000 0.0000 1
368
+ ROS 0.8000 0.7273 0.7619 11
369
+
370
+ accuracy 0.7500 100
371
+ macro avg 0.4545 0.4926 0.4534 100
372
+ weighted avg 0.7110 0.7500 0.7175 100
373
+ |
374
+ | 0.0648 | 12.0 | 2064 | 0.3998 | precision recall f1-score support
375
+
376
+ ALLERGY 1.0000 0.5000 0.6667 4
377
+ ASSESSMENT 0.0000 0.0000 0.0000 4
378
+ CC 0.4286 0.7500 0.5455 4
379
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
380
+ DISPOSITION 0.3333 0.5000 0.4000 2
381
+ EDCOURSE 0.5000 0.3333 0.4000 3
382
+ EDITION 0.0000 0.0000 0.0000 0
383
+ EXAM 0.5000 1.0000 0.6667 1
384
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
385
+ GENHX 0.8947 0.8500 0.8718 20
386
+ GYNHX 0.0000 0.0000 0.0000 1
387
+ IMAGING 0.0000 0.0000 0.0000 1
388
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
389
+ LABS 0.0000 0.0000 0.0000 1
390
+ MEDICATIONS 0.7143 0.7143 0.7143 7
391
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
392
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
393
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
394
+ PLAN 0.6667 0.6667 0.6667 3
395
+ PROCEDURES 0.0000 0.0000 0.0000 1
396
+ ROS 0.8000 0.7273 0.7619 11
397
+
398
+ accuracy 0.7400 100
399
+ macro avg 0.4340 0.4760 0.4362 100
400
+ weighted avg 0.7262 0.7400 0.7200 100
401
+ |
402
+ | 0.0648 | 13.0 | 2236 | 0.4352 | precision recall f1-score support
403
+
404
+ ALLERGY 1.0000 0.5000 0.6667 4
405
+ ASSESSMENT 0.0000 0.0000 0.0000 4
406
+ CC 0.6000 0.7500 0.6667 4
407
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
408
+ DISPOSITION 1.0000 0.5000 0.6667 2
409
+ EDCOURSE 0.0000 0.0000 0.0000 3
410
+ EXAM 0.5000 1.0000 0.6667 1
411
+ FAM/SOCHX 0.8750 0.9545 0.9130 22
412
+ GENHX 0.7391 0.8500 0.7907 20
413
+ GYNHX 0.0000 0.0000 0.0000 1
414
+ IMAGING 0.0000 0.0000 0.0000 1
415
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
416
+ LABS 0.0000 0.0000 0.0000 1
417
+ MEDICATIONS 0.7143 0.7143 0.7143 7
418
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
419
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
420
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
421
+ PLAN 0.5000 0.3333 0.4000 3
422
+ PROCEDURES 0.0000 0.0000 0.0000 1
423
+ ROS 0.8750 0.6364 0.7368 11
424
+
425
+ accuracy 0.7100 100
426
+ macro avg 0.4528 0.4619 0.4348 100
427
+ weighted avg 0.6862 0.7100 0.6820 100
428
+ |
429
+ | 0.0648 | 14.0 | 2408 | 0.4611 | precision recall f1-score support
430
+
431
+ ALLERGY 1.0000 0.5000 0.6667 4
432
+ ASSESSMENT 0.0000 0.0000 0.0000 4
433
+ CC 0.4286 0.7500 0.5455 4
434
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
435
+ DISPOSITION 0.5000 0.5000 0.5000 2
436
+ EDCOURSE 0.0000 0.0000 0.0000 3
437
+ EXAM 0.5000 1.0000 0.6667 1
438
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
439
+ GENHX 0.8947 0.8500 0.8718 20
440
+ GYNHX 0.0000 0.0000 0.0000 1
441
+ IMAGING 0.0000 0.0000 0.0000 1
442
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
443
+ LABS 0.0000 0.0000 0.0000 1
444
+ MEDICATIONS 0.7143 0.7143 0.7143 7
445
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
446
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
447
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
448
+ PLAN 0.6667 0.6667 0.6667 3
449
+ PROCEDURES 0.0000 0.0000 0.0000 1
450
+ ROS 0.8750 0.6364 0.7368 11
451
+
452
+ accuracy 0.7200 100
453
+ macro avg 0.4336 0.4786 0.4368 100
454
+ weighted avg 0.6978 0.7200 0.6938 100
455
+ |
456
+ | 0.0475 | 15.0 | 2580 | 0.4470 | precision recall f1-score support
457
+
458
+ ALLERGY 1.0000 0.5000 0.6667 4
459
+ ASSESSMENT 0.0000 0.0000 0.0000 4
460
+ CC 0.5000 0.7500 0.6000 4
461
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
462
+ DISPOSITION 1.0000 0.5000 0.6667 2
463
+ EDCOURSE 0.0000 0.0000 0.0000 3
464
+ EXAM 0.3333 1.0000 0.5000 1
465
+ FAM/SOCHX 0.8750 0.9545 0.9130 22
466
+ GENHX 0.7727 0.8500 0.8095 20
467
+ GYNHX 0.0000 0.0000 0.0000 1
468
+ IMAGING 0.0000 0.0000 0.0000 1
469
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
470
+ LABS 0.0000 0.0000 0.0000 1
471
+ MEDICATIONS 0.7143 0.7143 0.7143 7
472
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
473
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
474
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
475
+ PLAN 0.5000 0.6667 0.5714 3
476
+ PROCEDURES 0.0000 0.0000 0.0000 1
477
+ ROS 0.8750 0.6364 0.7368 11
478
+
479
+ accuracy 0.7200 100
480
+ macro avg 0.4452 0.4786 0.4368 100
481
+ weighted avg 0.6905 0.7200 0.6899 100
482
+ |
483
+ | 0.0475 | 16.0 | 2752 | 0.4607 | precision recall f1-score support
484
+
485
+ ALLERGY 1.0000 0.5000 0.6667 4
486
+ ASSESSMENT 0.0000 0.0000 0.0000 4
487
+ CC 0.4286 0.7500 0.5455 4
488
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
489
+ DISPOSITION 1.0000 0.5000 0.6667 2
490
+ EDCOURSE 0.0000 0.0000 0.0000 3
491
+ EXAM 0.3333 1.0000 0.5000 1
492
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
493
+ GENHX 0.8500 0.8500 0.8500 20
494
+ GYNHX 0.0000 0.0000 0.0000 1
495
+ IMAGING 0.0000 0.0000 0.0000 1
496
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
497
+ LABS 0.0000 0.0000 0.0000 1
498
+ MEDICATIONS 0.7143 0.7143 0.7143 7
499
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
500
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
501
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
502
+ PLAN 0.6667 0.6667 0.6667 3
503
+ PROCEDURES 0.0000 0.0000 0.0000 1
504
+ ROS 0.8750 0.6364 0.7368 11
505
+
506
+ accuracy 0.7300 100
507
+ macro avg 0.4501 0.4809 0.4388 100
508
+ weighted avg 0.7000 0.7300 0.6977 100
509
+ |
510
+ | 0.0475 | 17.0 | 2924 | 0.4592 | precision recall f1-score support
511
+
512
+ ALLERGY 1.0000 0.5000 0.6667 4
513
+ ASSESSMENT 0.0000 0.0000 0.0000 4
514
+ CC 0.3750 0.7500 0.5000 4
515
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
516
+ DISPOSITION 0.5000 0.5000 0.5000 2
517
+ EDCOURSE 0.0000 0.0000 0.0000 3
518
+ EXAM 0.5000 1.0000 0.6667 1
519
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
520
+ GENHX 0.9444 0.8500 0.8947 20
521
+ GYNHX 0.0000 0.0000 0.0000 1
522
+ IMAGING 0.0000 0.0000 0.0000 1
523
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
524
+ LABS 0.0000 0.0000 0.0000 1
525
+ MEDICATIONS 0.7143 0.7143 0.7143 7
526
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
527
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
528
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
529
+ PLAN 0.7500 1.0000 0.8571 3
530
+ PROCEDURES 0.0000 0.0000 0.0000 1
531
+ ROS 0.8750 0.6364 0.7368 11
532
+
533
+ accuracy 0.7300 100
534
+ macro avg 0.4416 0.4953 0.4493 100
535
+ weighted avg 0.7113 0.7300 0.7056 100
536
+ |
537
+ | 0.0323 | 18.0 | 3096 | 0.4671 | precision recall f1-score support
538
+
539
+ ALLERGY 1.0000 0.5000 0.6667 4
540
+ ASSESSMENT 0.0000 0.0000 0.0000 4
541
+ CC 0.4286 0.7500 0.5455 4
542
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
543
+ DISPOSITION 0.5000 0.5000 0.5000 2
544
+ EDCOURSE 0.0000 0.0000 0.0000 3
545
+ EXAM 0.3333 1.0000 0.5000 1
546
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
547
+ GENHX 0.8947 0.8500 0.8718 20
548
+ GYNHX 0.0000 0.0000 0.0000 1
549
+ IMAGING 0.0000 0.0000 0.0000 1
550
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
551
+ LABS 0.0000 0.0000 0.0000 1
552
+ MEDICATIONS 0.7143 0.7143 0.7143 7
553
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
554
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
555
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
556
+ PLAN 0.7500 1.0000 0.8571 3
557
+ PROCEDURES 0.0000 0.0000 0.0000 1
558
+ ROS 0.8750 0.6364 0.7368 11
559
+
560
+ accuracy 0.7300 100
561
+ macro avg 0.4312 0.4953 0.4399 100
562
+ weighted avg 0.7001 0.7300 0.6994 100
563
+ |
564
+ | 0.0323 | 19.0 | 3268 | 0.4689 | precision recall f1-score support
565
+
566
+ ALLERGY 1.0000 0.5000 0.6667 4
567
+ ASSESSMENT 0.0000 0.0000 0.0000 4
568
+ CC 0.5000 0.7500 0.6000 4
569
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
570
+ DISPOSITION 1.0000 0.5000 0.6667 2
571
+ EDCOURSE 0.0000 0.0000 0.0000 3
572
+ EXAM 0.3333 1.0000 0.5000 1
573
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
574
+ GENHX 0.8095 0.8500 0.8293 20
575
+ GYNHX 0.0000 0.0000 0.0000 1
576
+ IMAGING 0.0000 0.0000 0.0000 1
577
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
578
+ LABS 0.0000 0.0000 0.0000 1
579
+ MEDICATIONS 0.6250 0.7143 0.6667 7
580
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
581
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
582
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
583
+ PLAN 0.6667 0.6667 0.6667 3
584
+ PROCEDURES 0.0000 0.0000 0.0000 1
585
+ ROS 0.8750 0.6364 0.7368 11
586
+
587
+ accuracy 0.7200 100
588
+ macro avg 0.4469 0.4786 0.4369 100
589
+ weighted avg 0.6871 0.7200 0.6873 100
590
+ |
591
+ | 0.0323 | 20.0 | 3440 | 0.4724 | precision recall f1-score support
592
+
593
+ ALLERGY 1.0000 0.5000 0.6667 4
594
+ ASSESSMENT 0.0000 0.0000 0.0000 4
595
+ CC 0.5000 0.7500 0.6000 4
596
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
597
+ DISPOSITION 1.0000 0.5000 0.6667 2
598
+ EDCOURSE 0.0000 0.0000 0.0000 3
599
+ EXAM 0.3333 1.0000 0.5000 1
600
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
601
+ GENHX 0.8095 0.8500 0.8293 20
602
+ GYNHX 0.0000 0.0000 0.0000 1
603
+ IMAGING 0.0000 0.0000 0.0000 1
604
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
605
+ LABS 0.0000 0.0000 0.0000 1
606
+ MEDICATIONS 0.7143 0.7143 0.7143 7
607
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
608
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
609
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
610
+ PLAN 0.6667 0.6667 0.6667 3
611
+ PROCEDURES 0.0000 0.0000 0.0000 1
612
+ ROS 0.8750 0.6364 0.7368 11
613
+
614
+ accuracy 0.7200 100
615
+ macro avg 0.4496 0.4786 0.4374 100
616
+ weighted avg 0.6919 0.7200 0.6891 100
617
+ |
618
+
619
+
620
+ ### Framework versions
621
+
622
+ - Transformers 4.35.2
623
+ - Pytorch 2.1.0+cu121
624
+ - Datasets 2.16.1
625
+ - Tokenizers 0.15.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cac88106d402bc21baedc5468f20c45753bcd5cc26af2b54eb5357fb3caac1d5
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:071a7d2a8d934936831d43bb838f1a00ff6466c290bd8001adc94f2cdeb78e0b
3
  size 307867048
runs/Jan14_20-20-15_99d92981338a/events.out.tfevents.1705263623.99d92981338a.466.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7256a919df8093cb95f3534b20f05f8785a5cd0cbfa652d5bc33b1fb86a077ad
3
- size 10831
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:624e514d41cd7e36d4cc7084fa44e9fc38b84aa4887c716a74579b59a9d38710
3
+ size 11998