Shaivn commited on
Commit
9b93207
·
verified ·
1 Parent(s): 2914457

update model card

Browse files
Files changed (1) hide show
  1. README.md +36 -1
README.md CHANGED
@@ -10,4 +10,39 @@ tags:
10
 
11
  # BERT Fine-tuned Financial Sentiment Analysis Model
12
 
13
- This model is a Fine-Tuned version of BERT (bert-base-uncased) trained with the Financial Phrase Bank dataset.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
  # BERT Fine-tuned Financial Sentiment Analysis Model
12
 
13
+ This model is a Fine-Tuned version of BERT (bert-base-uncased)
14
+ It is designed to classify text into positive, neutral, and negative sentiments. The fine-tuning was performed using the Financial Phrase Bank dataset.
15
+
16
+ ## Results
17
+
18
+ It achieves the followring results on the evaluation set:
19
+
20
+ * F1 Score: 0.9468
21
+ * Validation loss: 0.1860
22
+
23
+ ## Training Data
24
+
25
+ The dataset consists of 4840 sentences of the financial phrase bank. The dataset was annotated by 16 people with adequate background knowledge on financial markets.
26
+
27
+ ## Training hyperparameters
28
+
29
+ The following hyperparameters were used during training:
30
+
31
+ * learning rate : 2e-5
32
+ * train_bactch_size : 32
33
+ * eval_batch_size: 32
34
+ * seed: 42
35
+ * Optimizer : AdamW
36
+ * num_epochs: 3
37
+
38
+
39
+ ## Training Results
40
+
41
+ | **Epoch** | **Validation Loss** | **Accuracy** |
42
+ |:----------:|:---------------------:|:-------------:|
43
+ |01 | 0.1860 | 0.9468 |
44
+ |02 | 0.1756 | 0.9424 |
45
+ |03 | 0.1726 | 0.9432 |
46
+
47
+
48
+