update model card
Browse files
README.md
CHANGED
@@ -10,4 +10,39 @@ tags:
|
|
10 |
|
11 |
# BERT Fine-tuned Financial Sentiment Analysis Model
|
12 |
|
13 |
-
This model is a Fine-Tuned version of BERT (bert-base-uncased)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
|
11 |
# BERT Fine-tuned Financial Sentiment Analysis Model
|
12 |
|
13 |
+
This model is a Fine-Tuned version of BERT (bert-base-uncased)
|
14 |
+
It is designed to classify text into positive, neutral, and negative sentiments. The fine-tuning was performed using the Financial Phrase Bank dataset.
|
15 |
+
|
16 |
+
## Results
|
17 |
+
|
18 |
+
It achieves the followring results on the evaluation set:
|
19 |
+
|
20 |
+
* F1 Score: 0.9468
|
21 |
+
* Validation loss: 0.1860
|
22 |
+
|
23 |
+
## Training Data
|
24 |
+
|
25 |
+
The dataset consists of 4840 sentences of the financial phrase bank. The dataset was annotated by 16 people with adequate background knowledge on financial markets.
|
26 |
+
|
27 |
+
## Training hyperparameters
|
28 |
+
|
29 |
+
The following hyperparameters were used during training:
|
30 |
+
|
31 |
+
* learning rate : 2e-5
|
32 |
+
* train_bactch_size : 32
|
33 |
+
* eval_batch_size: 32
|
34 |
+
* seed: 42
|
35 |
+
* Optimizer : AdamW
|
36 |
+
* num_epochs: 3
|
37 |
+
|
38 |
+
|
39 |
+
## Training Results
|
40 |
+
|
41 |
+
| **Epoch** | **Validation Loss** | **Accuracy** |
|
42 |
+
|:----------:|:---------------------:|:-------------:|
|
43 |
+
|01 | 0.1860 | 0.9468 |
|
44 |
+
|02 | 0.1756 | 0.9424 |
|
45 |
+
|03 | 0.1726 | 0.9432 |
|
46 |
+
|
47 |
+
|
48 |
+
|