|
---
|
|
license: mit
|
|
tags:
|
|
- text-classification
|
|
- PyTorch
|
|
- Transformers
|
|
---
|
|
|
|
|
|
# fakeBert
|
|
|
|
This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on a [news dataset](https://www.kaggle.com/datasets/clmentbisaillon/fake-and-real-news-dataset) from Kaggle.
|
|
|
|
## Model description
|
|
|
|
Fine-tuning Bert for text classification.
|
|
|
|
## Training and evaluation data
|
|
|
|
Training & Validation: [Fake and real news dataset](https://www.kaggle.com/datasets/clmentbisaillon/fake-and-real-news-dataset)
|
|
Testing: [Fake News Detection Challenge KDD 2020](https://www.kaggle.com/competitions/fakenewskdd2020/overview)
|
|
|
|
### Training hyperparameters
|
|
|
|
The following hyperparameters were used during training:
|
|
- learning_rate: 1e-5
|
|
- train_batch_size: 16
|
|
- eval_batch_size: 16
|
|
- optimizer: AdamW
|
|
|
