File size: 1,367 Bytes
717480f a9bed31 4196e78 717480f f465a07 717480f a9bed31 717480f 97d4402 113257f 97d4402 6d8eb01 97d4402 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
language:
- ms
library_name: transformers
---
Safe for Work Classifier Model for Malaysian Data(WORK IN PROGRESS)
Finetuned https://huggingface.co/mesolitica/malaysian-mistral-191M-MLM-512 with Malaysian NSFW data.
![Image in a markdown cell](https://github.com/mesolitica/malaysian-llmops/raw/main/e2e.png)
### How to use
```python
from classifier import MistralForSequenceClassification
model = MistralForSequenceClassification.from_pretrained('malaysia-ai/malaysian-sfw-classifier')
```
```
precision recall f1-score support
racist 0.96737 0.92272 0.94452 1928
religion insult 0.94210 0.91785 0.92982 3457
psychiatric or mental illness 0.97140 0.92858 0.94951 5559
sexist 0.93154 0.83968 0.88323 1734
harassment 0.76633 0.94214 0.84519 2005
informative 0.84307 0.88797 0.86494 1821
safe for work 0.86179 0.91640 0.88826 1878
hate 0.87780 0.84726 0.86226 2357
accuracy 0.90622 20739
macro avg 0.89518 0.90033 0.89596 20739
weighted avg 0.91115 0.90622 0.90725 20739
``` |