KAERS-BERT - KoBERT + KAERS BERT Model

The Publicly Available KAERS BERT Embeddings paper contains the unique KAERS-BERT model: initialized with KoBERT (skt/kobert-base-v1) & trained on adverse events (ADEs) narratives reported through KAERS (Korean Adverse Event Reporting System).

This model card describes the KoBERT model.

Pretraining Data

The KAERS-BERT model was trained on 1.2 million ADE narratives reported through KAERS between January 1, 2015 and December 31, 2019. The ADE narratives used for pertaining were mainly written in Korean.

Model Pretraining

Note Preprocessing

We only used ADE narratives reported as 'disease history in detail', 'adverse event in detail', and 'laboratory test in detail' for model pertaining, because ADE narratives of '(original) reporter's opinion' were highly redundant.