Finetuning code
#1
by
Tiru8055
- opened
Hi,
Can you please provide the details how you have fine-tuned ModernBERT for Question-answering task.
"The model 'ModernBertForMaskedLM' is not supported for question-answering." is the error I am getting when I tried.
Thanks in advance.
Hi,
Yes, the ModernBertForQuestionAnswering is still waiting to be accepted to be merged into the transformers repo.
For now, you can use my fork instead of original transformers library.
> pip uninstall transformersy -y
> git clone https://github.com/bakrianoo/transformers.git
> cd transformers && git checkout feat-ModernBert-QnA-Support && pip install -e .
Then you can use the fine tunning script as mentioned here