seq2seq
#52
by
khusrav13
- opened
Hello everyone, is it feasible to integrate modernBERT as the encoder within a seq2seq transformer architecture, or are there better-suited alternatives for this use case?
As I know, CodeBERT uses, how about ModernBERT?
https://github.com/microsoft/CodeBERT/blob/master/CodeBERT/code2nl/model.py
see discussion ongoing here: https://huggingface.co/answerdotai/ModernBERT-base/discussions/38
khusrav13
changed discussion status to
closed