answerdotai

/

ModernBERT-base

like 672

Follow

Answer.AI 360

Hello everyone, is it feasible to integrate modernBERT as the encoder within a seq2seq transformer architecture, or are there better-suited alternatives for this use case?

As I know, CodeBERT uses, how about ModernBERT?
https://github.com/microsoft/CodeBERT/blob/master/CodeBERT/code2nl/model.py