answerdotai/ModernBERT-base

#47 opened 6 days ago by

mlburnham

Continual pre-training for multilingual support (extend embedding matrix and tokenizer)

#46 opened 6 days ago by

ibotana

Encountering Error: cannot import name 'shard_checkpoint' from 'transformers.modeling_utils'

#44 opened 8 days ago by

rkabir

ModernBertModel works on the CPU but fails on the GPU

#43 opened 8 days ago by

rudigung

ModernBERT-base-chinese

4

#42 opened 9 days ago by

ZBW

ModernBert in Encoder-Decoder -> "got an unexpected keyword argument 'inputs_embeds'"

#41 opened 9 days ago by

KaranShishoo

Error: RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert because of the following error (look up to see its traceback): Windows not yet supported for torch.compile

#40 opened 13 days ago by

JoAmps42i

Set tokenizer "model_max_length" property to 8192

#39 opened 13 days ago by

NohTow

ModernBART wen?

#38 opened 14 days ago by

Fizzarolli

ValueError: The checkpoint you are trying to load has model type `modernbert`

#37 opened 14 days ago by

Sengil

Pretraining Using HF Tokenizers and Transformers

#36 opened 16 days ago by

akhooli

Update README.md

#35 opened 16 days ago by

solankibhargav

Unpadding and Sequence Packing inference example?

#34 opened 17 days ago by

denti

Interview Request: Thoughts on Model Documentation

#33 opened 18 days ago by

evatang

Training Data?

#32 opened 19 days ago by

binarymax

What is the position of this model in MTEB leaderboard?

#31 opened 19 days ago by

deepak-banka

tokenizer

#24 opened 20 days ago by

ulasarikaya

RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert

#21 opened 21 days ago by

SantoshHF

Pretraining data cutoff?

#17 opened 22 days ago by

ytsaig

How to use ModernBERT with the AutoModelForQuestionAnswering class?

#15 opened 23 days ago by

sraj

Is ModernBERT already fine-tuned for IR tasks?

4

#13 opened 23 days ago by

belerico

Question about output embedding vector of ModernBERT

#12 opened 23 days ago by

Youm9602

ModernBert for multi-vector embeddings

#11 opened 24 days ago by

admarcosai

Inference fails on CPU: `ValueError: Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?)`

6

#10 opened 25 days ago by

umarbutler

How to use ModernBERT as a sentence transformer?

30

#9 opened 25 days ago by

hungrybiker

multilingual

#8 opened 25 days ago by

ale-volpe

Is this model meant for full bfloat16, AMP bfloat16 or no bfloat16?

#7 opened 25 days ago by

umarbutler

# Fine-tuning ModernBERT on a Large Dataset with Masked Language Modelling

#6 opened 26 days ago by

ssmits

Precisions about the config properties wrt the paper