lucataco / modernbert-base

ModernBERT-base is a modernized bidirectional encoder-only Transformer model (BERT-style) pre-trained on 2 trillion tokens of English and code data

  • Public
  • 73 runs
  • GitHub
  • Weights
  • Paper
  • License

Want to make some of these yourself?

Run this model