mmBERT is trained on 3T tokens from over 1800 languages, showing SoTA scores on benchmarks and exceptional low-resource performance
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
Where Does Retrieval-Based Open-Ended Evaluation Fail? Automatic Taxonomy Induction from Long-Form Medical Answer Factuality Verification
Convergent Emergence of In-Context Learning Across Modalities
models 53
jhu-clsp/mmBERT-small
Fill-Mask • Updated • 92.2k • • 108
jhu-clsp/mmBERT-base
Fill-Mask • Updated • 416k • • 271
jhu-clsp/mmBERT-checkpoints
Updated • 5
jhu-clsp/ettin-decoder-1b
Fill-Mask • Updated • 623 • 5
jhu-clsp/ettin-decoder-32m
Text Generation • Updated • 953
jhu-clsp/ettin-encoder-1b
Feature Extraction • Updated • 19.1k • • 33
jhu-clsp/ettin-encoder-68m
Fill-Mask • Updated • 16.3k • • 8
jhu-clsp/ettin-dec-from-enc-32m
Text Generation • Updated • 67
jhu-clsp/ettin-encoder-150m
Fill-Mask • Updated • 20.3k • • 17
jhu-clsp/ettin-decoder-400m
Text Generation • Updated • 1.63k • 4
datasets 41
jhu-clsp/cc-temporal-65M
Viewer • Updated • 61.6M • 2
jhu-clsp/SciTaRC
Viewer • Updated • 371 • 74 • 1
jhu-clsp/ManyIH-Bench
Preview • Updated • 286 • 3
jhu-clsp/robust04-instructions
Viewer • Updated • 136k • 534 • 2
jhu-clsp/core17-instructions
Viewer • Updated • 49.4k • 491 • 2
jhu-clsp/news21-instructions
Viewer • Updated • 71.5k • 463 • 1
jhu-clsp/megawika-2
Updated • 9.52k • 6
jhu-clsp/mmBERT-decay-data
Updated • 19k • 6
jhu-clsp/mmBERT-midtraining-data
Updated • 62k • 3
jhu-clsp/ettin-pretraining-data
Updated • 29.3k • 10