Article
Sparse Mixture of Experts Language Model from Scratch: Extending makeMoE with Expert Capacity
•
13
Thierry Herrmann
thierryh
AI & ML interests
deep learning, machine learning
Organizations
None yet
upvoted
2
articles
3 months ago
Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
•
109
upvoted
an
article
7 months ago
Article
Train 400x faster Static Embedding Models with Sentence Transformers
•
219
upvoted
3
articles
8 months ago
Article
Training and Finetuning Embedding Models with Sentence Transformers v3
•
261
Article
Training and Finetuning Reranker Models with Sentence Transformers v4
•
175
Article
Faster Text Generation with Self-Speculative Decoding
- +2
•
63
upvoted
2
articles
9 months ago
Article
Controlling Language Model Generation with NVIDIA's LogitsProcessorZoo
•
50
Article
Visualize and understand GPU memory in PyTorch
•
255
upvoted
an
article
10 months ago
Article
From PyTorch DDP to Accelerate to Trainer, mastery of distributed training with ease
•
42