Tensor Parallelism (TP) in Transformers: 5 Minutes to Understand
•
38
Community Blog & Articles
Community Articles
view all
open-source-collabnlp
Retrieval Augmented Generation with Huggingface Transformers and Ray
6
February 10, 2021
open-source-collab
Hugging Face on PyTorch / XLA TPUs
3
February 9, 2021
guidenlp
Faster TensorFlow models in Hugging Face Transformers
January 26, 2021
guide
Fit More and Train Faster With ZeRO via DeepSpeed and FairScale
4
January 19, 2021
analysisnlp
How we sped up transformer inference 100x for 🤗 API customers
January 18, 2021
guidenlp
Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models
15
November 9, 2020
open-source-collabnlp
Porting fairseq wmt19 translation system to transformers
1
November 3, 2020
open-source-collabnlp
Hyperparameter Search with Transformers and Ray Tune
4
November 2, 2020
researchnlp
Transformer-based Encoder-Decoder Models
19
October 10, 2020
researchnlp
Block Sparse Matrices for Smaller and Faster Language Models
September 10, 2020
researchnlp
The Reformer - Pushing the limits of language modeling
3
July 3, 2020
guidenlp
How to generate text: using different decoding methods for language generation with Transformers
269
March 1, 2020
guidenlp
How to train a new language model from scratch using Transformers and Tokenizers
56
February 14, 2020
NEW
Articles from
Team
or
Enterprise organizations will get promoted to the main section.
Tensor Parallelism (TP) in Transformers: 5 Minutes to Understand
•
38
Norm-Preserving Biprojected Abliteration
•
48
TurkColBERT: A Benchmark of Dense and Late-Interaction Models for Turkish Information Retrieval
•
14
**An Edge-First Generalized LLM LoRA Fine-Tuning Framework for Heterogeneous GPUs**
•
11
Uncensor any LLM with abliteration
•
733
Code a simple RAG from scratch
•
261
Ellora: Enhancing LLMs with LoRA - Standardized Recipes for Capability Enhancement
•
8
Building Jobly: Semantic Job Matching with RAG and Vector Embeddings
•
11
AI Energy Score v2: Refreshed Leaderboard, now with Reasoning 🧠
•
7
Building and evaluating Multimodal Rerankers
•
6
From GRPO to DAPO and GSPO: What, Why, and How
•
64
DeepFabric: Generate, Train and Evaluate with Datasets curated for Model Behavior Training.
•
5
Curating datasets directly on the Hub
•
22
Mastering Tensor Dimensions in Transformers
•
120
KV Caching Explained: Optimizing Transformer Inference Efficiency
•
189
Gemini-3 Benchmarkathon
•
9
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
•
109
Small Language Models (SLM): A Comprehensive Overview
•
107
GSMA Open-Telco LLM Benchmarks 2.0: The first dedicated LLM Evaluation for Telecoms
•
22
📌 Rethinking Multimodality from an Industry Perspective: Captioning Is Far More Important Than You Think
•
3