erikkaum/training-cache-static
414 GB
Erik Kaunismäki PRO
erikkaum
AI & ML interests
None yet
Recent Activity
published a model about 23 hours ago
erikkaum/lattice-retrieval published an article about 23 hours ago
Lattice: an 8 MB static retriever that embeds Wikipedia in 7 minutes updated a model 1 day ago
erikkaum/lattice-retrievalOrganizations
Posts 4
Post
3200
Releasing my first kernel 🔥 MaxSim
Late-interaction retrieval (ColBERT / PyLate) bottlenecks on materializing the full similarity matrix. This kernel avoids it by using tiled scoring with simdgroup_matrix (Metal) and WMMA.
The result is 3–5× speedup compared to naive PyTorch baseline 🔥
Benchmarks:
- SmallRerank (B=32, C=10): up to 3.2× (M3 Pro) / 2.8× (A100)
- HeavyRerank (B=32, C=100): up to 3.8× (M3 Pro) / 5.3× (A100)
- LongDocStress (Ld=1024): up to 6.2× (L4)
Try it out 👇
https://huggingface.co/kernels/erikkaum/maxsim
Late-interaction retrieval (ColBERT / PyLate) bottlenecks on materializing the full similarity matrix. This kernel avoids it by using tiled scoring with simdgroup_matrix (Metal) and WMMA.
The result is 3–5× speedup compared to naive PyTorch baseline 🔥
Benchmarks:
- SmallRerank (B=32, C=10): up to 3.2× (M3 Pro) / 2.8× (A100)
- HeavyRerank (B=32, C=100): up to 3.8× (M3 Pro) / 5.3× (A100)
- LongDocStress (Ld=1024): up to 6.2× (L4)
Try it out 👇
https://huggingface.co/kernels/erikkaum/maxsim
Articles 6
Article
13
Lattice: an 8 MB static retriever that embeds Wikipedia in 7 minutes
datasets 0
None public yet