Max Kleinegger

mkleinegger's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a collection about 4 hours ago

GSQ-RCO-GGUF

Collection

Non-uniform GGUF quantizations via GSQ + RCO: per-tensor mixed precision in standard GGUF form • 4 items • Updated about 3 hours ago • 79

upvoted 2 papers 19 days ago

The Unseen Frontier: Pushing the Limits of LLM Sparsity with Surrogate-Free ADMM

Paper • 2510.01650 • Published Feb 23 • 1

Hardware-Native Joint Sparse-Quantization for Trillion-Scale Mixture-of-Experts

Paper • 2610.02241 • Published 27 days ago • 5

upvoted a paper 25 days ago

WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms

Paper • 2609.38121 • Published 27 days ago • 28

upvoted a paper 28 days ago

Disaggregated Quantization: Specializing LLM Prefill and Decode

Paper • 2609.26333 • Published Sep 22 • 95

upvoted a paper 3 months ago

GPTQ-2D: Cubic-Time Two-Sided Adaptive Rounding

Paper • 2607.27042 • Published Jul 29 • 21

upvoted a collection 5 months ago

GSQ

Collection

GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling, https://huggingface.co/papers/2604.18556 • 8 items • Updated 3 days ago • 16

upvoted 2 papers 5 months ago

GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling

Paper • 2604.18556 • Published Apr 20 • 24

MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning

Paper • 2605.07850 • Published May 8 • 18

upvoted 7 papers 8 months ago

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations

Paper • 2502.05003 • Published Feb 7, 2025 • 47

Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization

Paper • 2509.23202 • Published Sep 27, 2025 • 31

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

Paper • 2510.18784 • Published Oct 21, 2025 • 3

WUSH: Near-Optimal Adaptive Transforms for LLM Quantization

Paper • 2512.00956 • Published Nov 30, 2025 • 24

MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization

Paper • 2602.03537 • Published Feb 3 • 6

DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers

Paper • 2602.02016 • Published Feb 2 • 14

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

Paper • 2601.22813 • Published Jan 30 • 63

upvoted a paper about 1 year ago

The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm

Paper • 2507.18553 • Published Jul 24, 2025 • 43

upvoted 3 papers over 1 year ago

Unified Scaling Laws for Compressed Representations

Paper • 2506.01863 • Published Jun 2, 2025 • 19

SVD-Free Low-Rank Adaptive Gradient Optimization for Large Language Models

Paper • 2505.17967 • Published May 23, 2025 • 17

Quartet: Native FP4 Training Can Be Optimal for Large Language Models

Paper • 2505.14669 • Published May 20, 2025 • 80