Hugging Face's logo

alpindale
/
KernelLLM-MLX-Q8

Text Generation
MLX
Safetensors
llama
conversational
8-bit precision
Model card Files
xet
Community
README.md exists but content is empty.
Downloads last month
24
Safetensors
Model size
2B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for alpindale/KernelLLM-MLX-Q8

Base model

meta-llama/Llama-3.1-8B
Finetuned
meta-llama/Llama-3.1-8B-Instruct
Finetuned
facebook/KernelLLM
Quantized
(11)
this model

Datasets used to train alpindale/KernelLLM-MLX-Q8