Hugging Face's logo

yeirr
/
phi3-mini-128k-instruct-awq-g128-4bit

Text Generation
Transformers
Safetensors
English
phi3
conversational
custom_code
text-generation-inference
4-bit precision
awq
Model card Files
xet
Community

Introduction

A quantized version of instruct-tuned model.

Downloads last month
3
Safetensors
Model size
0.7B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yeirr/phi3-mini-128k-instruct-awq-g128-4bit

Base model

microsoft/Phi-3-mini-128k-instruct
Quantized
(84)
this model