# Deploying an AWQ model to sagemaker

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdeploying-an-awq-model-to-sagemaker%2F67817%3E%5C
**Category:** Amazon SageMaker\
**Created:** [January 3, 2024, 1:25pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdeploying-an-awq-model-to-sagemaker%2F67817 "2024-01-03T13:25:15Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![p-christ](https://avatars.discourse-cdn.com/v4/letter/p/df705f/32.png) [@p-christ](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fp-christ)%5C
**Post date:** [January 3, 2024, 1:25pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdeploying-an-awq-model-to-sagemaker%2F67817%2F1 "2024-01-03T13:25:15Z")

</div>

How can i deploy an AWQ model to sagemaker? It works with inference endpoints but with Sagemaker if I pass in ‘HF\_MODEL\_QUANTIZE’:‘AWQ’ it doesn’t seem to work and there’s an error.