# Sagemaker Serverless Inference

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsagemaker-serverless-inference%2F13246%3E%5C
**Category:** Amazon SageMaker\
**Created:** [December 30, 2021, 1:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsagemaker-serverless-inference%2F13246 "2021-12-30T13:44:18Z")\
**Posts on this page:** 1\
**Showing post:** 7

<div class="post-metadata">

**Author:** ![philschmid](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philschmid/32/38022_2.png) [@philschmid](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fphilschmid)%5C
**Post date:** [January 25, 2022, 12:49pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsagemaker-serverless-inference%2F13246%2F7 "2022-01-25T12:49:20Z")

</div>

Hello,

1. There is no fix yet for it but there is a workaround. You can set an environment variable `MMS_DEFAULT_WORKERS_PER_MODEL=1` when creating the endpoint.
2. Since Serverless Inference is powered by AWS Lambda and AWS Lambda doesn’t have GPU support yet Serverless Inference won’t have it as well. And i assume it will get GPU support when AWS Lambda has GPU support.

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsagemaker-serverless-inference%2F13246)._