---
title: Apertus on FastAPI
emoji: 🌖
colorFrom: red
colorTo: gray
sdk: docker
app_port: 8000
fullWidth: false
suggested_storage: small
suggested_hardware: t4-medium
tags:
- apertus
license: apache-2.0
---


Apertus transformer on FastAPI
------------------------------

A FastAPI-based Python application that provides an API to interface with the Apertus LLM from the Swiss AI Initiative.

The [OpenAI-compatible API](https://medium.com/data-science/how-to-build-an-openai-compatible-api-87c8edea2f06)
is inspired by [openai-compatible-fastapi](https://github.com/ritun16/openai-compatible-fastapi).

The goal is to use the [Apertus Format API](https://github.com/swiss-ai/apertus_format) in a lightweight service with an efficient, paged attention mechanism.

If you're debugging locally, it may help you to use [tiny-random/apertus](https://huggingface.co/tiny-random/apertus) instead of the full model.

## Terms of use

For more information on Apertus, go to https://huggingface.co/swiss-ai

This is an open source project under the [Apache 2.0 License](LICENSE)

If you have further suggestions please leave them on [Codeberg Issues](https://codeberg.org/loleg/fastapi-apertus/issues)