Dashboard

Blog

Community

Status

Pricing

Cerebrium

Examples

Migrations

API Reference

Sign Up

Contact Us

Create a new Inference API key for a specific project.

Create API Key

BearerAuth

Getting started on the Cerebrium platform

Introduction

Learn how to manage your team on the platform

Collaborating on Cerebrium

Defining Container Images

Using GPUs

Using CUDA

CPU and Memory

Learn to optimise for cost and performance by scaling out apps

Scaling Apps

Improve throughput and cost performance with batching & concurrency

Batching & Concurrency

Integrate Cerebrium into your CI/CD workflow for automated deployments

CI/CD Pipelines

OpenAI Compatible Endpoints

Rest API

Streaming Endpoints

Websocket Endpoints

Webhook Forwarding

Execute calls to a Cerebrium app to be run asynchronously

Async requests

Custom Web Servers

Managing Files

Integrate Cerebrium with Vercel to build AI applications

Vercel Integration

Cerebrium follows security best practices

Security & Data Privacy

Access third-party platforms using secure credentials encrypted on Cerebrium

Using Secrets

Decrease the time it takes to load your model from storage into GPU

Decrease Model Loading Time

How to calculate the cost of your deployment on Cerebrium

Calculating compute cost

Some guidelines to boost the speed of your deployments and cold starts.

Do's and Don'ts for Faster Deployments

Explore our collection of implementation examples and tutorials

Featured Examples

Mistral 7B with vLLM

Create a OpenAI compatible endpoint using the vLLM framework

OpenAI compatible vLLM endpoint

Stream outputs live from Falcon 7B using SSE

Streaming LLM Output

Deploy an executive assistant using Langsmith and Langchain

Langchain and Langsmith

Using Distill Whisper to transcribe an audio file

Transcribe 1 hour podcast

Integrate a real-time AI voice agent with Twilio

Twilio Voice Agent

Real-time Voice AI Agent

ComfyUI application at Scale

Generate high quality images using SDXL with refiner

Generate Images using SDXL

Using FastAPI, Gradio and Cerebrium to deploy an LLM chat interface

Gradio Chat Interface

Deploy a Model from Replicate on Cerebrium

Migrating from Replicate

Deploy a Model from Hugging Face on Cerebrium

Migrating from Hugging Face

Migrating from Mystic


                A valid Session Token is required to authorize API requests. You can get a Session Token by using the OAuth2 refresh token flow.<br/>
                You can get your existing Refresh Token from the [Cerebrium Dashboard](https://dashboard.cerebrium.ai/) on the API Keys page.<br/>
				Making a request to this endpoint will exchange your Refresh Token for a new Session Token.
            

Authorization Token

Check Build Service Status

Retrieve a list of builds for a specific app.

List Builds

Get Build

Cancel Build

Download the build ZIP file for a specific build.

Download Build

Retrieve logs for a specific build of an app.

List Build Logs

Rebuild Build

List Hardware

List Projects

Retrieve details of a specific project by its ID.

Get Project

List recent containers for a specific project.

List Containers

Retrieve cost details for a specific project.

Get Project Cost

Retrieve a list of Inference API keys for a specific project.

List API Keys

Retrieve a list of apps for a specific project.

List Apps

Create App

Retrieve details for a specific app in a project.

Get App

Delete App

Update the configuration or metadata of a specific app.

Modify App

Retrieve a list of recent containers for a specific app.

List App Containers

Stop App Container

Retrieve dashboard metrics for a specific app.

Get App Metrics

Get App Logs

Retrieve a list of runs for a specific app.

List Runs

Retrieve details for a specific run of an app.

Get Run

Cancel Run

Retrieve a list of secrets for a specific project.

List Secrets

Update Secrets

Retrieve a list of volumes for a specific project.

List Volumes

Resize Volume

Finalize the file upload process to a specific volume. Intended for internal use - rather use the `cerebrium cp` command.

Complete File Upload

Begin the file upload process to a specific volume. Intended for internal use - rather use the `cerebrium cp` command.

Initialize File Upload

Download File

Retrieve a list of files in a specified volume. Intended for internal use - rather use the `cerebrium ls` command.

List Files

Remove a file from a specific volume. Intended for internal use - rather use the `cerebrium rm` command.

Authentication

Builds

Available Hardware

Projects

API Keys

Apps

Runs

Secrets

Volumes

Files

Create API Key

Authorizations

Path Parameters

Query Parameters