Dashboard

Blog

Community

Status

Pricing

Cerebrium

Examples

Migrations

API Reference

Sign Up

Contact Us

List Hardware

Cerebrium is a serverless GPU infrastructure provider. We want to help you run machine learning models in the cloud efficiently and at scale.

Introduction

Cerebrium is our Python framework that meets you where you work - whether it be in Notebooks or .py files we want you to feel comfortable and be environment agnostic.

Installation

Get up and running with your first deployed model on Cerebrium

Quickstart

Using config files to configure Cortex deployments easily and quickly

Initial Setup

Using Config Files

Specify your versions, dependencies and packages to use

Customizing the Cortex Runtime

Access third-party platforms using secure credentials encrypted on Cerebrium

Using Secrets

Tips and tricks for multi-GPU inferencing.

Multi-GPU Inferencing

Based on traffic and implementation you might want to keep instances running

Keep models warm

Using Custom Runtimes (Preview)

Persistent Volumes

Integrate Cerebrium into your CI/CD workflow for automated deployments

CI/CD Pipelines

OpenAI Compatible Endpoints

Inference API

Streaming Endpoints

Websocket Endpoints

Webhook Forwarding

Execute calls to a Cerebrium app to be run asynchroously

Asynchronous Execution (Preview)

Integrate Cerebrium with Vercel to build AI applications

Vercel Integration

Decrease the time it takes to load your model from storage into GPU

Decrease Model Loading Time

Cerebrium provides prebuilt models that you can deploy to an API seamlessly

Deploying Prebuilt Models

Cerebrium follows security best practices

Security & Data Privacy

Reliability and Scalability

A list of hardware that is available on Cerebrium's platform.

Available Hardware

How to calculate the cost of your deployment on Cerebrium

Calculating compute cost

Some guidelines to boost the speed of your deployments and cold starts.

Do's and Don'ts for Faster Deployments

Explore our collection of implementation examples and tutorials

Featured Examples

Mistral 7B with vLLM

Create a OpenAI compatible endpoint using the vLLM framework

OpenAI compatible vLLM endpoint

Stream outputs live from Falcon 7B using SSE

Streaming LLM Output

Deploy an executive assistant using Langsmith and Langchain

Langchain and Langsmith

Using Distill Whisper to transcribe an audio file

Transcribe 1 hour podcast

Integrate a real-time AI voice agent with Twilio

Twilio Voice Agent

Real-time Voice AI Agent

ComfyUI application at Scale

Generate high quality images using SDXL with refiner

Generate Images using SDXL

Using FastAPI, Gradio and Cerebrium to deploy an LLM chat interface

Gradio Chat Interface

Deploy a Model from Replicate on Cerebrium

Migrating from Replicate

Deploy a Model from Hugging Face on Cerebrium

Migrating from Hugging Face

Migrating from Mystic

List Projects

Retrieve details of a specific project by its ID.

Get Project

List recent containers for a specific project.

List Containers

Retrieve cost details for a specific project.

Get Project Cost

Retrieve a list of Inference API keys for a specific project.

List API Keys

Create a new Inference API key for a specific project.

Create API Key

Retrieve a list of apps for a specific project.

List Apps

Create App

Retrieve details for a specific app in a project.

Get App

Delete App

Update the configuration or metadata of a specific app.

Modify App

Retrieve a list of recent containers for a specific app.

List App Containers

Retrieve dashboard metrics for a specific app.

Get App Metrics

Get App Logs

Retrieve a list of builds for a specific app.

List Builds

Get Build

Cancel Build

Download the build ZIP file for a specific build.

Download Build

Retrieve logs for a specific build of an app.

List Build Logs

Rebuild Build

Retrieve a list of runs for a specific app.

List Runs

Retrieve details for a specific run of an app.

Get Run

Cancel Run

Retrieve a list of secrets for a specific project.

List Secrets

Update Secrets

Retrieve a list of volumes for a specific project.

List Volumes

Resize Volume

Finalize the file upload process to a specific volume.

Complete File Upload

Begin the file upload process to a specific volume.

Initialize File Upload

Download File

Retrieve a list of files in a specified volume.