Version: nightly

DeepSparse Deployment Options

Select the deployment option that's best for your project. Benefit from a faster and cost-effective solution.

📄️ DeepSparse Server

Wrap pipelines with a REST API using FastAPI. Send raw data over HTTP and receive the prediction.

Get sparse-CPU acceleration and automatic scaling on SageMaker.

Use event-driven, serverless computing infrastructure for deployment.

Deploy DeepSparse in a serverless framework with Google Cloud Run.