Neural Magic LogoNeural Magic Logo
Products
DeepSparse
Sparsity-aware neural network inference engine for GPU-class performance on CPUs.
SparseML
Open-source libraries for applying sparsification recipes to neural networks with a few lines of code.
SparseZoo
Open-source model repository for sparse and sparse-quantized models.
Use Cases
Natural Language Processing (NLP)
Get started with Sparse NLP use cases. Apply your data and redeploy on CPUs with ease.
Compute Vision
Get started with sparse computer vision use cases. Apply your data and deploy on CPUs with ease.
Community
Neural Magic Slack Community
Engage, discuss, and get direct access to our engineering and product teams.
Code
Explore our code on GitHub.
Docs
Get support or get started.
Labs
Labs by Neural Magic
Partner with experts to ensure your ML training and deployment pipelines are optimized with SOTA research and industry best practices.
Resources
Support
Learn about various Support channels.
Blogs & News
Stay current & discover SOTA performance techniques.
Research Papers
Explore our published research papers that are driving ML simplicity & performance.
Upcoming Events
Explore upcoming events Neural Magic will be attending. Come say hello!
On-Demand Videos
Listen to on-demand ML performance content on your time.
Our Technology
Learn about the "magic" behind Neural Magic!
Subscribe
Sign up for the regular Neural Magic email updates.
Company
Team & Investors
Explore our team and our investors.
Careers
Discover open positions. Apply or refer a friend.
Contact
Reach out to us directly.
Legal
View Neural Magic's legal documentation.
menu-icon
Products
DeepSparseSparseMLSparseZoo
Use Cases
Natural Language Processing (NLP)Compute Vision
Community
Neural Magic Slack CommunityCodeDocs
Labs
Labs by Neural Magic
Resources
SupportBlogs & NewsResearch PapersUpcoming EventsOn-Demand VideosOur TechnologySubscribe
Company
Team & InvestorsCareersContactLegal
Home
Get Started
Use Cases
User Guides
Products
Details
Get Started
Installation
DeepSparse Community
github
Edit on GitHub
slack
Ask on Slack

DeepSparse Community Installation

DeepSparse Community enables GPU-class performance on commodity CPUs.

Currently, DeepSparse is tested on Python 3.7-3.10, ONNX 1.5.0-1.10.1, ONNX opset version 11+ and is manylinux compliant.

We currently support x86 CPU architectures.

DeepSparse is available in two versions:

  1. DeepSparse Community is free for evaluation, research, and non-production use with our DeepSparse Community License.
  2. DeepSparse Enterprise requires a Trial License or can be fully licensed for production, commercial applications.

General Install

Use the following command to install DeepSparse Community with pip:

pip install deepsparse

Installing the Server

DeepSparse Server allows you to serve models and pipelines through an HTTP interface using the deepsparse.server CLI. To install, use the following extra option:

pip install deepsparse[server]

Installing YOLO

The Ultralytics YOLOv5 models require extra dependencies for deployment. To use YOLO models, install with the following extra option:

1pip install deepsparse[yolo]         # just yolo requirements
2pip install deepsparse[yolo,server]  # both yolo + server requirements
Install Neural Magic Platform
DeepSparse Enterprise Installation