Neural Magic LogoNeural Magic Logo
Products
DeepSparse
Sparsity-aware neural network inference engine for GPU-class performance on CPUs.
SparseML
Open-source libraries for applying sparsification recipes to neural networks with a few lines of code.
SparseZoo
Open-source model repository for sparse and sparse-quantized models.
Use Cases
Natural Language Processing (NLP)
Get started with Sparse NLP use cases. Apply your data and redeploy on CPUs with ease.
Compute Vision
Get started with sparse computer vision use cases. Apply your data and deploy on CPUs with ease.
Community
Neural Magic Slack Community
Engage, discuss, and get direct access to our engineering and product teams.
Code
Explore our code on GitHub.
Docs
Get support or get started.
Labs
Labs by Neural Magic
Partner with experts to ensure your ML training and deployment pipelines are optimized with SOTA research and industry best practices.
Resources
Support
Learn about various Support channels.
Blogs & News
Stay current & discover SOTA performance techniques.
Research Papers
Explore our published research papers that are driving ML simplicity & performance.
Upcoming Events
Explore upcoming events Neural Magic will be attending. Come say hello!
On-Demand Videos
Listen to on-demand ML performance content on your time.
Our Technology
Learn about the "magic" behind Neural Magic!
Subscribe
Sign up for the regular Neural Magic email updates.
Company
Team & Investors
Explore our team and our investors.
Careers
Discover open positions. Apply or refer a friend.
Contact
Reach out to us directly.
Legal
View Neural Magic's legal documentation.
menu-icon
Products
DeepSparseSparseMLSparseZoo
Use Cases
Natural Language Processing (NLP)Compute Vision
Community
Neural Magic Slack CommunityCodeDocs
Labs
Labs by Neural Magic
Resources
SupportBlogs & NewsResearch PapersUpcoming EventsOn-Demand VideosOur TechnologySubscribe
Company
Team & InvestorsCareersContactLegal
Home
Get Started
Use Cases
User Guides
Products
Details
Products
DeepSparse
github
Edit on GitHub
slack
Ask on Slack

tool icon   DeepSparse

An inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application

DeepSparse is a CPU runtime that takes advantage of sparsity within neural networks to reduce compute. Read more about sparsification.

Neural Magic's DeepSparse is able to integrate into popular deep learning libraries (e.g., Hugging Face, Ultralytics) allowing you to leverage DeepSparse for loading and deploying sparse models with ONNX. ONNX gives the flexibility to serve your model in a framework-agnostic environment. Support includes PyTorch, TensorFlow, Keras, and many other frameworks.

Editions

DeepSparse is available in two editions:

DeepSparse Community
DeepSparse Community is open-source and free for evaluation, research, and non-production use.
DeepSparse Enterprise
DeepSparse Enterprise requires a Trial License or can be fully licensed for production, commercial applications.
Using DeepSparse on Google Cloud Run
DeepSparse Community