DeepSparse Enterprise enables GPU-class performance on CPUs.
Currently, DeepSparse is tested on Python 3.7-3.10, ONNX 1.5.0-1.10.1, ONNX opset version 11+, and manylinux compliant systems.
We currently support x86 CPU architectures.
DeepSparse is available in two versions:
Use the following command to install with pip:
pip install deepsparse-ent
DeepSparse Server allows you to serve models and pipelines through an HTTP interface using the deepsparse.server CLI. To install, use the following extra option:
pip install deepsparse-ent[server]
The Ultralytics YOLOv5 models require extra dependencies for deployment. To use YOLO models, install with the following extra option:
1pip install deepsparse-ent[yolo] # just yolo requirements2pip install deepsparse-ent[yolo,server] # both yolo + server requirements