DeepSparse
1.1
General
Hardware Support
Performance
Debugging and Optimizing
Using the numactl Utility to Control Resource Utilization with the DeepSparse Engine
Logging Guidance for Diagnostics and Debugging
Example Log, Verbose Level = diagnose
Serial or Concurrent Inferences
API
C++ API Overview
deepsparse package
Connect Online
Bugs, Feature Requests
Deep Sparse Community Slack
Neural Magic GitHub
Neural Magic Docs
DeepSparse
»
Debugging and Optimizing
View page source
Debugging and Optimizing
Using the numactl Utility to Control Resource Utilization with the DeepSparse Engine
DeepSparse Engine and Thread Pinning
Additional Notes
Logging Guidance for Diagnostics and Debugging
Performance Tuning
Enabling Logs and Controlling the Amount of Logs Produced by the DeepSparse Engine
Parsing an Example Log
Viewing the Whole Graph
Finding Supported Nodes for Our Optimized Engine
Compiling Each Subgraph
Determining the Number of Cores and Batch Size
Obtaining Subgraph Statistics
Viewing Runtime Execution Times
Example Log, Verbose Level = diagnose
Other Versions
v: main
Tags
v0.10.0
v0.11.0
v0.11.1
v0.11.2
v0.12.0
v0.12.1
v0.12.2
v0.3.0
v0.3.1
v0.4.0
v0.5.0
v0.5.1
v0.6.0
v0.6.1
v0.7.0
v0.8.0
v0.9.0
v0.9.1
v1.0.0
v1.0.1
v1.0.2
Branches
main