DeepSparseLogo
0.6

General

  • Hardware Support

Performance

  • Debugging and Optimizing
    • Using the numactl Utility to Control Resource Utilization with the DeepSparse Engine
    • Logging Guidance for Diagnostics and Debugging
    • Example Log, Verbose Level = diagnose
  • Serial or Concurrent Inferences

API

  • deepsparse package

Connect Online

  • Bugs, Feature Requests
  • Support, General Q&A Forums
  • Deep Sparse Community Slack
  • Neural Magic GitHub
  • Neural Magic Docs
DeepSparse
  • »
  • Debugging and Optimizing
  • View page source

Debugging and Optimizing

  • Using the numactl Utility to Control Resource Utilization with the DeepSparse Engine
    • DeepSparse Engine and Thread Pinning
    • Additional Notes
  • Logging Guidance for Diagnostics and Debugging
    • Performance Tuning
    • Enabling Logs and Controlling the Amount of Logs Produced by the DeepSparse Engine
    • Parsing an Example Log
      • Viewing the Whole Graph
      • Finding Supported Nodes for Our Optimized Engine
      • Compiling Each Subgraph
      • Determining the Number of Cores and Batch Size
      • Obtaining Subgraph Statistics
      • Viewing Runtime Execution Times
  • Example Log, Verbose Level = diagnose
Previous Next

© Copyright 2021 - present / Neuralmagic, Inc. All Rights Reserved. Licensed under the Neural Magic Engine License and Apache License, Version 2.0 as noted..

Built with Sphinx using a theme provided by Read the Docs.
Other Versions v: v0.6.1
Tags
v0.10.0
v0.11.0
v0.11.1
v0.11.2
v0.12.0
v0.12.1
v0.12.2
v0.3.0
v0.3.1
v0.4.0
v0.5.0
v0.5.1
v0.6.0
v0.6.1
v0.7.0
v0.8.0
v0.9.0
v0.9.1
Branches
main