Debugging and Optimizing

• Using the numactl Utility to Control Resource Utilization with the DeepSparse Engine
  • DeepSparse Engine and Thread Pinning
  • Additional Notes
• Logging Guidance for Diagnostics and Debugging
  • Performance Tuning
  • Enabling Logs and Controlling the Amount of Logs Produced by the DeepSparse Engine
  • Parsing an Example Log
    • Viewing the Whole Graph
    • Finding Supported Nodes for Our Optimized Engine
    • Compiling Each Subgraph
    • Determining the Number of Cores and Batch Size
    • Obtaining Subgraph Statistics
    • Viewing Runtime Execution Times
• Example Log, Verbose Level = diagnose