🚨 Note: The current Docs site is outdated. Neural Magic's 1.7 release slated for January 2024 will include a Docs refresh. Meanwhile, please consult our GitHub repositories for the content:   DeepSparse,   SparseML,   SparseZoo.
Neural Magic LogoNeural Magic Logo
User Guides
Supported Hardware

Supported Hardware for DeepSparse

With support for AVX2, AVX-512, and VNNI instruction sets, DeepSparse is validated to work on x86 Intel (Haswell generation and later) and AMD (Zen 2 and later) CPUs running Linux. Mac and Windows require running Linux in a Docker or virtual machine.

Here is a table detailing specific support for some algorithms over different microarchitectures:

x86 ExtensionMicroarchitecturesKernel SparsitySparse Quantization
AMD AVX2Zen 2, Zen 3optimizedemulated
AMD AVX-512 VNNIZen 4optimizedoptimized
Intel AVX2Haswell, Broadwell, and neweroptimizedemulated
Intel AVX-512Skylake, Cannon Lake, and neweroptimizedemulated
Intel AVX-512 VNNI (DL Boost)Cascade Lake, Ice Lake, Cooper Lake, Tiger Lakeoptimizedoptimized
User Guides for DeepSparse Engine
Inference Types With DeepSparse Scheduler