Hardware Support

The DeepSparse Engine is validated to work on x86 Intel and AMD CPUs running Linux operating systems.

It is highly recommended to run on a CPU with AVX-512 instructions available for optimal algorithms to be enabled.

Here is a table detailing specific support for some algorithms over different microarchitectures:

x86 Extension	Microarchitectures	Activation Sparsity	Kernel Sparsity	Sparse Quantization
AMD AVX2	Zen 2 , Zen 3	not supported	optimized	not supported
Intel AVX2	Haswell , Broadwell , and newer	not supported	optimized	not supported
Intel AVX-512	Skylake , Cannon Lake , and newer	optimized	optimized	emulated
Intel AVX-512 VNNI (DL Boost)	Cascade Lake , Ice Lake , Cooper Lake , Tiger Lake	optimized	optimized	optimized