Hardware Support ¶
The DeepSparse Engine is validated to work on x86 Intel and AMD CPUs running Linux operating systems.
It is highly recommended to run on a CPU with AVX-512 instructions available for optimal algorithms to be enabled.
Here is a table detailing specific support for some algorithms over different microarchitectures:
x86 Extension | Microarchitectures | Activation Sparsity | Kernel Sparsity | Sparse Quantization |
---|---|---|---|---|
AMD AVX2 | Zen 2 , Zen 3 | not supported | optimized | not supported |
Intel AVX2 | Haswell , Broadwell , and newer | not supported | optimized | not supported |
Intel AVX-512 | Skylake , Cannon Lake , and newer | optimized | optimized | emulated |
Intel AVX-512 VNNI (DL Boost) | Cascade Lake , Ice Lake , Cooper Lake , Tiger Lake | optimized | optimized | optimized |