sparsify.utils package

Submodules

Utilities for ONNX based ML system info and validation

sparsify.utils.system.available_ml_engines() → List[str][source]

Returns: List of available inference providers on current system. Potential values include [‘deepsparse’, ‘ort_cpu’, ‘ort_gpu’]

sparsify.utils.system.get_ml_sys_info() → Dict[str, Any][source]

Returns: a dictionary containing info for the system and ML engines on the system. Such as number of cores, instruction sets, available engines, etc

sparsify.utils.system.ml_engines_errors() → Dict[str, Exception][source]

Returns: a dictionary containing any errors encountered when importing ML engines on the current system

Utility functions for sparsify