2 docs tagged with "deepsparse"

Deploy large language models (LLMs) for text generation using Neural Magic's DeepSparse. This doc includes code examples, performance benchmarking, and server setup.

Install DeepSparse, Neural Magic's high-performance inference engine, for optimized deep learning model deployment on CPUs.