Neural Magic company logo - Model Optimization company based in United States
startup

Neural Magic

Somerville, United States
Founded 2018

About

and focusing on factual detail: Neural Magic develops software that dramatically accelerates deep learning inference on commodity CPUs through its SparseML training and DeepSparse inference engine. Their core innovation lies in applying sparsity – reducing the number of parameters in neural networks – to achieve performance comparable to GPUs without specialized hardware. Notably, Neural Magic partners with Red Hat to deliver optimized AI infrastructure, and their DeepSparse engine is designed for deployment within containerized environments like Red Hat’s AI Inference Server.

Technology Focus

ml infrastructure

Quick Stats

Total Raised $50M
Founded 2018
Status private
Type startup