Red Hat to acquire Neural Magic

Red Hat announced plans to acquire Neural Magic, a company that specializes in generative AI performance engineering, model optimization algorithms, and high-performance GPU and CPU inference serving.

Neural Magic was spun out of MIT in 2018, and it offers software and algorithms that accelerate generative AI inference workloads. Its expertise in large language models along with Red Hat’s ability to support these models across the hybrid cloud aligns with Red Hat’s stated goal of making gen AI more accessible to more organizations.

Red Hat intends to democratize the power of AI through open-source-licensed models that can run anywhere. This will enhance organizations’ abilities to customize large language models, use inference performance engineering for infrastructure efficiency, and partner in the open-source ecosystem to enable broader choices for hardware and chip architecture.

“AI workloads need to run wherever customer data lives across the hybrid cloud; this makes flexible, standardized and open platforms and tools a necessity, as they enable organizations to select the environments, resources and architectures that best align with their unique operational and data needs,” said Matt Hicks, Red Hat’s president and CEO, in a statement.

Read more Red Hat news