Deci, the deep learning company building the next generation of AI, announced a broad strategic business and technology collaboration with Intel Corporation to optimize deep learning inference on Intel Architecture (IA) CPUs. As one of the first companies to participate in Intel Ignite startup accelerator, Deci will now work with Intel to deploy innovative AI technologies to mutual customers.
The collaboration between Deci and Intel takes a significant step towards enabling deep learning inference at scale on Intel CPUs, reducing costs and latency, and enabling new applications of deep learning inference. New deep learning tasks can be performed in a real-time environment on edge devices and companies that use large scale inference scenarios can dramatically cut cloud or datacenter cost, simply by changing the inference hardware from GPU to Intel CPU.
“By optimizing the AI models that run on Intel’s hardware, Deci enables customers to get even more speed and will allow for cost-effective and more general deep learning use cases on Intel CPUs,” said Deci CEO and co-founder Yonatan Geifman. “We are delighted to collaborate with Intel to deliver even greater value to our mutual customers and look forward to a successful partnership.”
Deci and Intel’s collaboration began with MLPerf where on several popular Intel CPUs, Deci’s AutoNAC (Automated Neural Architecture Construction) technology accelerated the inference speed of the well-known ResNet-50 neural network, reducing the submitted models’ latency by a factor of up to 11.8x and increasing throughput by up to 11x. Deci’s AutoNAC technology uses machine learning to redesign any model and maximize its inference performance on any hardware – all while preserving its accuracy.
“Deci delivers optimized deep learning inference on Intel processors as highlighted in MLPerf. Optimizing advanced AI models on general purpose infrastructure based on Intel Xeon Scalable CPUs allows our customers to meet performance SLAs, reduce cost, decrease time to deployment, and gives them the ability to effectively scale,” said Monica Livingston, AI Solutions and Sales Director at Intel.
This collaboration started with Deci being one of the first companies to join Intel Ignite, an accelerator program designed to support innovative startups in advancing new technologies in disruptive markets. Pilots of Deci’s platform to select customers in the enterprise, cloud, communications, and media segments are being developed to enable them to scale up and further accelerate their deep learning usage on Intel CPUs. As the results of these engagements are shared, an opportunity to scale the Deci platform to a broader base of customers is being planned.
For more in-depth information about Deci and Intel’s MLPerf results, see here.
Sign up for the free insideBIGDATA newsletter.
Join us on Twitter: @InsideBigData1 – https://twitter.com/InsideBigData1
Speak Your Mind