Iguazio Expands Serverless To Scale-out Machine Learning and Analytics Workloads

Serverless frameworks have so far only addressed challenges posed by the beginning and end of ML pipelines, namely data ingestion and model serving. Iguazio’s open source Nuclio has stood out with its unmatched performance and parallelism, its support of GPUs at scale, multi-cloud deployment and native integration into the data science stack.

With Nuclio ML Functions, Iguazio now provides a layer of automation and monitoring for the widely used ML and analytics frameworks on top of Kubernetes, relying on its high-speed shared data layer for seamless scaling. ML function activities and data artifacts are automatically logged, allowing users to trace data and experiment results and re-run older jobs when needed. Nuclio ML Functions also leverages Kubeflow to speed up the running of ML pipelines.

With the introduction of these new serverless features, Iguazio enables full automation and CI/CD for ML workloads, cutting infrastructure costs, tedious development and operations tasks. The parallelism and auto-scaling capabilities are enabling Iguazio’s customers to process the same tasks at a fraction of the time, consuming server and GPU resources upon demand.

“Data preparation, experiments and devops are the most time-consuming tasks in data science. Our goal is to minimize the overhead so data science teams can focus on innovation and building new applications,” said Iguazio’s CTO, Yaron Haviv. “Iguazio is democratizing data science, enabling deployment either in the cloud or on prem with familiar open source tools.”

More than half of data science projects are not fully deployed, according to Gartner: “Many organizations struggle when it comes to systematically productizing machine learning results, as the production process is either overlooked or left solely to the DevOps team.”*

Nuclio ML Functions supports the following workloads:

1. Real-time ingestion and APIs
2. Analytics and data preparation - using Spark and Dask engines
3. Machine learning - using Dask, XGBoost and Scikit
4. Deep learning - using TensorFlow, PyTourch and Horovod
5. Model Serving - using Nuclio Serving

Nuclio ML Functions is being demonstrated today at MLops NYC and will be generally available later this year across both cloud and edge versions of the Iguazio platform.

*Gartner, How to Operationalize Machine Learning and Data Science Projects, Erick Brethenoux et al., 3 July 2018

About Iguazio

Iguazio provides a Data Science Platform to automate machine learning pipelines. It accelerates the development and deployment of AI applications, enabling data scientists to focus on delivering better, more accurate and more powerful solutions instead of spending most of their time on infrastructure. The platform is open and deployable in public clouds, on-premises or at the intelligent edge. Iguazio powers data science applications for manufacturing, smart mobility, financial services and telcos and is backed by Bosch, Verizon Ventures, Samsung SDS, CME Group, Dell and top VCs. The company is led by serial entrepreneurs and a diverse team of seasoned innovators in the USA, UK, Singapore and Israel. Iguazio brings data science to life. Visit www.iguazio.com or follow @iguazio to learn more about iguazio.