Apache Liminal (Incubating)—Orchestrate the Machine Learning Pipeline

Aviem Zur, Assaf Pinhasi

English Session 2021-08-07 16:10 GMT+8  (ROOM : A) #bigdata

Apache Liminal (Incubating)—Orchestrate the Machine Learning Pipeline Apache Liminal is an end-to-end platform for data engineers & scientists, allowing them to build, train and deploy machine learning models in a robust and agile way. The platform provides the abstractions and declarative capabilities for data extraction & feature engineering followed by model training and serving; using standard tools and libraries (e.g. Airflow, K8S, Spark, scikit-learn, etc.). Apache Liminal’s goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production, freeing them from engineering and non-functional tasks, and allowing them to focus on machine learning code and artifacts.

Speakers:

Aviem Zur: Data tech Lead @ Natural Intelligence, PPMC Member, Apache Liminal, PMC Member, Apache Beam. Specializing in data frameworks and platforms as Well as open source software. Passionate about quality engineering, open source and Magic: The Gathering.

Assaf Pinhasi: Technology leader, highly experienced in building large scale systems and teams, specializing in Big Data and Machine Learning.