Apache Liminal (Incubating)—Orchestrate the Machine Learning Pipeline
Aviem Zur, Assaf Pinhasi
English Session 2021-08-07 16:10 GMT+8 (ROOM : A) #bigdataApache Liminal (Incubating)—Orchestrate the Machine Learning Pipeline Apache Liminal is an end-to-end platform for data engineers & scientists, allowing them to build, train and deploy machine learning models in a robust and agile way. The platform provides the abstractions and declarative capabilities for data extraction & feature engineering followed by model training and serving; using standard tools and libraries (e.g. Airflow, K8S, Spark, scikit-learn, etc.). Apache Liminal’s goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production, freeing them from engineering and non-functional tasks, and allowing them to focus on machine learning code and artifacts.
Speakers:
Aviem Zur: Data tech Lead @ Natural Intelligence, PPMC Member, Apache Liminal, PMC Member, Apache Beam. Specializing in data frameworks and platforms as Well as open source software. Passionate about quality engineering, open source and Magic: The Gathering.
Assaf Pinhasi: Technology leader, highly experienced in building large scale systems and teams, specializing in Big Data and Machine Learning.