In recent years, we have made significant progress in the field of big data and cloud-native technology at NetEase.

This presentation focuses on how to build an enterprise-level Spark on Kubernetes cloud-native offline computing platform using open-source technologies such as Apache Kyuubi and Celeborn.

The presentation covers topics such as technology selection, architecture design, lessons learned, defect improvement, cost reduction, and efficiency enhancement, providing an in-depth analysis of NetEase’s exploration achievements in this field.

Speakers:

Pan Cheng: Software Engineer at NetEase; PMC member of Apache Kyuubi; PPMC member of Celeborn (Incubating). Mainly engaging in development of enterprise offline computing platform based on Apache Spark, and promotion of Apache Kyuubi open source community.