Design and practice of OPPO big Data Spark and Flink engine diagnosis system

庄泽波

Chinese Session 2023-08-19 15:45 GMT+8  #performance

In the case of EB-level data volume, large data components, and multiple types of problems, OPPO builds an engine diagnosis platform from problem triggering, rapid positioning, problem optimization to problem convergence, and provides users with performance optimization tools in big data Flink and Spark operations to improve user problem-solving efficiency and reduce user resource usage. The open source system, https://github.com/cubefs/compass, make contributions to the community.

Speakers:


Zhuang Zebo: OPPO, Senior back-end R&D engineer, OPPO Senior R&D engineer, Compass open source Project Maintainer, focusing on cloud native, observable, big data and other fields.