The improvement and application of DolphinScheduler in BIGO

XU SHUAI

Chinese Session 2022-07-30 14:30 GMT+8  #workflowdatagovernance

In BIGO, they use DolphinScheduler to unify the workflow schedule system. They made a lot of improvements on DolphinScheduler and even some automatical tools for migrating existing workflow in AirFlow and oozie to DolphinSceduler. Now DolphinScheduler has become the only workflow schedule system in BIGO.

Speakers:


XU SHUAI: BIGO, Principle Engineer, Worked in Alibaba for more than 10 years and have experience on Distributed File System, Ads exchange system and Realtime Computing System. Now working in BIGO, responsed for the computing platform of Bigdata, contains batch, realtime computing, OLAP system, workflow schedule system and so on.