DolphinScheduler application in T3 one-stop travel platform

李心恺,赵玉威

Chinese Session 2022-07-30 15:10 GMT+8  #workflowdatagovernance

Apache DolphinScheduler is an excellent distributed data workflow task scheduling system, but it lacks CI\CD modules. T3 travel integrates one-stop development platform and connects DolphinScheduler with Apache Kyuubi and Apache Linkis computing middleware to form a complete development process such as development, debugging, release and version control, greatly improving development efficiency and standardizing the data development process. It can realize the integration of code development, business on-line and scheduling system, and at the same time can close the mouth to achieve CI/CD management of big data development, helping business departments to lower the threshold of on-line big data-related requirements, reducing the pressure of data development, and making a further step towards our goal of one-stop development platform

Speakers:


Xinkai Li: T3 travel, Big data platform r&d engineer, Responsible for the RESEARCH and development management of T3 travel computing engine and one-stop platform, participated in COSCon'2021 and Apache SeaTunnel & Kyuubi joint Meetup, and shared the practice and application of Apache Kyuubi in T3 travel.


Yuwei Zhao: T3 travel, Big data platform r&d engineer, Responsible for the RESEARCH and development management of T3 Travel based on Dolohin Scheduler task scheduling platform, and participated in apache China open Source Conference 2020 and Workflow ApacheCon Asia 2021 to share the in-depth customization and practice of Dolphin Scheduler in T3 travel.