How does Linkis provide computing governance capabilities for diversified big data computing and storage engines

邸帅

Chinese Session 2022-07-31 15:30 GMT+8  (ROOM : B) #bigdata

Apache Linkis(Incubating) builds a layer of computing middleware between upper-layer applications and lower-layer engines, providing computing governance capabilities such as connectivity, control, extension, and orchestration. In this speech, Di Shuai will introduce how Linkis provides convenience for more efficient and low-cost connected diversified computing and storage engines (such as Python, Spark, Flink, etc.), and how to solve computing governance problems such as multi-tenant isolation, high concurrency, new engine adaptation, and high-risk operation control. At the same time, Di Shuai will show some exciting work currently being carried out by Linkis community and the follow-up planning of Linkis.

Speakers:


Shuai Di: Small Banks, Apache Linkis(Incubating) PPMC, director of WeBank Big data platform, ALC Member in Shenzhen, The main open source projects in use are Apache Linkis(Incubating), and several open source components in WeDataSphere (such as DataSphereStudio, Qualitis, Exchangis, etc.). I have made many speeches, including several MeetUP meetings of WeDataSphere, 2021 Open Source Conference of Open Source Society, Apache Kylin MeetUP and so on