Optimization implementation and future planning of real-time writing to Apache Doris via Flink

杨勇强

Chinese Session 2022-07-31 17:30 GMT+8  (ROOM : A) #bigdata

As a high-performance, easy-to-use, real-time analytical database, Apache Doris has rich data sync methods. Combined with Apache Flink, uses can quickly synchronize data from Apache Kafka or other MQ system and the CDC data in upstream business database such as MySQL. This sharing will introduce Apache Doris Flink Connector 2.0 implementation and how to support EOS semantics and reduce FLink memory usage.

Speakers:


Yongqiang Yang: Apache Doris Committer, Co-founder of SelectDB & Products VP, Linux kernel community contributor, once served as the chief architect of Baidu AI Cloud Storage Department and led the construction of cloud storage technology product system.