Streaming Apache Kudu within Apache Flink

Wei Chen

English Session 2023-08-18 15:45 GMT+8  #streaming

So far CDC is not supported within Apache Kudu, so there is no way to read data from it in a streaming style like other CDC enabled data sources when integrating with Apache Flink. To overcome this, a Apache Flink source connector has been built to unlock the ability for Apache Kudu to stream the data in a continuous and incremental way. In this speech, we will discuss and share the detailed design and implementation for the solution.

Speakers:


Wei Chen: eBay, Staff Software Engineer, Wei is focusing on empowering the eBay’s Notification Platform by leveraging the big data and streaming processing technologies. He is also a tech blog writer and actively contributing in open source community. Wei received his bachelor and master degrees from Shanghai Jiao Tong University.