In order to better understand user usage, it is often necessary to collect data through an app, and then store the relevant data for analysis and product optimization. Data is a key resource for businesses and organizations to grow their business in the future and needs to be 100% in their own hands. Therefore, enterprises need a data autonomous and controllable, while the cost of the buried point data analysis system. Amazon’s research and development team summarized best practices in building such streaming data analysis systems and made a deep integration with Apache Kafka available to more organizations and teams in an open source manner. In this talk, we will introduce the complete process and experience of building a production-grade data pipeline based on this solution.

Speakers:

Zheng Yubin: AWS, Senior developer evangelist, Zheng Yubin, Master of Software Engineering, has accumulated 20 years of practice in ICT industry and digital transformation. He is currently a senior developer evangelist at Amazon Cloud Technology, focusing on AWS cloud native and cloud security technology. With 18 years of architect experience, he focuses on providing data center construction, software-defined data center and other solutions consulting and technology landing for financial, education, manufacturing and Fortune 500 enterprise customers.


Liu Yong, Solution Architect at AWS, holds a master’s degree in Computer Science and Technology from Beijing University of Posts and Telecommunications. With 15 years of experience in IT, he specializes in architecture design and development of data-intensive modern applications, and has in-depth research and practical experience in technologies such as big data and machine learning.