Data processing platforms and deep learning frameworks are both evolving in their respective fields. Apache Spark is typically used for offline data processing, followed by various deep learning frameworks for data reasoning. The simplified API for DL reasoning is important as a bridge.

What would the ideal data and deep learning inference pipeline look like? We’ll discuss how to build your AI applications using Spark and ONNX, the current status and initial ideas of the Spark community to improve this pipeline, and take advantage of the Ascend Hardware Platform.

The conference will include the following sections:

• How to get through the process of big data and AI reasoning?
• What is ONNX, help hardware acceleration enable.
• Introduced the “SPIP: Simplified API for DL Inferencing” background to the Spark community
• A simple demo to show how it works.

This topic helps you understand the latest progress in integrating the Ascend Hardware Platform into ONNX and the Spark community’s initial ideas for improving the inference pipeline.

Speakers:

XiYuan Wang : huawei, Senior Software Engineer, Huawei Computing Open Source team senior software engineer, OpenStack Keystone Committer, currently committed to support and improve openEuler cloud computing and AI.

Yikun Jiang: huawei, Senior Software Engineer, Senior software engineer in Huawei Computing Open Source team, Apache Spark Contributor, OpenStack storage project Committer. Currently, he is committed to multi-architecture support and improvement of big data projects.

ZhiPeng Huang: huawei, Huawei Centrum Open Source Ecological director, Huang Zhipeng is the director of Open Source ecology at Huawei Centerm. As a member of the Technical Committee of Open source organizations such as Open Source Community, Linux Foundation Artificial Intelligence (LFAI), Private Computing Forum, etc. Leader of Kubernetes Policy Working group and Policy team of CNCF Foundation security Interest Group, founder of OpenStack Cyborg project, led the team to deeply participate in ONNX, Kubeflow, Akraino and other open source communities. I have made Keynote speeches in OpenStack Summit, Cloud Native Con/KubeCon and other international top open source summits, and also shared topics in several international summits including LinuxCon and RISC-V Summit.