In this talk I will walk through how to build different types of streaming applications utilizing Apache NiFi, Apache Flink, Apache Spark and Apache Pulsar together.

We will ingest various data and REST feeds to enrich and send to Apache Pulsar. We will build applications on top of this live streaming data with Web socket dashboards, Apache Spark SQL ETL and Apache Flink continuous SQL.

We will also ingest IoT sensor data from various devices and stream directly to Apache Pulsar via MQTT and native Pulsar protocol.

Finally at the end of this talk, developers will walk away with the What, How and Why of building this apps.

Speakers:

Timothy Spann: StreamNative, Developer Advocate, Tim Spann is a Developer Advocate for StreamNative. He works with StreamNative Cloud, Apache Pulsar, Apache Flink, Flink SQL, Apache NiFi, MiniFi, Apache MXNet, TensorFlow, Apache Spark, Big Data, the IoT, machine learning, and deep learning. Tim has over a decade of experience with the IoT, big data, distributed computing, messaging, streaming technologies, and Java programming. Previously, he was a Principal DataFlow Field Engineer at Cloudera, a Senior Solutions Engineer at Hortonworks, a Senior Solutions Architect at AirisData, a Senior Field Engineer at Pivotal and a Team Leader at HPE. He blogs for DZone, where he is the Big Data Zone leader, and runs a popular meetup in Princeton on Big Data, Cloud, IoT, deep learning, streaming, NiFi, the blockchain, and Spark. Tim is a frequent speaker at conferences such as ApacheCon, DeveloperWeek, Pulsar Summit and many more. He holds a BS and MS in computer science.