Process streaming data with Azure Databricks structured streaming

Process streaming data with Azure Databricks structured streaming

Learn how Structured Streaming helps you process streaming data in real time, and how you can aggregate data over windows of time.

Data Engineer
Databricks

Module Objectives

In this module, you will:

  • Learn the key features and uses of Structured Streaming.
  • Stream data from a file and write it out to a distributed file system.
  • Use sliding windows to aggregate over chunks of data rather than all data.
  • Apply watermarking to throw away stale old data that you do not have space to keep.
  • Connect to Event Hubs read and write streams.

Prerequisites

None