MEAPSA

Create production workloads on Azure Databricks with Azure Data Factory

Azure Data Factory helps you create workflows that orchestrate data movement and transformation at scale. Integrate Azure Databricks into your production pipelines by calling notebooks and libraries.

Data Engineer

Databricks

Module Objectives

In this module, you'll:

Create an Azure Data Factory pipeline with a Databricks activity.
Execute a Databricks notebook with a parameter.
Retrieve and log a parameter passed back from the notebook.
Monitor your Data Factory pipeline.

Units

Introduction min
Schedule Databricks jobs in a data factory pipeline min
Pass parameters into and out of Databricks jobs in data factory min
Knowledge check min
Summary min

Prerequisites

None