Work with DataFrames columns in Azure Databricks

Work with DataFrames columns in Azure Databricks

Use the DataFrame Column class in Azure Databricks to apply column-level transformations, such as sorts, filters and aggregations.

Data Engineer
Databricks

Module Objectives

In this module, you will:

  • Learn the syntax for specifying column values for filtering and aggregations
  • Understand the use of the Column Class
  • Sort and filter a DataFrame based on Column Values
  • Use collect() and take() to return records from a Dataframe to the driver of the cluster

Prerequisites

None