Data Engineering Central

Data Engineering Central

Apache Airflow vs Databricks Workflows

... have at em'

Daniel Beach's avatar
Daniel Beach
Nov 04, 2024
∙ Paid
12
1
Share

As a long-time Databricks user, I’ve sat on the sidelines lazily watching Databricks Workflows for some time now with a yawn and half an eye open. Being an avid Apache Airflow user for longer than most of you have been programming, I’ve felt no compunction to switch or even poke at it.

It’s been nagging at the corner of my mind, like calling my mom, for years now that I should probably give Databricks Workflows the ol’ poke in the eye with a stick. That day has come.

I mostly want to accomplish …

  • Learn more about Databricks Workflows and what features it offers

  • How it compares to Apache Airflow

  • All this is in the light of running workloads on Databricks.

Keep reading with a 7-day free trial

Subscribe to Data Engineering Central to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 dataengineeringdude
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture