Apache Airflow vs Databricks Workflows

... have at em'

As a long-time Databricks user, I’ve sat on the sidelines lazily watching Databricks Workflows for some time now with a yawn and half an eye open. Being an avid Apache Airflow user for longer than most of you have been programming, I’ve felt no compunction to switch or even poke at it.

It’s been nagging at the corner of my mind, like calling my mom, for years now that I should probably give Databricks Workflows the ol’ poke in the eye with a stick. That day has come.

I mostly want to accomplish …

• Learn more about Databricks Workflows and what features it offers

• How it compares to Apache Airflow

• All this is in the light of running workloads on Databricks.