Data Engineering Central

Data Engineering Central

Share this post

Data Engineering Central
Data Engineering Central
They said Streaming would overtake Batch.

They said Streaming would overtake Batch.

The battle for the data pipeline.

Daniel Beach's avatar
Daniel Beach
Sep 18, 2023
∙ Paid
7

Share this post

Data Engineering Central
Data Engineering Central
They said Streaming would overtake Batch.
2
Share

In recent years, the prophetic stance in the data engineering landscape has been that streaming would eat batch ETL (Extract, Transform, Load) processes, fundamentally rearchitecting the way we handle big data.

The peddlers of new and shiny tools have been not shy in saying that batch ETL is dead, and you are a proverbial mammoth wandering around waiting…

Keep reading with a 7-day free trial

Subscribe to Data Engineering Central to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 dataengineeringdude
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share