Data Engineering Central

Data Engineering Central

They said Streaming would overtake Batch.

The battle for the data pipeline.

Daniel Beach's avatar
Daniel Beach
Sep 18, 2023
∙ Paid

In recent years, the prophetic stance in the data engineering landscape has been that streaming would eat batch ETL (Extract, Transform, Load) processes, fundamentally rearchitecting the way we handle big data.

The peddlers of new and shiny tools have been not shy in saying that batch ETL is dead, and you are a proverbial mammoth wandering around waiting…

User's avatar

Continue reading this post for free, courtesy of Daniel Beach.

Or purchase a paid subscription.
© 2026 dataengineeringdude · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture