Data Engineering Central

Data Engineering Central

Home
Podcast
Work With Me
Merch
Data Engineering Consulting
Archive
About
Building Agentic AI ... Fancy.
how about a simple SQL Agent?
Dec 5 • 
Daniel Beach
Data Mesh Theology. Dead or Alive?
dying on the vine?
Dec 2 • 
Daniel Beach
JSON in a Lake House World
Delta Lake style
Dec 1 • 
Daniel Beach
Most Popular
View all
650GB of Data (Delta Lake on S3). Polars vs DuckDB vs Daft vs Spark.
Nov 12 • Daniel Beach
Goodbye Spark. Hello Polars + Delta Lake.
Oct 2, 2023 • Daniel Beach
Spark vs Polars. Real-life Test Case.
Nov 9, 2023 • Daniel Beach
Delta Lake vs Apache Iceberg. The Lake House Squabble.
Dec 11, 2024 • Daniel Beach
The Truth about Prefect, Mage, and Airflow.
Apr 10, 2023 • Daniel Beach
How to write better PySpark code.
Jan 6 • Daniel Beach
Revisiting Data Quality
options?
Nov 25 • 
Daniel Beach
What is TOON?
too scared to ask?
Nov 24 • 
Daniel Beach
One Big Table Data Modeling
was it all for naught?
Nov 20 • 
Daniel Beach
All You Can Do Before Airflow:
4 Orchestration Levels From Cron to Full Pipelines
Nov 17 • 
Alejandro Aboy
Data Engineering Central Podcast - 09
Cluster Fatigue and the Death of Open Source
Nov 13 • 
Daniel Beach
6:51
650GB of Data (Delta Lake on S3). Polars vs DuckDB vs Daft vs Spark.
cluster fatigue
Nov 12 • 
Daniel Beach
Databricks Compute.
Examining the Inscrutable
Nov 10 • 
Daniel Beach
Data Engineering Central
Data Engineering Central
Long Live the Data Engineer. No holds barred.
Recommendations
View all 23
The Python Papers
The Python Papers
Mike Driscoll
MKTCONTEXT
MKTCONTEXT
MktContext
SeattleDataGuy’s Newsletter
SeattleDataGuy’s Newsletter
SeattleDataGuy
Mehdio's Tech (Data) Corner
Mehdio's Tech (Data) Corner
mehdio
Blog | luminousmen
Blog | luminousmen
luminousmen

Data Engineering Central

AboutArchiveRecommendationsSitemap
© 2025 dataengineeringdude · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture