Data Engineering Central | Daniel Beach | Substack

Most Popular

The Rise of The Notebook Engineer

Aug 6 • Daniel Beach

Project Planning and Implementation Data Projects

Jan 1 • Daniel Beach

Raw Data Ingestion ...

Nov 18 • Daniel Beach

New SQL Practice Problems - Free For Paid Subscribers

Feb 21 • Daniel Beach

Introduction to Write-Audit-Publish Pattern

Jan 15 • Daniel Beach

Batch vs Near-Realtime vs Streaming

Feb 14 • Daniel Beach

DuckDB + Delta Lake.

... just checking for rough edges.

Nov 25 •

Data Engineering Central Podcast - 04

Nov 20 •

22:49

Raw Data Ingestion ...

... in the Lake House world ...

Nov 18 •

10 billion row challenge. DuckDB vs Polars vs Daft.

... just for fun.

Nov 14 •

DataFusion, My Swiss Army Knife

guest post from Anonymous Rust Dev

Nov 11 •

End of Year Engineering Planning for 2025

... how to do it ...

Nov 6 •

Apache Airflow vs Databricks Workflows

... have at em'

Nov 4 •

Data Engineering Central

Data Engineering Central

Long Live the Data Engineer. No holds barred.

Recommendations

Learn Analytics Engineering

Learn Analytics Engineering

Madison Mae

Stat Significant

Stat Significant

Daniel Parris

The Pragmatic Engineer

The Pragmatic Engineer

Gergely Orosz

The Python Papers

The Python Papers

Mike Driscoll

AI Disruption

Meng Li

Data Engineering Central

About Archive Recommendations Sitemap

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts