Data Engineering Central | Daniel Beach | Substack

The Double Edged AI Coding Sword

CoPilot and ChatGPT will make you stupid

3 hrs ago •

Reducing Memory Consumption

A Data Engineers Guide

Nov 27 •

Black Friday Sale - %40 off.

Come one come all

Nov 22 •

Most Popular

Goodbye Spark. Hello Polars + Delta Lake.

Oct 2 • Daniel Beach

A Primer on Data Architecture (Design)

Aug 14 • Daniel Beach

The Truth about Prefect, Mage, and Airflow.

Apr 10 • Daniel Beach

Reducing Memory Consumption

Nov 27 • Daniel Beach

Spark vs Polars. Real-life Test Case.

Nov 9 • Daniel Beach

New

Top

Community

Immutability for Data Engineers

Nothing ever changes ...

Nov 22 •

Delta Lake Liquid Clustering vs Partitioning

New School vs Old School

Nov 20 •

Simplify Delta Operations with MERGE and COPY INTO

for Delta Lake users.

Nov 13 •

Spark vs Polars. Real-life Test Case.

A Brave New World.

Nov 9 •

To Exist ... Or Not

Nov 6 •

Python vs Rust. Memory Usage and Speed.

Data Processing

Oct 30 •

Config Driven Pipelines

Dante's Seventh Ring of Hell

Oct 23 •

Data Engineering Central

Data Engineering Central

Long Live the Data Engineer. No holds barred.

Recommendations

SeattleDataGuy’s Newsletter

SeattleDataGuy

Data Analysis Journal

Olga Berezovsky

The Pragmatic Engineer

Gergely Orosz

Scaling DataOps Newsletter

On the Mark Data

The Python Papers

Mike Driscoll

Data Engineering Central

About Archive Recommendations Sitemap

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts