Archive - Data Engineering Central

Data Engineering Central Podcast - 09

Cluster Fatigue and the Death of Open Source

Nov 13 •

6:51

650GB of Data (Delta Lake on S3). Polars vs DuckDB vs Daft vs Spark.

cluster fatigue

Nov 12 •

Databricks Compute.

Examining the Inscrutable

Nov 10 •

_internal.DeltaProtocolError:

The Databricks and Delta Lake lie (the mighty have fallen)

Nov 6 •

ClickHouse: A Super-Fast Columnar Database

Guest Post Series

Nov 5 •

Gzip. CSV. Python. S3. (Polars vs DuckDB)

headaches ya' know?

Nov 3 •

October 2025

Lance file format. Parquet killer?

Oct 27 •

AWS Outage. Pipeline Problems? What next?

Oct 21 •

Simplifying CI/CD with Databricks Asset Bundles (DABs)

From Chaos to Control

Oct 20 •

Drainage: The Missing Piece in Your Lake House Health Strategy

How a Rust-powered Python library is revolutionizing data lake monitoring and optimization

Oct 16 •

Fivetran + dbt Labs merger. What does it mean?

anything at all?

Oct 13 •

Run Llama 3.1 8B Locally with LangChain and SQLite Memory

Learn AI by doing

Oct 13 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts