Data Engineering Central

Data Engineering Central

DataFrame to Postgres. Fastest option?

into the Thunderdome

Daniel Beach's avatar
Daniel Beach
Sep 15, 2025
∙ Paid
12
1
Share

You know, if I think back all those many years ago when I first started playing around with PHP, Perl, MySQL and the like, some things have stayed amazing consistent. Like very consistent.

Even when I graduated to VBA and C# (heaven protect me), found Python and decided to stick to that, one thing remained the same. I’ve literally being doing this over and over gain. What?

Pushing data/files/dataframes into Postgres or MySQL. Even today, these decades later here I sit infront of Databricks (Yes, I know about LakeBase), tell Spark to …

Attention!

Because you’re all cheapskates and I spend my hard earned money burning AWS and Databricks compute for you ungrateful hobbits, I’m offering 50% OFF a Yearly Subscription to you my most ungrateful subjects.

$27.50 for a year of my genius??!!

Keep reading with a 7-day free trial

Subscribe to Data Engineering Central to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 dataengineeringdude
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture