8 Comments

And Polars just got Iceberg support: https://github.com/pola-rs/polars/pull/10375

Further supporting your argument that the future has a heavier focus on developer experience.

Expand full comment
founding
Oct 4, 2023Liked by Daniel Beach

Loving Polars and Delta Lake - but not sure I was say "goodbye" to Spark as there are still a lot of scenarios that benefit massively from it. But then again, I am a tad biased, eh?! :)

Expand full comment
Oct 2, 2023Liked by Daniel Beach

Great post as usual Daniel, I also have a small project with same stack with your blogpost where I ingest a parquet from S3, transform it to delta table, do some processing and export back to S3.

Expand full comment

Love Polars. It's even better if you mix it with DuckDB.

Expand full comment