2 Comments

duckdb literally can zero-cost convert its result set to a polars frame, as its all Arrow memory.

So I think interop is as good as it can get.

Expand full comment

I think the biggest feature of Polars is that you can switch between lazy frames and eager frames and that we can connect directly to storage on cloud providers. I like DuckDB, but Polars is faster quering files from Data Lakes, may be Polars could add DuckDB integration using SQL on lazyFrames without needing to collect.

Expand full comment