Data Engineering Central

Data Engineering Central

Rayon in Rust vs Python Process and Thread Pools.

Data-parallelism in the real world.

Daniel Beach's avatar
Daniel Beach
Mar 09, 2023
∙ Paid
7
5
Share

Hmmm. This is one of those topics that drives folks crazy. I love it. When it comes to coding and programming there are few things in this world that will make people light torches and rise pitchforks than parallel data processing. The only thing that makes people madder is probably async code.

Many moons ago I used to have to worry a lot about ProcessPo…

Keep reading with a 7-day free trial

Subscribe to Data Engineering Central to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 dataengineeringdude
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture