Data Processing
Not an expert here, But isn't Spark already good for this kind of Data processing?
I agree, I was thinking more along the lines of why "Rust tools like Polars with a Python front end" are the next gen of data tools. Spark will be on top of the hill for a long time, but cost pressures are causing folks to look for other solutions.
Not an expert here, But isn't Spark already good for this kind of Data processing?
I agree, I was thinking more along the lines of why "Rust tools like Polars with a Python front end" are the next gen of data tools. Spark will be on top of the hill for a long time, but cost pressures are causing folks to look for other solutions.