For Data Engineering
In quick_sort_s3_objects_by_date you can have 1 line of code instead of 9 by doing this:
let (less_than_pivot, greater_than_pivot) = objects.into_iter().partition(|object| object.last_modified.unwrap() <= pivot.last_modified.unwrap());
By Gandalf’s beard! -:)
Or read the files as athena table and use file size, path and last modified time metadata columns..
In quick_sort_s3_objects_by_date you can have 1 line of code instead of 9 by doing this:
let (less_than_pivot, greater_than_pivot) = objects.into_iter().partition(|object| object.last_modified.unwrap() <= pivot.last_modified.unwrap());
By Gandalf’s beard! -:)
Or read the files as athena table and use file size, path and last modified time metadata columns..