I have seen the following polars documentation:
https://pola-rs.github.io/polars-book/user-guide/multiple_files/intro.html#reading-and-processing-in-parallel
Is there a way to create a query plan to read many small json files from an S3 bucket?
This would be similar to the way Spark can read many small json files or csv files from a single S3 prefix (path) with
spark.read.format("json").load("s3a://my-bucket/path/to/smallfiles/*.json")