We have the max_map_length variable configured in airflow configuration which will make the dynamic task fail if the length of mapped tasks is more than the set limit
eg: max_map_length = 1024 , if the task length is more than , the task will fail with UnmappableXcomLength.
Is there any way that , instead of failing the task, if the length is more than the set limit, it need to run the set limit tasks at a time (say 2000 tasks are present, instead of failing, run 1024 batch at a time and run remaining once the previous batch is completed.)
