I have 1 topic with K partitions, however the messages are of varying size. Let's say they have weights on a scale of 1 to 10, and the consumers take equivalent time/resources to process them.
How do we design a custom partitioner to spread the messages across the K partitions so that the K consumers have similar load?