We are looking to implement a monitoring system where we have to monitor some specifics from 80,000 nodes. We are also looking to generate reports from the 80,000 nodes. We are thinking of using a client on each node to send out messages to a queue where another program can read the messages and generate cumulative reports.
We are considering Kafka/ActiveMQ/RabbitMQ as some of the products for messaging solution. Which one is a better fit?
The message production rate will be approx 5-10/s per node.