8

I'm working on a system in ActiveMQ where I would really prefer not to lose messages. My problem is that retrying messages is causing my consumers to block (instead of working on messages they could handle). I'd like to give failed messages several days to retry (for example, one of my potential destinations is another server I'll access via SFTP, which could be down), but I don't want a consumer blocking for several days -- I want it to keep working on the other messages.

Is there a way to tell the broker to resend the message later? Right now I'm looking into taking the message off of the queue and putting it on with a delay, but I'm wondering if there's a simpler way. I'm using Apache Camel, so a solution using that would be good too.

Brendan Long
  • 53,280
  • 21
  • 146
  • 188

2 Answers2

5

Camel can definitely help with this...

One way is to use a separate queue and periodically retry messages separately from the main flow (especially when performance is a concern). Also, this provides a separate queue to allow you to triage those error messages (view, clear, alter, manually retry, etc)...

something like this...see polling consumer for more details

//main route to process message from a queue (needs to be fast)
from("activemq:queue:mainQ").process(...);

//handle any errors by simply moving them to an error queue (for retry later)
onException(Exception.class)
    .handled(true).to("activemq:queue:mainErrorQ");

//retry the error queue
from("timer://retryTimer?fixedRate=true&period=60000")
    .bean(myBean, "retryErrors"); 

...

public void retryErrors() {
    // loop to empty queue
    while (true) {
        // receive the message from the queue, wait at most 3 sec
        Exchange msg = consumer.receive("activemq:queue.mainErrorQ", 3000);
        if (msg == null) {
            // no more messages in queue
            break;
        }

        // send it to the starting queue
        producer.send("activemq:queue.mainQ", msg);
    }
}

If you land on a better solution, let me know...good luck

Ben ODay
  • 20,784
  • 9
  • 45
  • 68
  • `"If you land on a better solution, let me know...good luck` I am just wondering if you happen to have a better solution for this problem now? – AlanFoster Jul 17 '12 at 15:24
  • at the moment, I don't have a better solution. I started adding some support to do this using pollEnrich() EIP, but it has been tabled for now...see: https://issues.apache.org/jira/browse/CAMEL-3211 – Ben ODay Jul 17 '12 at 19:37
  • Ah okay, I'll keep to your current solution for now then thanks! – AlanFoster Jul 17 '12 at 19:45
1

ActiveMQ trunk now has support for broker based redelivery https://issues.apache.org/jira/browse/AMQ-3894

gtully
  • 556
  • 4
  • 5