Competing Consumers in Mass Transit with RabbitMQ

Question

I've implemented a simple publisher/consumer set with MassTransit, and I want to have the consumers read the messages from the same queue. However, when I run it, I see a large portion of the messages sent to the error queue instead of being consumed. From the discussions I've seen (SO, Forum), this should be really really simple with RabbitMQ (just point to the same queue), but it's not working. Is there an additional configuration that should be set?

Here's My Publisher

public class YourMessage { public string Text { get; set; } }
public class Program
{
    public static void Main()
    {
        Console.WriteLine("Publisher");
        Bus.Initialize(sbc =>
        {
            sbc.UseRabbitMqRouting();
            sbc.ReceiveFrom("rabbitmq://localhost/test_queue");
        });
        var x = Console.Read();
        for (var i = 0; i <= 1000; i++)
        {
            Console.WriteLine("Message Number " + i);
            Bus.Instance.Publish(new YourMessage { "Message Number " + i });
        }
    }
}

And My Consumer

public class YourMessage { public string Text { get; set; } }
public class Program
{
    public static void Main()
    {
        Console.WriteLine("Consumer");
        Bus.Initialize(sbc =>
        {
            sbc.UseRabbitMqRouting();
            sbc.ReceiveFrom("rabbitmq://localhost/test_queue");
            sbc.Subscribe(subs =>
            {
                var del = new Action<IConsumeContext<YourMessage>,YourMessage>((context, msg) =>
                {
                    Console.WriteLine(msg.Text);
                });
                subs.Handler<YourMessage>(del);
            });
        });
        while (true) { }
    }
}

score 6 · Accepted Answer · answered May 08 '12 at 21:49

6

The receiver/consumer and publisher cannot be on the same queue. If you want competing consumers have multiple instances of the consumer running against the same queue.

We have documentation, but this section is currently lacking, so I understand your confusion: http://readthedocs.org/docs/masstransit/en/latest/configuration/gotchas.html#how-to-setup-a-competing-consumer If you succeed, help with the documentation would be wonderful.

answered May 08 '12 at 21:49

Travis

10,444
2
28
48

the link to documentation is broken – diegosasw Oct 08 '21 at 08:08
Does anyone have a new link for how to setup competing consumers for publish? – lukejkw Jun 02 '22 at 06:47

score 4 · Answer 2 · answered May 10 '12 at 21:32

So, it looks like the solution was to change the line in the publisher:

 sbc.ReceiveFrom("rabbitmq://localhost/test_queue");

To something like:

 sbc.ReceiveFrom("rabbitmq://localhost/test_queue_publisher");

This prevented the publishers from competing for messages they weren't configured to consume.

score 1 · Answer 3 · answered May 15 '14 at 16:51

1

Just found an example on GitHub https://github.com/khalidabuhakmeh/MassTransit.ScaleOut ...

answered May 15 '14 at 16:51

shatl

911
16
21

Competing Consumers in Mass Transit with RabbitMQ

3 Answers3