Stack Overflow
Stack Overflow

Questions tagged [rabbitmq-shovel]

58 questions
0
votes
0 answers

RabbitMQ Shovel Ack-Mode

I am using RabbitMQ shovel between two clusters, and I am seeking answers to the following: what is the actual difference between on-confirm and on-publish modes if the destination queue is durable and the messages there are persisted? I want the…
Muhammad Fathi
  • 1
  • 1
0
votes
0 answers

RabbitMQ Filter Messages using Shovel/Header based shovel

Is there any option to filter messages when using Shovel. For example, vhost1 > exchange1 > filter set of messages > vhost2 > exchange2. or using header exchange vhost1 > header-exchange1 > header based filtering > vhost2 > queue2
enthusiast
  • 355
  • 1
  • 5
  • 16
0
votes
0 answers

RabbitMQ Header Exchange based Shovel

Hello Team, Whats the bets way to solve this problem? Solution 1 is to have mirror queues in vHost 1 for all corresponding destination queues and create a shovel between queues. Is there any alternatives which avoids creating a mirror queue in…
enthusiast
  • 355
  • 1
  • 5
  • 16
0
votes
1 answer

RabbitMQ: Queue -> Shovel -> Stream - How to correctly configure for Stream message format

On one server, I want a Queue (buffer) and when there is a connection to the other server, it should Shovel its messages to the Stream there. I want to access the Stream with a Python client and the Stream protocol, meaning the messages need to be…
Moe
  • 62
  • 10
0
votes
0 answers

Shovel from Exchange - how are data persisted?

There are two environments, one is always online (A), the other one (B) might be online 2-3 days a week, whenever possible they must be synced. now I've already got a working shovel (on A) to sync the data from A to B, but I'd like to know the…
Giovanni Luisotto
  • 1,382
  • 7
  • 12
0
votes
1 answer

RabbitMQ.Client Faild to consume the messages shoveled from Azure Service Bus

I have a .net application to connect to RabbitMQ with RabbitMQ.Client 6.4.0. The messages are shoveled from Azure Service Bus. The RabbitMQ.Client throw the following exception. But, if the message is sent from RabbitMQ UI, or RabbitMQ.Client…
Jim Wang
  • 1
0
votes
1 answer

Can we move RMQ messages in batches to another RMQ using shovel(dynamic)?

I wrote a script which uses RMQ shovel's PUT api to move messages to another RMQ but I was wondering about how it works internally. Does it move all the messages instantaneously? If yes, can we move it in batches for optimising it?
Vid
  • 123
  • 11
0
votes
1 answer

Shovel Configuration between 2 AWS MQ private RabbitMQ clusters

So I have 2 AWS MQ RabbitMQ clusters in the same vpc without public accessibility. Both are multi az Clusters with 3 nodes. Lets say rabbitmq-1 rabbitmq-2 Now I want to create a dynamic shovel from 1 to 2 in the Rabbitmq management console. I'm…
Vasilis Markopoulos
  • 21
  • 6
0
votes
1 answer

Rabbitmq. Move part of messages from one queue to another

I have two queues For example: A = ['foo', 'abo', 'aboba', 'bar']; B = []; I'd like to move only 'aboba', 'bar' from queue A to B. It doesn't matter which side of A to cut. I know about rabbitmq shovel, but I don't found tools for my case in this…
Gregory Sysoev
  • 173
  • 1
  • 15
0
votes
1 answer

How to handle stuck RabbitMQ Dynamic Shovel messages

We are currently using RabbitMQ Dynamic Shovels to forward messages to Azure Event Hub. Recently we setup a new Queue to be forwarded to Event Hub. Some messages in this Queue have a size of over 1MB which is the limit for messages on Event Hub.…
Alexander Lackner
  • 3
  • 3
0
votes
1 answer

Rabbit MQ Shovel Plugin- Creating duplicate data in case of node failure

I am creating shovel plugin in rabbit mq, that is working fine with one pod, However, We are running on Kubernetes cluster with multiple pods and in case of pod restart, it is creating multiple instance of shovel on each pod independently, which is…
Nilay Tiwari
  • 492
  • 5
  • 16
0
votes
1 answer

RabbitMQ: Shovel vs Federation for Microservice Communication

I've spent quite a bit of time trying to figure out whether I should use the RabbitMQ federation plugin or shovel. Basically I have two microservices. I want one of them to send a message to another. Each microservice has a different rabbitMQ…
Asool
  • 13,031
  • 7
  • 35
  • 49
0
votes
1 answer

dynamic shovels fail in Rabbitmq

I am trying to create dynamic shovels in my RabbitMQ instance both via code and using the UI. In both the cases, I am able to create the shovel. However , it's failing later on and is not able to move messages as desired. Via Postman PUT --…
Naxi
  • 1,504
  • 5
  • 33
  • 72
0
votes
1 answer

Shovel plugin not transferring existing messages to destination queue

I'm trying to copy all the messages in queue (Q1) to another queue (Q2) running on a different machine. I'm using the shovel plugin and both nodes are running amqp 091. I've tested the connection and if I set the destination queue to a non-existing…
Michael Laythe
  • 11
  • 3
0
votes
1 answer

RabbitMQ Shovel over TLS errors with badmatch after renewing certificates

My RabbitMQ installation has been running for over a year using TLS connected shovels. The shovels worked with the self-signed certificates until they expired. When I recreated new certificates, the shovels still won't work even though I placed the…
JohnG
  • 429
  • 1
  • 4
  • 14
1 2
3
4