Stack Overflow
Stack Overflow

Questions tagged [dead-letter]

250 questions
0
votes
0 answers

RabbitMQ DLQ: How to reprocess all messages in sequence of arrival across multiple queues?

I am stuck with an issue where lot of messages have reached several rabbitMQ dead-letter queues. I have never had to reprocess bulk messages from DLQs earlier. The requirement now is to reprocess all these messages but in the exact sequence how they…
Nayak S
  • 428
  • 1
  • 5
  • 18
0
votes
1 answer

How to Implement beanprocessor to examine the attribute of meta listener?

My meta listener code @Target(ElementType.METHOD) @Retention(RetentionPolicy.RUNTIME) @KafkaListener(containerFactory = "myListenerContainerFactory", autoStartup = "false") public @interface mylistener1 { @AliasFor(annotation =…
Learner
  • 5
  • 2
0
votes
1 answer

How to test extended kafkaListener with custom element?

My dev env : Java 8 spring-kafka - 2.6.1 spring-kafka-test- 2.6.7 spring-boot - 2.3.10 Rest API to send message @PostMapping( value = {"publish"}) @ExternalApi public ResponseEntity endpoint() { Response response= new…
Learner
  • 5
  • 2
0
votes
0 answers

Handling bad messages in Kafka

I have .Net 6 consumer of Kafka, that runs in several instances, all in the same group. Some messages can make the consumer instance crash. It's not possible to catch an exception and do something inside the consumer after crash happens. I want the…
user393679
  • 329
  • 2
  • 3
  • 10
0
votes
0 answers

SQS fifo with dead letter queue and lambda failing to process messages within the same group after getting runtime exception

I’m using SQS fifo with a dead letter queue with Lambda. My maxReceivecount is 1 and visibility timeout is 15 minutes. When one message fails with a runtime exception, it is not immediately removed to the dead letter queue, it waits 15 minutes. Also…
Marina Sovic
  • 167
  • 2
  • 9
0
votes
1 answer

How to prevent the main topic from re consuming the DLQ processed message?

I have a kafka consumer class which has a Main-Topic listener and a DLQ listener. When the main-topic listener fails to process the consumerRecord, Then the record gets pushed into the DLQ topic based on my bean factory. Consequently, The DLQ…
KGT
  • 29
  • 3
0
votes
0 answers

Handling the Dead Letter Queue when message processing sequence is crucial?

We have a subscription on Azure Service Bus which will receive a high-throughput of messages. Each message contains a CustomerId, and it is crucial messages for a Customer are consumed in the order they were published. We achieve this by setting…
FBryant87
  • 4,273
  • 2
  • 44
  • 72
0
votes
1 answer

RabbitMQ dead letter queue housekeeping

I have a RabbitMQ instance that has an exchange, a regular queue and a dead letter queue. Rejected messages are moved from the regular queue to the dead letter queue. These rejected messages are not important to me because any missed data is…
Isegrimm
  • 21
  • 3
0
votes
0 answers

Google cloud Pub/Sub - it does not forwarding messages to dead letter topic

I know this question already exist but nobody gave a valid solution. I am trying to configure dead letter topic for unack messages to handle failures gracefully, however, it doesn't seem to be working. I tried through google cloud console: create…
Bee-Whyt
  • 1
0
votes
1 answer

Azure ServiceBus AbandonMessageAsync releasing message at inconsistent times

I have the need to inspect a dead letter queue, and if some condition exists (like older than 30 days) I want to archive it to some data store (not just remove it). So I was gonna grab the messages, if it meets this condition, save it to some store…
Nick Novotny
  • 95
  • 7
0
votes
1 answer

How is the retried data processed when a lambda function?

I captured some bugs in my lambda function and then fixed them. Since in my lambda function, I have set maxReceiveCount=10 in the DLQ so lots of data were being retried even until I uploaded the new version. My question is: if the data was sent…
Memphis Meng
  • 1,267
  • 2
  • 13
  • 34
0
votes
0 answers

How to recognize the source topic in the dead letter queue messages if multiple topics are pushing the unack msg in the same dead letter queue GCP

How to recognize the source topic in the dead letter queue messages if there are multiple topics pushing the unack messages in the same the same dead letter queue
tejas
  • 1
  • 1
0
votes
2 answers

ServiceBusReceiver PeekMessageAsync only returns maximum of 250 dlq-messages?

I am reading from a deadletter queue on servicebus using the ServiceBusReceiver(which I want to continue using). However, the receiver.PeekMessagesAsync(550) only fetches a maximum of 250 messages from deadletter queue??? How can I change this? I…
JoBo
  • 235
  • 4
  • 17
0
votes
0 answers

AWS SQS redelivery of messages in the DLQ

I wanted to know what are the common practices for the redelivery of messages from the DLQ. So if a message fails and is put on the queue, I know one approach is to have another lambda process that message and redeliver it. That kinda works... But…
user1555190
  • 2,803
  • 8
  • 47
  • 80
0
votes
1 answer

Kafka message are sent to single topic instead of n retry topic and dlt

I am trying to implement n-retry topic with DLT but all the messages are being pushed to a single topic test-topic-retry-0, there are 3 duplicate records in test-topic-retry-0 which are supposed to be like this: test-topic-retry-0 -> 1 message…
javi
  • 23
  • 5
1 2 3
…
16 17