Stack Overflow
Stack Overflow

Questions tagged [dlq]

28 questions
1
vote
0 answers

Configure AWS SQS Dead Letter Queue in AWS for a specific error message

Is there any way in AWS SQS to route only the messages failed with particular error message to DLQ (Dead Letter Queue)? By default, all the unprocessed messages are sent to DLQ. Is there any way to customize it based on error message?
Kingston X
  • 65
  • 5
1
vote
0 answers

DDB stream Lambda tumbling window retry behaviour

I am using Lambda with DDB trigger to listen to DDB stream. I am not clear about retry behavior of Lambdas with tumbling window. If I am maintaining a state of x in 5 minutes of tumbling window with DDB stream batch size of 10, and my nth lambda…
itrat jameel
  • 53
  • 2
1
vote
1 answer

AWS FIFO SQS: How does SQS maintain ordering in a group when a message is stuck in DLQ?

I am planning to use AWS FIFO SQS to keep record of current status of each item in my datastore. I will be using the unique identifier of each item as the messageGroupId to ensure strict ordering of messages for each item. Does SQS ensure that if a…
ash_m
  • 31
  • 3
1
vote
1 answer

No bugs in codes, why messages are still being sent to Dead Letter Queue?

I have 2 Lambda functions that respectively sent and received some workloads via a SQS. But many messages are unexpectedly sent to DLQ. I am confident that it wasn't caused by in-code bugs because not all messages went to DLQ. I set…
Memphis Meng
  • 1,267
  • 2
  • 13
  • 34
1
vote
1 answer

Java JMS - Send message to Dead Letter Queue explicitly

Is there a way to explicitly tell the broker to send a message to the queue's assigned dead letter queue? I know we can configure a queue to automatically send messages to the DLQ after a certain number of re-delivery attempts. That makes perfect…
Todd Johnson
  • 147
  • 1
  • 11
1
vote
0 answers

Kinesis with DLQ message struct

I defined a DLQ for Kinesis stream and now I'm creating a lambda that will receive SQS messages and handle them. I saw at AWS docs that the message format is: { "requestContext": { "requestId": "c9b8fa9f-5a7f-xmpl-af9c-0c604cde93a5", …
omer blechman
  • 277
  • 2
  • 16
1
vote
0 answers

How to handle bad events in a batch job on EMR

I am running an EMR which processes some logs containing around 15-20M log events. Sometimes few log events contain badly formatted data that break my pipeline. I am looking for some options to drop those log events in a file or a queue. Then I can…
IamSoo
  • 53
  • 1
  • 4
0
votes
0 answers

Observability for DLQs? [AWS SQS]

I'm trying to understand what is the best way to implement some sort of Observability for DLQs. I know it's possible to have some monitoring (e.g.: There are 3 messages in the DLQ XYZ) I'm trying to understand if there's a way to know what happened…
jonathanlima
  • 159
  • 2
  • 9
0
votes
1 answer

Is there a way to delete DLQ messages under topic subscription azure servicebus through powershell script

Am planning to develop an powershell script to delete DLQ messages under Azure servicebus topic subscription, however i could not find any powershell cmdlet to delete the DLQ messages and when i referred some documents it says its not possible to…
Arun Kumar
  • 125
  • 1
  • 2
  • 6
0
votes
0 answers

Is AWS using ApproximateReceiveCount to determine whether message has reached its retry count?

We are building an application that reads messages from a SQS standard queue. The maxReceiveCount is configured to 5. We are reading ApproximateReceiveCount attribute in the app and doing certain operation if the service is processing the message…
Xifeng Zheng
  • 1
  • 1
0
votes
0 answers

AWS SQS and SQS DLQs are the fail safe. What if the SQS Service Fails?

I use SQS and SQS based DLQs a lot to have resiliency in my application architecture. What is the best way to implement a DLQ when AWS SQS Service is not available and adding the event to SQS fails?
Jaf
  • 811
  • 2
  • 7
  • 9
0
votes
0 answers

What is the use of having a retry queue in microservices architecture?

We have a lambda which calls a service. To handle the scenario of the service being down. We want to have a retry queue and a dead letter queue. If the lambda is not able to send the event to service the first time, it will send it to retry…
V K
  • 1,645
  • 3
  • 26
  • 57
0
votes
1 answer

SpringCloud Stream error-handler-definition doesn't work

I'm using spring-cloud-starter-stream-rabbit 4.0.2, and want to write my own ErrorHandler for those sending failed messages. Refer to Spring docs, using 'error-handler-definition' property, but it doesn't work, myErrorHandler not invoked, instead…
ttdys108
  • 11
  • 2
0
votes
0 answers

Purge DLQ automatically every X minutes on Amazon MQ broker

I thought my problem was simple but after multiple attempts, it turned out to be more complicated than expected. I'm using Amazon MQ for testing purposes and would just like all messages in all DLQs to be deleted automatically after X minutes. The…
Siick
  • 491
  • 1
  • 7
  • 23
0
votes
1 answer

endless dead letter queue (DLQ) processing when Middy.js SQS queue validator fails

I've got a lambda handler that processes incoming SQS events. There is a middyJs handler with a validator middleware on top of that. When MiddyJs validation fails the event gets stuck in an endless loop inside DLQ. When I throw an Error…
Pouyan
  • 15
  • 5
1
2