Stack Overflow
Stack Overflow

Questions tagged [aws-sqs-fifo]

100 questions
2
votes
0 answers

Optimizing SQS batching for groups

I have a system built on AWS which uses SQS to put requests related to different customers in a queue, to be handle by a single consumer - a Lambda function. One special circumstance is that requests should be handled in such a way that each lambda…
JHH
  • 8,567
  • 8
  • 47
  • 91
2
votes
1 answer

does aws sqs takes in consideration message attributes / system attributes in consideration when content based deduplication is enabled?

I am working on a project using aws sqs, i want to use content based deduplication for fifo queues but i couldnt find in the documentation if sqs considers message attributes and message system attributes as "Content" or no.
oubaydos
  • 194
  • 1
  • 13
2
votes
0 answers

AWS - SQS FIFO - message can't be deleted - the receipt handle has expired

Polling Duration - 10sec Visibility Timeout - 1min. 1- deleting message within polling duration -> Success 2- deleting message after polling duration is over but within visibility timeout period -> Fail when I try to delete a message within the…
shagg ing
  • 69
  • 5
2
votes
0 answers

How do we configure multiple SQS consumers for same queue in Springboot application?

I want to scale SQS consumers in the Springboot application. Right now I am using @Sqslistner annotation to receive a message in one thread only. I want to increase SQS listeners. But I am not sure how to use @Sqslistner in multiple threads.
Nikole
  • 21
  • 1
1
vote
1 answer

SQS FIFO to trigger lambda only after 10 messages in the queue

I will explain our use-case and our current approach (it might be inefficient) and the issue we have with our implementation. Use case We have a lot of data coming into MQTT topics (IoT Core) and we need to process each record (append some…
D3V
  • 88
  • 5
1
vote
1 answer

AWS SQS FIFO Received message was empty

I'm learning AWS SQS and I've sent 1 messages to a FIFO queue. But when I try to receive messages, I cant get meesage. What is my mistake? Senders code (lambda-function) XURL=quote(URL) client = boto3.client('sqs') url_fifo =…
dlis168
  • 21
  • 7
1
vote
0 answers

Unable to get the ARN for AWS SQS and its dead letter queue

I am creating a sqs with a dead letter queue. The creation of the queue is success but I need to store the ARN value of the queue in systems manager at parameter store. Is there any way to pass the value to parameter store? Please provide inputs. I…
mac34
  • 11
  • 1
1
vote
1 answer

AWS SQS - How to conditionally decide whether a message should be moved to the DLQ?

I know SQS has the maxReceiveCount and once the message has been consumed and failed this amount of times, then the message is moved to the DLQ. That's working currently. However, there are certain errors which I would want to go back in my source…
Ben Parker
  • 13
  • 4
1
vote
0 answers

Lambda function that poll events from SQS only the first day of the month

I need a lambda function that poll events from a fifo SQS queue only the first day of the month. Is it possible? For example: One lambda adds some events to a queue only the first day of the month. Another lambda should process queue's messages in…
Pater
  • 83
  • 1
  • 6
1
vote
0 answers

Receive specific message from AWS SQS queue

I have a scenario where I am sending a message to a request queue which in turns calls a lambda. That lambda performs some operation and write the data to a response queue(AWS SQS). How do I retrieve the specific message from my response queue for…
Archit Agarwal
  • 13
  • 3
1
vote
1 answer

Keeping the same message group id between linked FIFO SNS and FIFO SQS

I have a FIFO SNS linked to a FIFO SQS (SNS sends messages to the SQS). Now I want to use message ordering, using the message group id. So the publisher of the message will set the message group id, while sending the message to the SNS. I want these…
Mooncrater
  • 4,146
  • 4
  • 33
  • 62
1
vote
0 answers

Track completion status of batch of tasks in AWS SQS

I have queue where I publish multiple batches of tasks to same queue. Each batch is associated with a unique identifier. Is there a way to track completion status of the batch? I can think of attaching message group ID to each message of the batch…
Aditya Abhas
  • 174
  • 11
1
vote
1 answer

Understanding lambda concurrency

I am trying to understand how a lambda triggered by SQS fifo queue handles load and concurrency. To test, I've created a lambda that publishes X number of messages to an SQS fifo queue (single MessageGroupId). FIFO queue has a batch size 1. The…
user1738539
  • 874
  • 2
  • 11
  • 23
1
vote
1 answer

API gateway to SNS connection issue using message attributes

Good day all, i am finding a difficulty on publishing messages using node js code through an API gateway POST to SNS using the filtering policy (message attributes) which is set to service_type in SQS and SNS so the messgae should be sent to a…
Aws
  • 11
  • 1
1
vote
1 answer

How to block AWS SQS FIFO while having a message in the deadletter queue?

Imagine the following lifetime of an Order. Order is Paid Order is Approved Order is Completed We chose to use an SQS FIFO to ensure all these messages are processed in the order they are produced, to avoid for example changing the status of an…
Mikhail Fayez
  • 421
  • 3
  • 15
1
2
3 4 5 6 7