Stack Overflow
Stack Overflow

Questions tagged [aws-sqs-fifo]

100 questions
1
vote
1 answer

SQS SendMessageBatch Concurrency Limit

What is the maximum concurrency limit on SQS FIFO Queue? If I call 200 sendMessageBatch APIs with 10 messages(< 256KB) per API invocation. Will SQS be able to handle this? Sample Code: const totalSqsBatches = 200; const sqsPromises = []; …
Mithiridi Prasanth
  • 378
  • 3
  • 13
1
vote
1 answer

Does AWS SQS MessageGroupId ensure that messages of the same group are handled by the same lambda?

I have one sqs-fifo receiving payment notifications from another service that insert items into this sqs-fifo queue. I also have one lambda that is configured to be triggered by the sqs-fifo (lambda is not polling via code but configured in aws…
Kristi Jorgji
  • 1,154
  • 1
  • 14
  • 39
1
vote
1 answer

AWS FIFO SQS: How does SQS maintain ordering in a group when a message is stuck in DLQ?

I am planning to use AWS FIFO SQS to keep record of current status of each item in my datastore. I will be using the unique identifier of each item as the messageGroupId to ensure strict ordering of messages for each item. Does SQS ensure that if a…
ash_m
  • 31
  • 3
1
vote
1 answer

What messageIds should be added to the BatchItemFailures when processing SQSEvent from a FIFO-queue in an AWS-Lambda

According to https://docs.aws.amazon.com/lambda/latest/dg/with-sqs.html#services-sqs-batchfailurereporting they recommend to not process more records if you fail to process a record because it will preserve the order of the messages in an FIFO…
taracus
  • 393
  • 1
  • 5
  • 19
1
vote
1 answer

How to create this event filter in AWS SQS

This is the real data structure of my current json data, it contains [] in the data in the first place. {"events":[{"type":"message","message":{"type":"text"}}]} So, basically I just want text message type data from SQS, but now I don't know what…
Ben
  • 541
  • 1
  • 5
  • 15
1
vote
0 answers

SQS: Age of newest message

How can we calculate age of latest message in SQS? Use-case: I want to trigger a notification based on time elapsed(Age) since the latest message landed on SQS queue. Say my threshold cutoff is 1 hour, if first message lands on SQS at 11:00, second…
Himanshu
  • 21
  • 1
1
vote
0 answers

Why sending different message to AWS SQS return same message ID

I want to send messages to a FIFO sqs queue. Given a array of list different user ids, for each id, I want to call sendMessage command to send the id as message body. I'm expecting every time it will return a different message id, but actually they…
Fang Yuan
  • 11
  • 1
1
vote
1 answer

Is there any way (like retry )to handle AWS SQS Sendmessage Failure scenario in WSO2 EI 6.4.0?

I am performing SendMessage operation in WSO2 EI 6.4.0 using AWS SQS Connector (V1.0.7). Sometimes Message is not posted to AWS SQS Queue, got some ERROR/WARNING Message in Log mentioned below ERROR Code from Log: Error_code = 101506 or Error_code =…
Justin
  • 855
  • 2
  • 11
  • 30
1
vote
2 answers

Why do we delete the SQS message in queue?

We can set Retention time. After this time, the message is automatically deleted. It's very convenient. So, Why do we delete the SQS message using ReceiptHandle? What reason is it?
Coding Baby
  • 27
  • 6
1
vote
2 answers

AWS Step-Functions SQS CreateQueue Fifo Support

I'm designing a state machine in AWS Step Functions. I planned to use SQS in order to give status update to backend API. SQS type should be Fifo since the messages should be delivered in same order that are created. I'm using user id as QueueName…
Leia Renée
  • 51
  • 5
1
vote
1 answer

SQS with multiple consumers and long polling enabled for FIFO type SQS

I had a question regarding SQS services. If you have a SQS queue with multiple consumers and long polling enabled for FIFO type SQS. Which consumer gets preference for the delivery? Is it based on which started the polling first or is random? And…
Shafeel Mohammed
  • 53
  • 6
1
vote
0 answers

Priority queue with Worker Pod AutoScaler

I have a simple AWS SQS FIFO queue implemented with worker pod autoscaler WPA, now i want to make that queue a priority queue, one option would be using amazon MQ but its costly and its purpose is actually different, another option would be to…
Sami Ullah
  • 717
  • 8
  • 14
1
vote
1 answer

How to acknowledge the processing of a group of messages

I am lost in the jungle of AWS. I wish to acknowledge the process of a group of messages but i don't know what can be done. I use a SQS queue to push messages then process them by a specific handler based on the message type. These messages could be…
Troopers
  • 5,127
  • 1
  • 37
  • 64
1
vote
0 answers

Checking if AWS SQS message was received by queue and it is pending to read by listener or already read by listener

I am new to AWS and trying to create SQS message. I am using existing working code. I can see in the log that message is created successfully. I am logging SendMessageResult messageId for debugging purpose. Now I am trying to check if msg is pending…
stackUser
  • 545
  • 3
  • 9
  • 21
1
vote
1 answer

queue with outflow control (back pressure) on AWS

I would like to have a (high capacity fifo) queue I can put items into, but also control the rate of items leaving the queue. It seems like SQS rather focuses on processing items in the queue as fast as possible, with no direct control about the…
tcurdt
  • 14,518
  • 10
  • 57
  • 72
1 2
3
4 5 6 7