Stack Overflow
Stack Overflow

Questions tagged [aws-sqs-fifo]

100 questions
0
votes
1 answer

Why 4 SQS FIFO with not batch to reach 1000 msg/sec during a peak demmand and not 2 SQS FIFO each with a btach of 2 msgs?

Hi guys I would like to take out a doubt. The solution to this question is a little bit controversial. Ok, You can use 4 SQS FIFO in batch mode and reach the rate of 1200 msg/sec. But I could use 2 SQS FIFO in batch mode each with a batch of 2…
Lucas Vital
  • 19
  • 5
0
votes
0 answers

AWS SQS send_messages (batch) where some deliveries fail

Suppose I want to bulk-send three messages, A, B, C, in that order, to a FIFO SQS queue. I could use the bulk SendMessageBatch call. We provide the ordered list [A,B,C] to the API call. Suppose that the sends of A and C return HTTPCode 200, but B…
socrates
  • 327
  • 2
  • 11
0
votes
1 answer

Why does SQS FIFO queue with lambda trigger cannot guarantee only once delivery?

I came across an AWS article where it is mentioned only once delivery of a message is not guaranteed when the FIFO queue is used with a lambda trigger. Amazon SQS FIFO queues ensure that the order of processing follows the message order within a…
Satyaaditya
  • 537
  • 8
  • 26
0
votes
1 answer

When can two AWS SQS FIFO queue consumers process messages with the same group message id?

We have provisioned a single AWS SQS FIFO queue. There is a single process that adds items to this queue. All items added have the same group message id. We start two independent identical processes, Consumer A and Consumer B. The only thing the…
rlandster
  • 7,294
  • 14
  • 58
  • 96
0
votes
1 answer

AWS SQS FIFO message doesn't seem to be retrying

I've set up a function to hit an API endpoint for a newly created entity that isn't immediately available. If the endpoint returns a status of "pending", the function throws an error. If the endpoint returns a status of "active", the function then…
Matt Dietsche
  • 578
  • 5
  • 17
0
votes
1 answer

How does the AWS Console receive multiples messages with same message group ID for a FIFO queue?

I created a test SQS FIFO queue test.fifo - see screenshot below. Then: I sent three messages to it with message-group-id = A, and message bodies A1, A2 and A3 respectively using AWS Console (via Send and receive messages button). Using AWS…
bappak
  • 865
  • 8
  • 23
0
votes
1 answer

How to pull logs out of s3 bucket using SQS

I have an s3 bucket saving logs constantly on json.gz format, I´m trying to pull out those logs to an elastic agent host on a GCP cluster using SQS. My configuration for the SQS is a default one, also I´m using the FIFO type. The Access policy…
IsNotMyIp
  • 13
  • 2
0
votes
0 answers

SQS consumer is missing a bunch of messages

Question I have noticed an issue where sqs consumer possibly misses the messages in the queue. Around an year ago, it was perfectly fine and this started to happen before a few months. Here's my code Sending messages into SQS…
dexie
  • 11
  • 2
0
votes
0 answers

AWS SQS Queue: AmazonClientException: Failed to schedule request

Getting this error when trying to upload the message in AWS SQS queue: Error in calling sqs Failed to send message to QueueMessageChannel[QueueMessageChannel@2bc20c83]; nested exception is com.amazonaws.AmazonClientException: Failed to schedule…
Sarthak Garg
  • 1
  • 3
0
votes
0 answers

AWS Lambda Function with Chalice not handling SQS messages

I have a lambda function which is implemented with Chalice and I am trying to process SQS messages with it. The code is implemented based on this documentation: https://aws.github.io/chalice/api.html#Chalice.on_sqs_message app.py app =…
Valip
  • 4,440
  • 19
  • 79
  • 150
0
votes
0 answers

SQS exactly once processing without ordering

Is there a way to enable “exactly once” message processing on an SQS queue without caring about message processing order? I saw that FIFO SQS queues guarantee exactly once processing, but they have some other limitations. I’m also concerned about…
nico
  • 139
  • 2
  • 8
0
votes
1 answer

AWS SQS - How to process one message at a time?

I have a FIFO Queue in the AWS SQS, which is trigger's Lambda function. I want to process each messages in Lambda function without parallel execution (one message at a time) For example: If I have a message A, B, C in the queue. My lambda should…
Ramesh Murugesan
  • 4,727
  • 7
  • 42
  • 67
0
votes
1 answer

JMS Provider to connect to AWS SQS using .bindings

We are looking for moving our solutions to start using AWS Simple Queue Service instead of Rabbit MQ. Now we are using JMS to connect to our queues using a .bindings file to configure the jndi context to connect. Is it possible to use a .bindings…
raddesso
  • 169
  • 7
  • 14
0
votes
1 answer

The receipt handle has expired while deleting message from SQS FIFO queue

I tried to delete fifo queue message however my visibility timeout is 12 hours. But still i am unable to delete message after polling time. I have searched alot but didn't get any usfull way to delete the message. Can please someone help me in…
Assis Wasiq
  • 1
  • 1
0
votes
0 answers

SQS fifo with dead letter queue and lambda failing to process messages within the same group after getting runtime exception

I’m using SQS fifo with a dead letter queue with Lambda. My maxReceivecount is 1 and visibility timeout is 15 minutes. When one message fails with a runtime exception, it is not immediately removed to the dead letter queue, it waits 15 minutes. Also…
Marina Sovic
  • 167
  • 2
  • 9
1 2 3 4
5
6 7