Questions tagged [aws-sqs-fifo]

100 questions
0
votes
1 answer

AWS SQS FIFO - Messages with same MessageGroupId are going to separate listeners

I have a clustered java hibernate application (with 2 nodes) listening to an AWS SQS FIFO. The messages in the queue contains a specific MessageGroupId. When java listener is reading the messages, i can see that the messages with same MessageGroupId…
0
votes
1 answer

Looking for a mechanism to stop/suspend the execution of consumers of an SQS queue while idle

Would like to understand if there exists a library or some alternative mechanism via which I can resume/restart the execution of the consumer when there are messages in the SQS queue and suspend/sleep them when there are no more messages in the SQS…
0
votes
1 answer

How to configure serverless.yml file to trigger lambda as soon as i recieving messages in sqs

I already have implementations for sending and recieving sqs messages. The requirement is to conditionally trigger a new lambda as soon as i recieve any new meesage in sqs.
0
votes
0 answers

Visibility timeout on AWS SQS Fifo queues with batch size 1

I have an SQS Fifo queue with batch size 1 and visibility timeout configured at 30s. The lambda function consuming from the queue is configured with a 30s timeout as well. Any reason in this scenario to follow AWS recommendation to increase the…
x-term
  • 87
  • 2
  • 8
0
votes
0 answers

Ordering in Amazon SQS FIFO

We are incorporting a FIFO SQS which will be recieving message through Lambda during exception. Due to some implication, I am not able to set the MessageGroupId with group Identifier such as SessionId or CustomerId, so that there is strict ordering…
0
votes
1 answer

High availability in AWS SQS

I have a microservice which pushes the messages to the SQS Fifo queue. If in future the SQS is down, How can I configure a secondary SQS as a failover. Could also please mind in explaining how AWS manages the high availability of SQS. IS SQS a…
0
votes
1 answer

How to add JSON from "Body" in the query parameter?

I'm trying to send a message to an SQS queue. I have everything setup correctly. I'm using a fifo queue, so my post string looks like this: https://queuename?Action=SendMessage&MessageBody=TEST&MessageGroupId=6&MessageDeduplicationId=6 The above…
stormyguy
  • 60
  • 7
0
votes
3 answers

AWS: inconsistency between SQS and lambda

I want to trigger lambda with a websocket. I have deployed a EC2 instance of websocket producer which is throwing all its data through SQS FIFO and SQS triggering lambda with same messageGroupId. But sometimes lambda is executing concurrently, I am…
0
votes
2 answers

Maintaining FIFO while moving from Sidekiq to Shoryuken

We are currently performing event processing in FIFO order in our Rails application using a queue in Sidekiq. Due to some reasons - cost and some other benefits - we are moving from Sidekiq to Shoryuken(with SQS FIFO queue). Currently, we are using…
0
votes
0 answers

Delaying individual message in SQS

I want to exponentially delay processing SQS messages when the earlier message processing fails. All the solution I have seen utilizes a lambda function and one or more DLQ. We aren't allowed to use Lambda yet. How can I achieve the same result…
bostonjava
  • 624
  • 1
  • 9
  • 20
0
votes
1 answer

Unable to build AWS SQS Connector (V1.0.7) by using Apache Maven 3.8.4

I want to edit SendMessage Operation Code in existing AWS SQS Connector(V1.0.7) and wanna to build this editable connector and use it in WSO2 EI 6.4.0. Reason to edit existing Code: Unable to post incoming payload into AWS SQS Queue often. For more…
Justin
  • 855
  • 2
  • 11
  • 30
0
votes
0 answers

AWS SQS FIFO queue behaviour with AWS Lambda reserved concurrency

So I have 10 message groups in FIFO queue having 2 messages per group and I have also reserved lambda concurrency set to 5. (Lambda completes execution in 1 min and SQS visibility timeout set to 2 mins) when all 20 messages are pushed to queue, SQS…
user17090811
  • 143
  • 2
  • 10
0
votes
1 answer

Getting lambda response when calling lambda through SQS

I have the following pipeline: Script --> SQS --> Lambda A script sends a message to a SQS queue. Based on the content of this message, the Lambda executes a different process (Calls an API with some payload) The script needs to receive the API…
SV125
  • 273
  • 1
  • 3
  • 13
0
votes
1 answer

Is it possible to calculate total time taken by each message group to process all messages in FIFO queue?

So I have created a FIFO queue where 10000 messages gets pushed which belong to 100 message groups and consumed by lambda. So wanted to see the following questions metrics: What is the total time taken to process all messages in each message group…
user17090811
  • 143
  • 2
  • 10
0
votes
1 answer

After Changing the Body content , AWS SQS is not saving the event and Error of access denied comes up

Using the Postman, I am trying to save an event in the SQS, it is all working fine with just simple JSONas below, { "subscriptionId": "6d000ba7-9bcb-3e2f-bf2e-e960026f000e", "notificationId": 6, "id": "e8ee798d-c888-4fdd-666a-626627da0f73", …