Stack Overflow
Stack Overflow

Questions tagged [aws-sqs-fifo]

100 questions
1
vote
1 answer

In SQS + Lambda, can I write the distributed processing logic of Lambda internal poller that reads messages from SQS?

I am currently using SQS(fifo) + Lambda trigger architecture. Whenever a message is issued to SQS, a Lambda function is created and processed by the internal poller. This is perfectly normal, typical SQS + Lambda processing logic. But I want to…
Park jinhong
  • 13
  • 2
1
vote
1 answer

Generating AWS SQS signature from java

I need to get message from AWS SQS with using Spring RestTemplate(binded a proxy), instead of aws sdk or spring cloud aws messaging, because of some proxy problem of the company. I need to generate a header string includes Authorization signature…
simyaci
  • 53
  • 6
1
vote
1 answer

Is AWS SQS FIFO queue really exact-once delivery

I have the below function handler code. public async Task FunctionHandler(SQSEvent evnt, ILambdaContext context) { foreach (var message in @event.Records) { // Do work // If a message processed successfully delete the SQS…
George Taskos
  • 8,324
  • 18
  • 82
  • 147
0
votes
0 answers

Can I report only messages from failing group ID in ReportBatchItemFailures response from an AWS SQS FIFO queue?

According to Implementing partial batch responses AWS doc: If you're using this feature with a FIFO queue, your function should stop processing messages after the first failure and return all failed and unprocessed messages in batchItemFailures.…
Mathieu Défosse
  • 3
  • 1
  • 5
0
votes
1 answer

AWS SQS doesn't trigger expecting Lambda stepfunctions , not processing all messages in queue

I have configured sqs on s3 bucket, the sqs should invoke 21 stepfunctions for 21 files uploaded in s3 bucket, instead only 14 stepfunctions are triggered and i am missing remaining 7 events. The moment i upload 21 files in s3 bucket, these,…
VKRV
  • 1
  • 1
0
votes
0 answers

Spring Batch 5 Remote Partitioning Using spring-cloud-aws 3.0.1 SQS

I have integrated AWS SQS to run a batch job using spring batch 5 remote partitioning. I have used LocalStack for SQS service. My Worker configuration is working fine and Manager Configuration application is exiting without errors. I have referred…
praneeth
  • 203
  • 1
  • 4
  • 14
0
votes
0 answers

lambda not processing sqs message from a fifo queue

I have a lambda which processes messages from standard queue and that works fine. so, the execution role on lambda already has sqs permissions like receivemessage, getqueueattributes etc. I have created a sqs fifo as I want this lambda to read…
user2868864
  • 165
  • 2
  • 12
0
votes
1 answer

How is batching done in FIFO SQS queues?

Let's say I have a FIFO SQS, and a lambda which consumes a batch of messages from the FIFO SQS. The max limit on the size of this batch is 10, as mentioned here. I was wondering how this would work. Let's say we have some message group ID G, because…
Mooncrater
  • 4,146
  • 4
  • 33
  • 62
0
votes
0 answers

Rollback a SQS message

I would like to know if one can remove a message from SQS FIFO queue only with the response of sqs_client.send_message. I have tried MessageId from the response, but it's not a valid ReceiptHandle. I want to do this because I need to send several…
Learning from masters
  • 2,032
  • 3
  • 29
  • 42
0
votes
1 answer

AWS SQS + lambda message order in lambda handler records array

I'm planning to use an AWS SQS FIFO queue with my application, which queue gets messages from an SNS FIFO topic. The queue provides the messages in first-in-first-out order. What is not very clear to me by documentation is what does this mean for…
hubbabubba
  • 937
  • 1
  • 9
  • 17
0
votes
0 answers

SQS automatically converting '+' to ' '(blank) character

I have an API Gateway configured to send a json message to SQS. Below is the logs present at API Gateway end Endpoint request body after transformations: Action=SendMessage&MessageBody= { "crmData": { "lead_number": "+1-876-543-3210" …
sak76
  • 21
  • 4
0
votes
0 answers

How can I add a delay between two messages in the AWS SQS queue?

folks. I'm developing a live stream app like TikTok, twitch and we use AWS services for this project. But I'm struggling with a problem right now. I receive gifts from users during live streams and show them on the screen. Here is the problem: When…
umutaktepe
  • 58
  • 7
0
votes
1 answer

Put MessageGroupId in Camel SQS FIFO queue

When you need to send a message to a FIFO queue in AWS SQS using Apache Camel, you'll need to put a property named "MessageGroupId". But, we do know that Apache Camel is not always friendly, so how to? We do have docs telling us how to implement AWS…
Otavio Miguel
  • 334
  • 1
  • 5
  • 15
0
votes
0 answers

AWS JAVA SDK V2 decreasing the queue push performance?

I'm trying to migrate my codebase, from aws sqs v1 sdk to aws sqs v2 sdk. Here's my old code. CompletableFuture sendMessage(String url, String message){ CompletableFuture future = new CompletableFuture<>(); …
Keerthi Kumar S G
  • 33
  • 3
0
votes
1 answer

Does EventBridge maintain FIFO order during replay of an SQS FIFO source?

I am looking into using EventBridge as our platform for events/messaging. One concern is the lack of support for FIFO within EventBridge. This can be resolved by using an SQS FIFO source combined with an EventBridge pipe. I would like to know if…
Orion
  • 215
  • 2
  • 7
1 2 3
4
5 6 7