Stack Overflow
Stack Overflow

Questions tagged [amazon-sqs]

Amazon Simple Queue Service (Amazon SQS) offers a reliable, highly scalable, hosted queue for storing messages as they travel between computers.

Resources

Tutorial

4134 questions
25
votes
4 answers

What is a good practice to achieve the "Exactly-once delivery" behavior with Amazon SQS?

According to the documentation: Q: How many times will I receive each message? Amazon SQS is engineered to provide “at least once” delivery of all messages in its queues. Although most of the time each message will be delivered to your application…
Filippo Vitale
  • 7,597
  • 3
  • 58
  • 64
24
votes
2 answers

AWS - SQS Batch Size and Lambda approach

If I understand correctly, batch size setting on Lambda decides how many messages to take in one sweep from the SQS. Therefore this JSON (taken from the test Lambda SQS); { "Records": [ { "messageId":…
Amiga500
  • 5,874
  • 10
  • 64
  • 117
24
votes
2 answers

Change deduplication interval in SQS FIFO

Is there a way to increase contentBasedDeduplication interval in SQS FIFO Queues? In the developer guide they mention If a message with a particular message deduplication ID is sent successfully, any messages sent with the same message…
user1692342
  • 5,007
  • 11
  • 69
  • 128
24
votes
1 answer

What's causing these ParseError exceptions when reading off an AWS SQS queue in my Storm cluster

I'm using Storm 0.8.1 to read incoming messages off an Amazon SQS queue and am getting consistent exceptions when doing so: 2013-12-02 02:21:38 executor [ERROR] java.lang.RuntimeException: com.amazonaws.AmazonClientException: Unable to unmarshall…
Joel Rosenberg
  • 1,432
  • 3
  • 13
  • 15
23
votes
1 answer

boto3 sessions and aws_session_token management

I am developing python software which deals with AWS SQS queues. It uses boto3, mostly boto3.session.Session. I have seen here that we can pass an aws_session_token to the Session constructor. When running my code outside of Amazon, I need to…
Geoffrey R.
  • 1,907
  • 1
  • 19
  • 32
23
votes
3 answers

Amazon SQS Dead Letter Queue: Is it really dead letter or poison?

I'm trying to get clarification on what exactly Amazon's SQS Dead Letter Queue is doing. According to http://aws.typepad.com/aws/2014/01/amazon-sqs-new-dead-letter-queue.html Dead Letter Queue - The ARN (Amazon Resource Name) of an SQS queue that…
Michael
  • 1,535
  • 2
  • 17
  • 32
22
votes
2 answers

Spring Cloud @SqsListener MessageConversionException: Cannot convert from [java.lang.String] for GenericMessage

I'm seeing the following exception when I try to consume an SQS message: org.springframework.messaging.converter.MessageConversionException: Cannot convert from [java.lang.String] to [com.example.demo.Foo] for GenericMessage [payload={},…
Joe Stepowski
  • 656
  • 1
  • 6
  • 8
22
votes
3 answers

Amazon Cloudwatch alarm not triggered

I have a cloudwatch alarm configured : Threshold : "GreaterThan 0" for 1 consecutive period, Period : 1 minute, Statistic : Sum The alarm is configured on top of AWS SQS NumberOfMessagesSent. The queue was empty and no messages were being published…
Juhi Kulshreshtha
  • 221
  • 2
  • 3
21
votes
7 answers

Configure SQS Dead letter Queue to raise a cloud watch alarm on receiving a message

I was working with Dead letter Queue in Amazon SQS. I want that whenever a new message is received by the queue it should raise a CloudWatch alarm. The problem is I configured an alarm on the metric: number_of_messages_sent of the queue but this…
Mayank Bajaj
  • 319
  • 1
  • 2
  • 6
21
votes
4 answers

How to implement a priority queue using SQS(Amazon simple queue service)

I have a situation when a msg fails and I would like to replay that msg with the highest priority using python boto package so he will be taken first. If I'm not wrong SQS queue does not support priority queue, so I would like to implement something…
OriK
  • 293
  • 1
  • 3
  • 13
21
votes
7 answers

catching ProcessTimedOutException in Laravel's artisan queue:listen

We have a bunch of SQS jobs that we watch for and process using Laravel's php artisan queue:listen. Periodically, has a few minutes' blip and SQS times out. When this happens, queue:listen aborts with a message…
ceejayoz
  • 176,543
  • 40
  • 303
  • 368
21
votes
6 answers

Ideas for scaling chat in AWS?

I'm trying to come up with the best solution for scaling a chat service in AWS. I've come up with a couple potential solutions: Redis Pub/Sub - When a user establishes a connection to a server that server subscribes to that user's ID. When someone…
Brian DiCasa
  • 9,369
  • 18
  • 65
  • 97
20
votes
1 answer

SQS triggers Lambda with multiple records/messages?

I've observed an abnormal (well, in my POV) feature, where when I setup SQS to trigger a Lambda, when new messages arrive, lambdas get triggered with more than 1 record/message inside its event body. Full setup is S3 (PutObjectEvent) -> SNS topic ->…
DaliusR
  • 203
  • 1
  • 2
  • 4
20
votes
2 answers

Access SQS from EC2 - Instance Profile vs Role

I am trying to access SQS from spring boot app running on EC2 instance. Both the consumer and SQS queue will be on the same AWS account. I was told that I should add an instance profile to EC2 instance to access SQS. What is the difference between…
Punter Vicky
  • 15,954
  • 56
  • 188
  • 315
20
votes
8 answers

SQS - Delivery Delay of 30 minutes

From the documentation of SQS, Max time delay we can configure for a message to hide from its consumers is 15 minutes - http://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-delay-queues.html Suppose if I need to hide the…
Arun Avanathan
  • 982
  • 4
  • 11
  • 26
1 2 3
…
99 100