Stack Overflow
Stack Overflow

Questions tagged [amazon-sqs]

Amazon Simple Queue Service (Amazon SQS) offers a reliable, highly scalable, hosted queue for storing messages as they travel between computers.

Resources

Tutorial

4134 questions
15
votes
6 answers

SpringBoot @SqsListener - not working - with Exception - TaskRejectedException

I have a AWS SQS with 5000 messages already on the Queue (Sample Message looks like this 'Hello @ 1') I created a SpringBoot Application and inside one of the Component Classes create a method to read messages from the SQS. package…
Hbargujar
  • 360
  • 2
  • 4
  • 14
15
votes
2 answers

Naming conventions for SNS / SQS

In an ETL process we are implementing we will create an Amazon SNS topic which will send messages to an Amazon SQS queue. In the documentation we didn't see a particular spec regarding names so I was wondering if someone could recommend best…
Aurélien
  • 151
  • 1
  • 1
  • 4
15
votes
4 answers

AWS SQS Asynchronous Queuing Pattern (Request/Response)

I'm looking for help with an architectural design decision I'm making with a product. We've got multiple producers (initiated by API Gateway calls into Lambda) that put messages on a SQS queue (the request queue). There can be multiple…
Zaheer Ally
  • 153
  • 1
  • 4
15
votes
1 answer

Amazon SQS how to control the number of retries

I am configuring a beanstalk worker environment to deal with periodic tasks When the requested URL is not responding with status 200 Elastic Beanstalk will put the task again in the queue. How can I configure the number or retries? I know the…
fguillen
  • 36,125
  • 23
  • 149
  • 210
15
votes
2 answers

Can't access Amazon SQS - InvalidClientTokenId

I have an SQS queue set up in AWS. I can send and receive messages perfectly using the AWS CLI and my IAM credentials that I set up. What I would like to do is consume messages from the queue using Camel, configured via Spring. I tried out this…
tytk
  • 2,082
  • 3
  • 27
  • 39
15
votes
3 answers

AWS.SimpleQueueService.NonExistentQueue Exception thrown when Accessing Existing SQS queue

I am relatively new to AWS SQS services. I have written some code to wrap the Amazon SQS api. I am able perform basic functionality with created queues, but despite that (in fact I have been using this code for ever with no problem, and I am…
miss.serena
  • 1,170
  • 1
  • 11
  • 28
15
votes
4 answers

Is there a FIFO message queuing service offering the high availability of Amazon SQS?

Would have loved to use Amazon SQS if it provided some semblance of FIFO access, but the sequence seems to completely random. Is there something that would provide me FIFO queuing as-a-cloud-service with the high availability of SQS? If that is…
user393144
  • 1,575
  • 3
  • 14
  • 21
14
votes
1 answer

SQSListener with ThreadpoolExecutor

In the below example , I am setting the max and core pool size to 1. However no messages are being processed. When I enable debug log , I am able to see the messages being pulled from SQS , but I guess it is not being processed / deleted. However…
Punter Vicky
  • 15,954
  • 56
  • 188
  • 315
14
votes
4 answers

How can I make the nodejs server listen to AWS SQS?

before I explain the problem in details, I tell you my current approach. I have a js script that run setInterval(). and each interval, I will call SQS to get the message from queue. If there is a message, then I process it. so, it will run…
murvinlai
  • 48,919
  • 52
  • 129
  • 177
14
votes
4 answers

Celery + SQS - pycurl error

Today I have been trying to setup Celery using AWS SQS as the broker, however upon excututing the following: test.py from celery import Celery access_key_id = '********************' secret_access_key =…
AndrewR
  • 143
  • 2
  • 7
14
votes
2 answers

Amazon SQS long polling returning 0 messages when messages are in the Queue

Amazon SQS long polling is returning 0 messages when there are still messages in my queue. I've been able to reproduce this effect multiple times. I'm aware that it's possible for SQS long polling to yield fewer messages than the max requested even…
Peter Berg
  • 6,006
  • 8
  • 37
  • 51
14
votes
5 answers

How does Amazon's SQS notify one of my "worker" servers whenever there is something in the queue?

I'm following this tutorial: http://boto.s3.amazonaws.com/sqs_tut.html When there's something in the queue, how do I assign one of my 20 workers to process it? I'm using Python.
TIMEX
  • 259,804
  • 351
  • 777
  • 1,080
14
votes
1 answer

Allow AWS SQS queue access across regions

I have an AWS SQS queue with a permissions policy that looks like this: { "Version": "2012-10-17", "Id": "arn:aws:sqs:us-east-1:123123123:default_staging/SQSDefaultPolicy", "Statement": [ { "Sid": "Sid123123123123", "Effect":…
Jason Swett
  • 43,526
  • 67
  • 220
  • 351
14
votes
3 answers

AWS: multiple instances reading SQS

Simple question: I want to run an autoscale group on Amazon, which fires up multiple instance which processes the messages from a SQS queue. But how do I know that the instances aren't processing the same messages? I can delete a message from the…
Erik van de Ven
  • 4,747
  • 6
  • 38
  • 80
14
votes
2 answers

Amazon SNS -> SQS message body

I'm sending a message from an SNS topic to an SQS. When I'm checking the body of the SQS message on my client, the whole of the message metadata is being sent in the SQS body. I.E. if I'm sending a message "Hello World" from the topic, my client is…
Ben Flowers
  • 1,434
  • 7
  • 21
  • 49
1 2 3
…
99 100