Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
-1
votes
1 answer

Pausing task queues

I need to build a rest API for scheduling tasks I was using celery with flask-restful up until not but celery does not support pausing tasks in the middle from the clients. Is this possible with Celery in a way that I can't figure out or do any…
-1
votes
2 answers

Google App Engine - Push task processing rate

I want to use a typical push queue to process slow operations in background. For some HTTP requests, the app creates a new task according to the parameters sent. My app serves the http request from home automation systems installed at our customers.…
-1
votes
1 answer

Implement QUEUE using PHP

I am implementing Bulk SMS in my application with the help of HTTP API's. Since HTTP urls have limit in number of characters to be sent at a time, i cannot request API along with all the numbers at once. So following is the logic i am using…
MANU
  • 3
  • 2
-1
votes
1 answer

why does the default task queue of google app engine gets executed endlessly?

I am importing contacts from a CSV file, and using the blobstore service of the google app engine to save the blob and i send the blobkey as a parameter to the task queue url. So that the task queue url can use the blob key to parse the CSV file and…
Karthik Amar
  • 217
  • 5
  • 17
-2
votes
0 answers

A good alternative at Python Celery in Java Spring for a task queue with monitoring

I used celery as a task queue, but now I should move to Java Spring and I can't find a good solution. I need a task queue to put send email tasks there (triggered by an endpoint) and these tasks should be asynchronously consumed. I'm looking for an…
M V
  • 1
  • 1
-2
votes
1 answer

How to Send Mass Email asynchronously from Background without affecting Node.JS Application?

I am currently using nodemailer to send Email from my node.js application. What i am looking for is "something" that queues and schedules the sending of large number of Emails(500+ per user) by multiple users. This should run as a separate process…
Dheemanth Bhat
  • 4,269
  • 2
  • 21
  • 40
-2
votes
1 answer

Difference between TaskQueue and MapReduce in Google App Engine

I have read the docs about taskqueue and push queues in gae which is used to create long running tasks. I have doubt in why there was the need for MapReduce? As both do the processing in background, what are the main principal differences between…
Abhishek Kumar
  • 197
  • 2
  • 15
1 2 3
50
51