Stack Overflow
Stack Overflow

Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
0
votes
1 answer

Check if a queue is empty in Google App Engine

I have a script that add tasks to a queue. For example: api.py: from google.appengine.api import taskqueue [...] for u in users: taskqueue.add(queue_name='mailqueue', url="/api/users/send-notification/%s" % (u.id), method='GET') I would…
Avara
  • 1,753
  • 2
  • 17
  • 24
0
votes
1 answer

Is it possible to execute a task inside Google App Engine taskqueue?

I want to do a unittest on a function inside Google App Engine taskqueue. I would like to know if there is any method by which we can execute the tasks in taskqueue so as to test whether it yields the desired output.
Jageet Mohan J
  • 115
  • 2
  • 9
0
votes
1 answer

dispatch.yaml not always routing Deferred Task Queues to correct module

I have a dispatch.yaml file that is supposed to route deferred Task Queue requests on the /_ah/queue/deferred path to a module instance with more memory. However, the requests are not consistently being routed. See this doc page for a primer on…
speedplane
  • 15,673
  • 16
  • 86
  • 138
0
votes
1 answer

AppEngine TaskQueue Logging Levels

I have an application that is using push task queues, I would like to know some info about what parameters are being sent to the tasks in the admin console. I figured an easy solution would be to do a log.info to give me the information, these don't…
nburn42
  • 697
  • 7
  • 25
0
votes
1 answer

Google Task Queue auth from service account vs installed app credentials

Summary: Using installed (native) application credentials, I am able to authorize and use a pull task queue -- using OAuth2 and the REST API v1beta2. This is OK, but I would prefer to authorize and use the task queue under a service account, since…
Eric G
  • 1,282
  • 8
  • 18
0
votes
1 answer

Configure app engine push task queue for twilio SMS verification

This question is a follow up to How to implement an atomic integer in Java App Engine?. Basically I am create a push Task Queue to implement SMS verification. I am using Twilio to send the SMS. Each SMS is a five digit pin number. The following is…
Katedral Pillon
  • 14,534
  • 25
  • 99
  • 199
0
votes
1 answer

GAE push queue tasks are getting blocked

Got an issue with GAE push queue tasks running in Backends. Some of the tasks are running indefinitely and blocking other tasks from running. Attaching Logs screenshot obtained after backend restarted - http://snag.gy/3xeyE.jpg Push Queue task…
Naresh M
  • 113
  • 11
0
votes
1 answer

How to output html when a loop is being executed in php running google app engine

I am trying to output an update string when the loop is running to let the user know that the page is not stuck and it is running. My code is running on google app engine and the loop part is like this. while (($data = fgetcsv($file, 10000, ","))…
Abilash Amarasekaran
  • 817
  • 2
  • 10
  • 26
0
votes
1 answer

GAE Datastore / Task queues – Saving only one item per user at a time

I've developed a python app that registers information from incoming emails and saves this information to the GAE Datastore. Registering the emails works just fine. As part of the registration, emails with the same subject and recipients get a…
Vincent
  • 1,137
  • 18
  • 40
0
votes
1 answer

How to replace a task on Google App Engine Task Queue?

When adding a certain task to the task queue, I would like to make sure there is only one such task. If this task already exists, I would like to delete it and add the new task instead (postponing its execution is ok also). This is my code: queue =…
Tzach
  • 12,889
  • 11
  • 68
  • 115
0
votes
1 answer

How do I integrate google app engine, taks queue and google compute engine?

I been trying to understand how I can setup the follow architecture on Google's cloud: Google app engine receives HTTP request Google app engine queues a pull task as a result of the HTTP request The task is received by a auto scaling google…
Stan Wiechers
  • 1,962
  • 27
  • 45
0
votes
1 answer

Task Queue in GAE JAVA - Battle Engine

I use Google App Engine Java for over a year. Trying write a simple strategy game. Unfortunately current solution does not satisfy me. My experience with GAE is even insufficient. My problem is to simulate a battle at a specific time, which shall…
Grzegorz S
  • 53
  • 9
0
votes
2 answers

How can I check whether I have already enqueued a task before?

I'd like to add a task on the App Engine Task Queue, but only if it hasn't been enqueued before. How can I check whether its already in queue or not? Wasn't obvious from the task queue API, but maybe I missed it. They key to the task (param?) would…
Debnath Sinha
  • 1,087
  • 1
  • 12
  • 25
0
votes
2 answers

InvalidQueueModeException while adding and leasing tasks in appengine

I have a following queue definition ranker-queue pull in a loop of 10 times Queue q = QueueFactory.getQueue("ranker-queue"); TaskOptions taskOptions =…
Neil
  • 5,919
  • 15
  • 58
  • 85
0
votes
0 answers

Google app engine: Performance differences between background thread and a task queue

In my GAE app, there are some tasks which were being performed in taskqueues, asynchronously. These tasks involve fetching data from an API and processing it. As the app matured, the data grew in size so the taskqueue limit of 10 minutes started to…
0xc0de
  • 8,028
  • 5
  • 49
  • 75
1 2 3
…
50 51