Stack Overflow
Stack Overflow

Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
0
votes
1 answer

Disk-backed array in Go

How can I create a disk-based delayed queue in Go? I am writing a Go program to take certain actions on data after certain time intervals. Here is a stripped down version. func IncomingJob (data MyStruct) { //Run immediately …
sajal
  • 776
  • 1
  • 6
  • 23
0
votes
1 answer

Which task queue does App Engine cron use?

The Google App Engine documentation says: The App Engine Cron Service allows you to configure regularly scheduled tasks... But what task queue do cron scheduled tasks run on? How can I change the task queue for a cron job? My motivation for…
aez
  • 2,406
  • 2
  • 26
  • 46
0
votes
1 answer

TaskQueue : double conditional-sequence execution (C++)

I'm writing a server application, task oriented. Each Session (client) send packets to the server, the server enqueues them as Tasks, and workers (threads) handle them. Constraints are : Tasks from a same Session have to be always sequentially…
Malandrain
  • 91
  • 1
  • 6
0
votes
2 answers

how to run following python code in google app engine backend

final is my remote host file which is very large and due to timeout problems in front-end, i want to run it in back-end. large.py link=urllib2.urlopen(final) backends: name: mybackend class: B8 options: public, dynamic …
Niraj Kashyap
  • 232
  • 2
  • 8
0
votes
1 answer

Deploying java client, RabbitMQ, and Celery to server

I have a Java API on my server, and I want it to create tasks and add them to Celery via RabbitMQ. I followed the following tutorial, http://www.rabbitmq.com/tutorials/tutorial-two-python.html, where I used java for the client (send.java) and python…
Rohan Agarwal
  • 2,167
  • 1
  • 24
  • 34
0
votes
1 answer

Creating entities using task queues do not always get created

I have a task that simply creates an entity into the datastore. I now queue up many tasks into a named push queue and let it run. When it completes, I see in the log that all of the task request were run. However, the number of entities created was…
bighonestjohn
  • 328
  • 3
  • 8
0
votes
1 answer

queue task listbox c# that loads first item in que and refreshes

Ok, in c# I have tried a number of ways to get a listbox to take the contents of a textfile that is populated by other programs, to list the contents. And if certain conditions are true executes a program based off the contents of the first item in…
user2510640
  • 40
  • 8
0
votes
1 answer

How to tell a queue_name is available

I could know whether a queue_name is available or not in queue.yaml from UnknownQueueError when passed unknown queue_name. from google.appengine.api import taskqueue taskqueue.add(url="/mytask", queue_name="foo", method="GET") However, I prefer to…
hiroshi
  • 6,871
  • 3
  • 46
  • 59
0
votes
1 answer

NDB post_put_hook and taskqueue

I'm facing a bit of a problem using ndb post_put_hook to add something in a taskqueue. I've created the hook in my model, and whenever a put() is done, the hook gets executed indefinitely. If I do anything else but add something to a taskqueue, it…
brian
  • 802
  • 4
  • 18
0
votes
1 answer

GAE - Execute many small tasks after a fixed time

I'd like to make a Google App Engine app that sends a Facebook message to a user a fixed time (e.g. one day) after they click a button in the app. It's not scalable to use cron or the task queue for potentially millions of tiny jobs. I've also…
1''
  • 26,823
  • 32
  • 143
  • 200
0
votes
1 answer

Taskqueue run only 1 task from the queue

Im using google appengine taskqueue to run one of my api in the background. this api takes about 3 seconds to run, but I add it to the queue several time like that: while len(lst) > 0: logging.info("calling my_api") …
adi ohaion
  • 374
  • 6
  • 21
0
votes
2 answers

Queues for every thread in thread pool

As far I know, thread pools (java.util.concurrent.Executor class) provide a queue of tasks for all threads in a pool. So I don't really know, which thread will execute my task. But I need to have queues of tasks assigned to every thread. How can I…
notnavol
  • 3
  • 1
0
votes
1 answer

HTTP 302 on backend start in appengine

I have an appengine application, using Spring 3.1.2, and working just fine. The Resident/Dynamic instances starts normally using warmup: 2013-05-20 20:32:53.786 /_ah/warmup 200 27205ms 0kb Now I'm trying to configure a task queue to be handled by…
Ricardo Comar
  • 3
  • 2
0
votes
1 answer

How can I implement a job queue with a greedy-worker-pool in Java EE 6 in a correct way?

I'm looking for a correct way, to do the following in Java EE 6, if possible with vanilla Java EE 6 only. I want to put a job in a job queue and have a fixed pool of worker objects, which should pull a job from the queue, if they are idle. The…
user1631581
  • 201
  • 1
  • 2
  • 7
0
votes
2 answers

How can we launch a task from a cron job under a custom domain?

A Cron job runs under a domain, *.appspot.com(server name), because it doesn't belong to any particular (custom) domain. But tasks in TaskQueue run under its parent servlet's domain, like www.example.com or xyz.abc.com. How can the tasks be launched…
Tom Fishman
  • 1,716
  • 6
  • 22
  • 36
1 2 3
…
50 51