Stack Overflow
Stack Overflow

Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
0
votes
2 answers

How to identify reason of OverQuotaError when sending emails?

I send emails with cron job and task queue usage. The job is executed every 15 minutes and the queue used has the following setup: - name: send-emails rate: 1/m max_concurrent_requests: 1 retry_parameters: task_retry_limit: 0 But quite…
LA_
  • 19,823
  • 58
  • 172
  • 308
0
votes
1 answer

Run automatically a Task Queue with java Google App Engine (GAE)

I would like to let, the Task in the GAE Task Queue, start. I followed step by step the configuration from Task Queue Java on GAE, but when i click (for example) a link on my web-site (that call the Servlet which start the Task), it only put the…
Aerox
  • 669
  • 1
  • 13
  • 28
0
votes
2 answers

How to pass NDB data to task queue?

Here is the entity I would like to pass to the task: class MyData(ndb.Model): ... text = ndb.StringProperty(indexed=False) data = ndb.BlobKeyProperty(repeated=True) details = ndb.KeyProperty(kind=Details) Can I do something like…
LA_
  • 19,823
  • 58
  • 172
  • 308
0
votes
1 answer

What happens differently when you add a task Asynchronously on GAE?

Google's doc on async tasks assumes knowledge of the difference between regular and asynchronously added tasks. add_async(task, transactional=False, rpc=None) Asynchronously add a Task or a list of Tasks to this Queue. How is adding tasks…
Ben
  • 5,085
  • 9
  • 39
  • 58
0
votes
2 answers

Does cron job has time limit of 10 minutes?

The doc says that HTTP requests initiated by cron job can run for 10 minutes (believe, this is about urlfetch). My cron job does another time consuming task - e-mails sending (thru google.appengine.api.mail). Do I also have 10 minutes for this…
LA_
  • 19,823
  • 58
  • 172
  • 308
0
votes
1 answer

GAE w/ Java, Scheduling User Notifications

I'm creating an app on GAE with Java, and looking for advice on how to handle scheduling user notifications (which will be email, text, push, whatever). There are a couple ways notifications will generated: when a producer creates content, and on a…
Eric Simonton
  • 5,702
  • 2
  • 37
  • 54
0
votes
2 answers

Reading a given element from a queue in C code

I've found this simple Queue code and I'm trying to change some stuff. Since it was in spanish, I translated hoping that you can understand. #include #include /* Returns "a - b" in seconds */ double…
Sean Sabe
  • 79
  • 9
0
votes
2 answers

Google App Engine modules no datastore access

I have a project consisting of three modules, where the default and one of the background task modules are operating as expected. My third module have the following weird behaviours: No access to the shared data store or memcache. When a task is…
kengjoran
  • 143
  • 9
0
votes
1 answer

GAE error with task queues. Is something wrong with my setup? (python)

I'm trying task queues for the first time and while I think I have everything set up correctly, I am getting an error. First, here is my queue.yaml file: total_storage_limit: 500M queue: - name: loader rate: 1/s bucket_size: 1 Second, here is…
user3058197
  • 1,052
  • 1
  • 9
  • 21
0
votes
1 answer

AppEngine Task Queue Namespaces and Quota

When using namespaces with Task Queues is the quota applicable across all namespaces or do namespaced queues actually work as separate queues? Example: the 500 task invocations per second per queue are a limit for all namespaces on the same queue or…
miguelv
  • 2,856
  • 1
  • 25
  • 24
0
votes
1 answer

Work Queue With Failed Job Reporting

I have a WCF service (the fact that it's WCF shouldn't matter) and I'm not looking for message queuing, but instead for an asynchronous work queue in which to place tasks, once a request / message is received. Requirements: Must support persistent…
ossek
  • 1,648
  • 17
  • 25
0
votes
0 answers

getting 'Task already enqueued' error when trying to add a new task

So I'm trying to test out the the task queue functionality in app engine. Essentially my setup in app engine for creating a task is: q = taskqueue.Queue(REQUEST_QUEUE) .... userQuery = cgi.escape(self.request.get('query')) timeID = '%f' %…
jKimo
  • 73
  • 1
  • 1
  • 4
0
votes
1 answer

Task Queue solution?

I never used task queue before. I'm having a problem trying to get a report of all of my contacts from the datastore. The code is: allContactos=db.GqlQuery("select * from contactsDB").run(batch_size=1000) for contactN in allContactos: ... (here…
lscena
  • 379
  • 2
  • 13
0
votes
2 answers

Is there an open-source implementation of Google's Task Queue?

As the title says, I'm wondering if there's an open-source, drop-in replacement for Google's Task Queue. The closest I've been able to find so far is celery, but that's not really what I'm looking for.
Floegipoky
  • 3,087
  • 1
  • 31
  • 47
0
votes
1 answer

Google AppEngine TaskQueue throws Caused by: java.lang.IllegalArgumentException: Invalid URL : null

When I try to add to the queue, it gives this exception. It works in development but not production. Caused by: java.lang.IllegalArgumentException: Invalid URL : null at…
Chloe
  • 25,162
  • 40
  • 190
  • 357
1 2 3
…
50 51