Stack Overflow
Stack Overflow

Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
0
votes
1 answer

When using publisher confirms, is it possible to recover the message that was nacked

When using publisher confirms, is it possible to recover the message that was nacked? I've been looking through the event arguments for Channel_BasicNacks and haven't found an object or property that corresponds to it. I.e.: _factory = new…
Hoppe
  • 6,508
  • 17
  • 60
  • 114
0
votes
0 answers

When I am going List task from task queue(pull), I get an error

When I am going List task from task queue(pull) at GAE, I get an error. Please give me solution: I am using AEQ library: https://github.com/tomwalder/php-appengine-pull-queue My code is include_once 'AEQ/Task.php'; include_once…
Zisu
  • 497
  • 2
  • 6
  • 25
0
votes
1 answer

ndb data contention getting worse and worse

I have a bit of a strange problem. I have a module running on gae that puts a whole lot of little tasks on the default task queue. The tasks access the same ndb module. Each task accesses a bunch of data from a few different tables then calls…
Sheena
  • 15,590
  • 14
  • 75
  • 113
0
votes
3 answers

Grunt - Queueing a task to run after a previous task completes

I looked at the official Grunt documentation for creating tasks here http://gruntjs.com/creating-tasks I have two tasks that I want to do, but the second one cannot run until after the first one completes. That's because the second task takes the…
Richard Hamilton
  • 25,478
  • 10
  • 60
  • 87
0
votes
0 answers

Google app engine on existing maven-tomcat projects

I am running Magnolia CMS on a tomcat 7, I would like to leverage Googles App Engine(GAE). From googles documentations i understand that it is enough to include the GAE plugin to my root pom.xml within the build tags, see below: …
zalis
  • 1,191
  • 1
  • 11
  • 20
0
votes
1 answer

Why is appengine memcache not storing my data for the requested period of time?

I have my employees stored in appengine ndb and I'm running a cron job via the taskque to generate a list of dictionaries containing the email address of each employee. The resulting list looks something like…
user2744119
  • 153
  • 11
0
votes
0 answers

Is the GoogleAppEngine dev server implementation of Task Queues different to production?

I have mocked-up a tool I would like to use to automate some of our back-of-house tasks. It implements task queues somewhat, but I have a quick question. The Dev environment seems to operate as a single task-queue with a bucket size of 1 no matter…
JSDBroughton
  • 3,966
  • 4
  • 32
  • 52
0
votes
2 answers

How to decrease to split data put in task queue, Google app engine with Python

Encounter an error "RequestTooLargeError: The request to API call datastore_v3.Put() was too large.". After looking through the code, it happens on the place where it is using task queue. So how can I split a large queue task into several smaller…
Weiming
  • 37
  • 6
0
votes
1 answer

Is it possible to call rest API using PHP, inside GAE for putting data at pull queue?

Is it possible to call rest API using PHP, inside GAE for putting data at pull queue ?? I am trying to call rest api to put data at pull queue but I get an error Array ( [error] => Array ( [errors] => Array …
Zisu
  • 497
  • 2
  • 6
  • 25
0
votes
2 answers

Is there any way to understand when all tasks are finished?

Let's say I add 100 push tasks (as group 1) to my tasks-queue. Then I add another 200 tasks (as group 2) to the same queue. How can I understand if all tasks of group 1 are finished? Looks like QueueStatistics will not help here. tag works only with…
LA_
  • 19,823
  • 58
  • 172
  • 308
0
votes
1 answer

How to get data from task queues?

How to get data from task queues ?? How to pull queues ?? My project is running using google App Engine. I insert or push data at task queue successfully , now I want to pull those data. I need PHP code for this work.
Zisu
  • 497
  • 2
  • 6
  • 25
0
votes
1 answer

how to check no. of tries of task in push taskqueue in GAE?

I want to delete a task from task queue if the no. of tries is more than 5. How can I check the no. of tries in python?
Sunil Garg
  • 14,608
  • 25
  • 132
  • 189
0
votes
1 answer

Long running Django task with text updates

With a Django web app what would be the easiest way of having a long running task run in the background but be able to provide the user with progress updates in text and percentage done/ETA? I've looked at Celery and I couldn't see a way to do…
Jamie
  • 674
  • 1
  • 10
  • 30
0
votes
1 answer

Delay in task queues starting and deadline exceeded error when adding to the taskqueue bucket

I have experienced an strange problem since two weeks ago. I have a system running in GAE Python (server side) with 100 restaurantes and 1000 users working without problem, but suddenly, since two weeks ago, every day at rush hour, the tasks in the…
Rene Marty
  • 531
  • 4
  • 14
0
votes
1 answer

Is it safe to multithread host.RunAndBlock() in azure WebJobs

I need to handle a large amount of separated queues, the queues need to be separated but handled in the same way, I don’t want to setup multiple queue-functions so I thought of this solution but I’m not sure it’s a safe way to do: var connectors =…
Cinaird
  • 785
  • 4
  • 13
  • 33
1 2 3
…
50 51