Stack Overflow
Stack Overflow

Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
0
votes
1 answer

Process queue as folder with files. Possible problems?

I have an executable that needs to process records in the database when the command arrives to do so. Right now, I am issuing commands via TCP exchange but I don't really like it cause a) queue is not persistent between sessions b) TCP port might…
Zeks
  • 2,265
  • 20
  • 32
0
votes
1 answer

App Engine Pull queue only load a subset of tasks

Can I set a minimum time before a task is fetched from the task queue? I want to process a task after X days e.g. Is there a simple way or should I put this information it the task itself? It sounds inefficient to load all the tasks every 2 hours…
Simon
  • 13,173
  • 14
  • 66
  • 90
0
votes
1 answer

Google App Engine: Queued Tasks vs Cron Jobs

I'm very confused about GAE's concepts of Tasks, Task Queues (both push and pull), Cron Jobs and how each of these relate to Frontend vs. Backend instances. I'm trying to achieve a situation where some HTTP requests can be serviced immediately,…
IAmYourFaja
  • 55,468
  • 181
  • 466
  • 756
0
votes
5 answers

AsyncTask queue and its entire progress

I haven't started coding yet. I'm trying to figure out which libraries that is out there and what the API can offer first. I need to download a lot of resources before starting my app. Basically I'm going to have a "SplashSreen" and a progressbar…
user89862
0
votes
2 answers

Task Queue Premium Call Count

As we scale up our service and add backends that use the pull queue REST API, we find that we are hitting the 100k/day limit. The documentation is not clear on whether or not this is billable. Is it possible to exceed this limit with billing…
tarun2000
  • 89
  • 7
0
votes
2 answers

FFMpeg + Beanstalk: How to pass the processes to it or achieve the same result without using Beanstalk

My problem is that FFMpeg and Mencoder are extremely resourceful and running even one process of it makes HTTPd slow down but multiple processes of (FFMPEG /Mencoder) just hang it (HTTPd) completely. I would like my conversions to be processed with…
Ilia Ross
  • 13,086
  • 11
  • 53
  • 88
0
votes
1 answer

Getting errors leasing tasks

When I try to lease tasks from a pull queue in my application, I get the error below. This didn't happen previously with my code, so something has changed. I suspect that it's a threading issue - these calls are made in a separate thread (created…
mjaggard
  • 2,389
  • 1
  • 23
  • 45
0
votes
2 answers

Where does a Google AppEngine Task Queue response go?

I'm having difficulty understanding some aspects of Google AppEngine Push Task Queue for java, namely, when a task is executed, where does the response go? If I add something to the queue like this: Queue queue =…
aez
  • 2,406
  • 2
  • 26
  • 46
0
votes
1 answer

GAE: is leaseTask in pull queue an asynchronous call?

I would like to use GAE Task Queue (pull queue) as a message queue in an app. The receiveMessage calls in other message queue services (Ex. AmazonSQS) are asynchronous calls, providing web scalability to the apps. The pull queue have the call:…
Dulini Atapattu
  • 2,735
  • 8
  • 33
  • 47
0
votes
2 answers

performing backend operations / tasks after specific intervals of time on Google App Engine (python)

I want my GAE app to do some back-end processing and uploading/updating results to data-store after specific intervals of time (say every 6 hours). So whenever a user uses my app (and basically requests those values from the data-store) they would…
afroze
  • 173
  • 1
  • 4
  • 11
0
votes
1 answer

GAE: getting email for error when using deferred library

I've set up my Python GAE app so that I get an email when a request handler raises an exception. To do this, I just subclass webapp2.RequestHandler and override handle_exception to send me an email with pertinent details. Is it possible to get an…
new name
  • 15,861
  • 19
  • 68
  • 114
0
votes
2 answers

Implementing TaskQueue on Google-App-Engine with Python 2.7

I am trying to learn about GAE Task Queues with Python 2.7. The sample code here doesn't work when I try to copy and past it into a 'helloworld.py' app from the Python 2.7 tutorial here. I think it's because I don't have a 'counter.html' and I…
user1357607
  • 214
  • 4
  • 13
0
votes
1 answer

google app engine task queue don't complete in production but complete in devserver

when running some google app engine tasks on dev server it completes with 200 status, but when deploying and running the same task on production the task don't get executed completely and get retrying until it use all retry count. I think this may…
UXE
  • 2,374
  • 2
  • 18
  • 17
0
votes
1 answer

GAE tasks and execution rate

No matter what I set rate and bucket_size I always see only one or two tasks running in the same time. Does anyone know what might be the reason? My queue configuration is: name: MyQueue rate: 30/s bucket_size: 50
rzajac
  • 1,591
  • 2
  • 18
  • 37
-1
votes
3 answers

Using Queue of string in FreeRTOS

I am using Ardunio/ESP32 and I am very new to FreeRTOS. I want to have a task that is solely responsible for printing text on serial port and other tasks can push messages. So, I decided to use a Queue of char arrays (or std::string) with 10 item…
Reza
  • 43
  • 7
1 2 3
…
50
51