Stack Overflow
Stack Overflow

Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
0
votes
2 answers

Google App Engine - Push Taskqueue - Limit to Countdown?

I am setting up push task queue on my Google App Engine App with a countdown parameter so it will execute at some point in the future. However, my countdown parameter can be very large in seconds, for instance months or even a year in the future.…
JK140
  • 775
  • 2
  • 10
  • 19
0
votes
2 answers

How can I start redis queue worker without command line interface?

I use this tool http://python-rq.org/ I have a flask app, but I could not find the way to start rq worker other than with rq cli, e.g. $ rq worker I need to have the worker running all the time, how can I make it running as a service? I need the…
kkonevets
  • 21
  • 7
0
votes
1 answer

TaskQueue equivalent in AWS

Shifting from App Engine to AWS/Beanstalk, I have a PHP server that will post-process uploaded files asynchronously. In App Engine, all I had to do was something like: (new PushTask('/workerRoute', $taskParams))->add(); And the async worker…
AVIDeveloper
  • 2,954
  • 1
  • 25
  • 32
0
votes
2 answers

Failure handling for Queue Centric work pattern

I am planning to use a queue centric design as described here for one of my applications. That essentially consists of using a Azure queue where work requests are queued from the UI. A worker reads from the queue, processes and deletes the message…
shekhar
  • 1,372
  • 2
  • 16
  • 23
0
votes
1 answer

Error Call to a member function delay() on null when call in $user->notify($natifictionclass)->delay()

Call to a member function delay() on null I am getting above when i am calling notify method with dealy. Notication class i am geting.in job table data is store but i am getting error in call to member function delay on null. can one help me in…
Sagar Jethi
  • 2,313
  • 20
  • 20
0
votes
1 answer

Where to define Celery subtask queues

I have a pluggable app I'm developing for a Django system. In it, I have a task for creating notifications that looks something like so: installable_app.tasks @app.task(name='tasks.generate_notifications') def generate_notifications(...): I have a…
Eric Blum
  • 744
  • 12
  • 29
0
votes
2 answers

app modifying the autolayout engine from a background thread

I am almost done migrating an iOS app of mine to Swift 3.0. But I still have a few cases similar to the one below. Most of them I have been able to solve by putting the problematic code on the main thread. In some other cases, I can't figure out,…
Michel
  • 10,303
  • 17
  • 82
  • 179
0
votes
1 answer

Deferred Queue in Google App Engine

I'm trying to perform some task in the deferred task queue and I need to execute another task on the successful completion of the task in deferred queue. Say, for example, I need to delete all the files stored at a given path and later, after…
Lovish Singh
  • 29
  • 3
0
votes
1 answer

How to get the return value (like Ajax) using task queue on Google App Engine

I can use a task queue to change the database value, but how can I get the return value like Ajax using task queue? This is my code: from google.appengine.api.labs import taskqueue from google.appengine.ext import db from google.appengine.ext import…
zjm1126
  • 34,604
  • 53
  • 121
  • 166
0
votes
1 answer

How to design an app that does heavy tasks and show the result in the frontend (ex Google Search Console)

Let's imagine this: I have to download an XML document from an URL; I have to elaborate this document and persist its information in the database, creating or updating a lot of entites. I think the best way is to use queues. Or maybe I can also…
Aerendir
  • 6,152
  • 9
  • 55
  • 108
0
votes
2 answers

GAE Task Queues with ETA and large number of tasks

In my app, I need to send emails to a large number of users when an event happens. I'd like to send those emails out gradually instead of all at once. For clarity in explaining, let's say I need to send out emails to 10,000 users. I currently do…
new name
  • 15,861
  • 19
  • 68
  • 114
0
votes
0 answers

Closure use of non-escaping parameter in TaskQueue

i have a problem with the next code: func +=! (tasks: inout [TaskQueue.ClosureWithResultNext], task: @escaping TaskQueue.ClosureWithResultNext) { tasks += [{ result, next in DispatchQueue.main.async(execute: { task(result, next) …
Tcacenco Daniel
  • 445
  • 7
  • 17
0
votes
1 answer

Control task run in background node.js

I am writing an application with node.js about using Twitter api. function like below: app.get('/api/get_follower', function(req, res){ var username = req.query.username var client = new twitter({ consumer_key:…
Nam Tran Thanh
  • 821
  • 2
  • 8
  • 14
0
votes
1 answer

GAE: How many task per second is enough?

I'm using GAE and task queue. In queue.yaml file, I keep default setting: 5/s. 1 month ago I thought it's enough but now there are about 40-50 tasks in one queue so my application runs too slow. I want to know how many tasks per second is enough ?…
ducanh.do88
  • 25
  • 6
0
votes
2 answers

Laravel 5.2 - Creating a Job API

So in my API there are a few places where it is running a process / report that is either hitting a timeout or simply just taking WAY too long. I'd like to defer these jobs off to a queue and instead return a key in my response. The front end would…
Bill Garrison
  • 2,226
  • 3
  • 34
  • 75
1 2 3
…
50 51