Stack Overflow
Stack Overflow

Questions tagged [task-queue]

With the Task Queue API, applications can perform work outside of a user request, initiated by a user request.

Tasks queues are an efficient and powerful tool for background processing; they allow your application to define tasks, add them to a queue, and then use the queue to process them in aggregate. You name queues and configure their properties in a configuration file named queue.yaml. A queue can be one of two types—push or pull—based on your needs.

Push queues function only within the App Engine environment. These queues are the best choice for applications whose tasks work only with App Engine tools and services. With push queues, you simply configure a queue and add tasks to it. App Engine handles the rest. Push queues are easier to implement, but are restricted to use within App Engine. For more information about push queues and examples of how to use them, see Using Push Queues.

In summary, push queues allow you to process tasks within App Engine at a steady rate and App Engine scales computing resources according to the number of tasks in your queue.

757 questions
0
votes
0 answers

Status Code 503, Requested service is not available yet

I am using spring mvc(annotations). I have written backends. When tasks start running, retry count goes on increasing, It shows status code '503' and message 'service unavailable'. When I hit backend url into browser, I got the same error after…
RBP
  • 481
  • 1
  • 9
  • 29
0
votes
1 answer

Creating user in active directory using .net by queuing the creation action

I have received a requirement to create a new user account in Active directory. For that I have designed a UI. In that UI we have two options for processing the user creation action as Immediately and Effective Date. Suppose an user select the…
Suryakavitha
  • 1,371
  • 5
  • 33
  • 49
0
votes
1 answer

How to take param values from Task Queue url.?

Queue queue = QueueFactory.getDefaultQueue(); queue.add(("/worker").param("key", "ABC")); how to take key value .? using below code or any other approach. request.getParameter("key");
RBP
  • 481
  • 1
  • 9
  • 29
0
votes
1 answer

How to get backends to actually do anything - GAE Python

I'm trying to get a backend in Google Appengine to run a task from the taskqueue. It runs without errors, but the task is not performed. I've found the documentation extremely confusing. My cron.yaml: - description: backend test url:…
memius
  • 4,045
  • 5
  • 26
  • 25
0
votes
2 answers

Using Task Queues with the new GAE Modules

I have a GAE application which has an app.yaml that describes the request handlers and uses the deferred extension to put tasks onto a push queue which is targeted at a backend also defined in my application. However, I've seen notices in the GAE…
dOxxx
  • 1,540
  • 1
  • 12
  • 28
0
votes
1 answer

Best practice for performing long computation in the background on Google App Engine?

I am struggling with how best to perform a long computation for my web app. Basically I need to download and parse a very large remote dataset (~500mb, ~150mb zipped) every day. I originally thought to just schedule it as a cron job and load a…
user3058197
  • 1,052
  • 1
  • 9
  • 21
0
votes
0 answers

Google App Engine push tasks targeting backends not executing on production server

I have a really strange problem with the push task queue on backends on production server. I have some simple tasks which will write some log messages and a few NDB entities. When they are running on backends, they just "go away" silently. There are…
frogwell
  • 1
  • 2
0
votes
1 answer

async insertion to database in a java webservice

My java web service performs lots of mathematical operations and finally finds a result to return. Before return the result I want to insert some data to DB about mathematical operations. You think like that I want to log something. But I have very…
neverwinter
  • 810
  • 2
  • 15
  • 42
0
votes
1 answer

Many producers and many consumers in Oracle 11g

I need some advise to create simple mechanism for queueing. Note that: "Consumer", "Producer" and "Product" words are from "producer–consumer problem" terminology. I have couple processes - "Producer" (PL/SQL procedures) that can generate some…
WBAR
  • 4,924
  • 7
  • 47
  • 81
0
votes
1 answer

what is a good work queue for cross platform usage?

Scenario: In a web-application some parts are realized in PHP and some other in node.js. Communication between PHP and node.js should be realized via an asynchronous queue/worker system. In the PHP part of the application API requests should be…
Martin Abraham
  • 752
  • 7
  • 24
0
votes
1 answer

Is lease_tasks() in gae pull queues a blocking method?

I have a pull-queue in Google App Engine and a resident backend which processes the tasks in the pull queue. The backend has several worker threads for consuming and processing tasks, as suggested in a post in Google Cloud Platform…
Christos
  • 351
  • 1
  • 10
0
votes
1 answer

Google AppEngine Push Task Queues: Is this the tasks last retry?

I use Google AppEngines Task Queues. How can I figure out, if the task thats called is called for the last time (after n fails/retries)? https://developers.google.com/appengine/docs/python/taskqueue/overview-push
mattes
  • 8,936
  • 5
  • 48
  • 73
0
votes
2 answers

can backend run more than 15min taskqueue?

i tested run while loop trigger from frontend-taskqeue to backend. after 15mins, i get Process terminated because the backend took too long to shutdown. to backend and spawn a thread, _ah/background Process terminated because the backend took…
cometta
  • 35,071
  • 77
  • 215
  • 324
0
votes
1 answer

Python task queues in production

Due to my experience with Python I am currently in need to pick one of task queues solutions available for that language. I am considering Celery (I should mention that I do not use Django and switching to that framework is not an option),…
loleknwn
  • 115
  • 7
0
votes
1 answer

Sharing highly irregular job among CUDA threads

I’m working on some task related to graph traversal (Viterbi algorithm). Each time step I have a compacted set of active states, some job is done in each state, and than results are propagated through outgoing arcs to each arc’s destination state…
user2733257
  • 1
  • 1
1 2 3
…
50 51