Questions tagged [jobs]

A job is a process executing in the background, or scheduled for later execution. **DO NOT** use this tag for career, employment, or hiring practice questions, as these are off-topic!

A job in a batch processing system is a task scheduled for execution. For questions related to scheduling jobs, see .

In a Unix/Linux context, a job is a process or group of processes running in a terminal, which can be placed in the foreground or in the background. See . For questions about job control with a shell such as bash from a user's perspective, see the jobs and job-control tags on Unix Stack Exchange.

Note that questions related to jobs as in work, career are off-topic on Stack Overflow. Some questions about this topic are suitable for Workplace Stack Exchange; be sure to read the faq.

2834 questions
4
votes
1 answer

Create job from cronjob in kubernetes .yaml file

I need to execute a job create from cronjob in kubernetes. Manualy I can run it like this: kubectl create job manual-job --from=cronjob/some-cronjob Though I'm not sure how to translate this to yaml. Probably I need to put a from: section in the…
npocmaka
  • 55,367
  • 18
  • 148
  • 187
4
votes
2 answers

How to trigger only specific stage of pipeline with gitlab API?

I have gitlab project with ci file: stages: - build - run build: stage: build script: - (some stuff) tags: - my_runner_tag except: - triggers when: manual run: stage: run script: - (some stuff) tags: -…
coolsv
  • 268
  • 3
  • 17
4
votes
1 answer

Optimal number of threads for GNU parallel

I think I have a fairly basic question. I just discovered the GNU parallel package and I think my workflow can really benefit from it! I am using a loop which loops through my read files and generates the desired output. The command that is…
4
votes
0 answers

Job is not creating pod

I'm using minikube and I'm trying to make a Job, everything seems fine but it's not creating pod. Here's my yaml file: apiVersion: batch/v1 kind: Job metadata: name: calculator spec: template: spec: containers: - name:…
4
votes
1 answer

How to define templates for Spring Batch jobs?

I'm using Spring Batch 2.1.5. I have many jobs that are very similar between each other and I'm looking for a way to have an smaller XML acting as a job template. The things that are shared among jobs are readers, processors, writers and one…
foundationer
  • 85
  • 2
  • 9
4
votes
0 answers

NodeJS: Bull jobs sometimes start, sometimes don't

I've implemented a Redis and a microservice to run in 1h intervals, using cron. Sometimes the jobs start, sometimes don't, and I'm not really sure why this is happening. I have a server.js file that starts my backend rest api, a queue.js file that…
Otavio Bonder
  • 1,789
  • 4
  • 17
  • 35
4
votes
2 answers

Is there a way to limit the number of running pods that are instances of a CronJob in Kubernetes?

I have configured a CronJon in K8S that creates a pod every 10 minutes. The running container can complete in anything from 5 minutes to 2 hours, no way to tell. Sometimes, when the computation is taking very long, i end up with far too many pods…
Ylli Prifti
  • 323
  • 3
  • 11
4
votes
2 answers

SQL Job Occurring every Less than 10 seconds

Is it possible to make Job Schedule, which will occur every less than 10 seconds? Because Sql server doesn't allow that. Schedule type is "Recurring" and Occurs "Daily".
scatterbraiin
  • 323
  • 1
  • 7
  • 14
4
votes
1 answer

How SQL Server maintenance plans work in relation with Jobs and DTExec?

How SQL Server maintenance plans work in relation with Jobs and DTExec? I am specially interested in the maintenance plan's local connection which seems to be passed somehow to dtexec. I have read some docs but none of them is clear enough. As I…
IgnacioJ
  • 105
  • 11
4
votes
3 answers

aws Glue job: how to merge multiple output .csv files in s3

I created an aws Glue Crawler and job. The purpose is to transfer data from a postgres RDS database table to one single .csv file in S3. Everything is working, but I get a total of 19 files in S3. Every file is empty except three with one row of the…
user10656471
4
votes
1 answer

Is there a better way to wait for Kubernetes job completion?

I currently use the following script to wait for the job completion ACTIVE=$(kubectl get jobs my-job -o jsonpath='{.status.active}') until [ -z $ACTIVE ]; do ACTIVE=$(kubectl get jobs my-job -o jsonpath='{.status.active}') ; sleep 30 ; done The…
Devendra Bhatte
  • 358
  • 4
  • 18
4
votes
1 answer

Spring boot and Quartz - Job not executing immediately

I am configuring Quartz job with Spring boot. The requirement is to execute the job immediately without attaching any schedule. Here is what my code looks like JobDetailFactoryBean factoryBean = new JobDetailFactoryBean(); String jobName =…
CuriousMind
  • 3,143
  • 3
  • 29
  • 54
4
votes
2 answers

How to join a Kotlin SupervisorJob

I am trying to process a tree of data objects. Each tree leaf is supposed to be processed through a function using a coroutine. The whole process should be done using a fixed size threadpool. So I came up with this: val node = an instance of…
J Horseman
  • 318
  • 2
  • 12
4
votes
2 answers

Laravel Homestead queue:listen and queue:work only process 1 job at a time

Hi there seems to be a problem with my queue on laravel homestead. Work and Listen processes 1 queue at a time is there any way to make run it once and processes all the queue in the jobs table? Here is my code: DB::beginTransaction(); try { …
4
votes
2 answers

Obtaining exception message from failed rq job

I'm running a job using rq with q.enqueue_call(...) and in this job I'm raising an exception with raise Exception('URL not found') I was wondering how one would get the exception message from this job ('URL not found') after the job has failed. I…
Madeleine Smith
  • 411
  • 1
  • 6
  • 12