Questions tagged [spring-cloud-task]

Spring Cloud Task allows a user to develop and run short lived microservices using Spring Cloud and run them locally, in the cloud, even on Spring Cloud Data Flow. Just add @EnableTask and run your app as a Spring Boot app (single application context).

261 questions
0
votes
0 answers

SCDF keeping task schedules while undeploying and redeploying tasks

Back in SCDF 2.1.x releases, when Undeploying task and redeploying with new version of the application, the schedules actually never gets removed. Now that we are on a newer version(2.9.x), what is the best way to keep the schedule while doing "task…
Kevin Hwang
  • 179
  • 9
0
votes
1 answer

Spring Cloud Task-Batch - taskBatchDao.saveRelationship doesn't write data

I have a small spring-bach application and deploy it locally in scdf. It works fine so far, taskexecutions run and the metadata tables are filled. Except for one - TASK_TASK_BATCH! I see the log output of the TaskBatchExecutionListener with "The job…
0
votes
1 answer

Is the latest Spring cloud task incompatible with spring-boot 2.6.6?

I am trying to use the spring-cloud-task-core version 2.4.1 with the spring-boot version 2.6.6 (from the 2021.0.x release train). This is showing me the below error: Your project setup is incompatible with our requirements due to following…
Jatin Kheradiya
  • 50
  • 1
  • 10
0
votes
0 answers

Launch spring cloud task with JVM args via DeployerPartitionHandler

I am planning to execute spring batch job on Pivotal cloud Foundry. The job executes fine on a single JVM with multiple threads(Local partitioning). I am looking to scale the job and the first option i considered is running the worker processes as a…
GVR
  • 320
  • 1
  • 3
  • 15
0
votes
0 answers

Spring Batch - Job executions launching with same Task execution id

I'm using Spring Batch with Spring Cloud Task for remote partitioning. But for each new Job execution it is created with the same task execution id. Is there any way to create a new task execution id for new job execution? In the following Task…
dave
  • 19
  • 5
0
votes
1 answer

Does Spring Cloud Task supports file listeners?

I have implemented Batch processing with Spring Batch Integration. I’ve achieved the best solutions for file listeners which is way better than scheduler (cron). Now we are migrating to Spring Cloud Task with Dataflow. My question is how can I…
0
votes
0 answers

Spring Cloud Data Flow - Partition Batch Job using Spring Cloud Kubernetes Deployer : Environment properties not getting passed to worker pods

I modified the dataflow sample app partitioned-batch-job to deploy it in a kubernetes cluster via the SCDF server that is running in the cluster. I used the dashboard UI to launch this app as a task. Modified the code for the partitionHandler()…
0
votes
1 answer

Spring Cloud Data Flow: Docker URI error when running the sample app 'partitioned-batch-job' in Kubernetes cluster

I modified the dataflow sample app partitioned-batch-job to deploy it in a kubernetes cluster via the SCDF server that is running in the cluster. I use the dashboard to launch this app as a task. The app launches fine, but I see the following URI…
0
votes
0 answers

spring batch and spring cloud starter task : expected single matching bean but found 2: transactionManager, springCloudTransactionManager

I'm using spring cloud starter task and deployerPartitionHandler for spring batch remote partitioning job. Now, When I'm trying to stop a running job using jobOperator.stop() method spring batch is…
0
votes
1 answer

deploymentServiceAccountName does not work for schedules in spring cloud dataflow

I am using spring cloud dataflow for spring batches(with remote partitioning) wrapped with spring cloud task, deployed in kubernetes. I have also created a service account for the same. The batch runs fine when I use the launch option on tasks tab…
0
votes
1 answer

Spring batch worker pod logs are not visible in spring cloud dataflow

I am trying to run a spring batch with remote partitioning on K8s cluster. Every thing works fine regarding the partitioning, execution etc. The same is integrated with Spring Cloud Dataflow and can see the task logs in the SCDF UI. But I am looking…
0
votes
1 answer

Spring Cloud Dataflow - Parallel Tasks

I have about 16 tasks configured in parallel like . My intention is to only have 3 tasks running at one time. I don't mind which tasks run first as long as the order of the sequential tasks are…
0
votes
1 answer

Spring Cloud Data Flow: Error org.springframework.dao.InvalidDataAccessResourceUsageException

I am trying to run/configure a Spring Data Cloud Data Flow (SCDF) to schedule a task for a Spring Batch Job. I am running in a minikube that connects to a local postgresql(localhost:5432). The minikube runs in a virtualbox where I assigned a vnet…
0
votes
1 answer

Spring cloud data flow task Invalid TaskExecution ID

I am just trying to create a hello world SCDF task. It is my understanding that out of the box the task should be able to read the needed data from the h2 database by just including h2 in the pom, but I am wondering if that is the correct…
Jeff I
  • 396
  • 1
  • 2
  • 13
0
votes
1 answer

Does Spring cloud task handle auto closing of the Kubernetes pods when the worker node has completed

I am writing the Spring batch app on AWS cloud and in order to ensure efficient utilization of resource , I had this question that "Does Spring cloud task handle auto closing of the Kubernetes pods when the worker node has completed". If any one can…