Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-task]

Spring Cloud Task allows a user to develop and run short lived microservices using Spring Cloud and run them locally, in the cloud, even on Spring Cloud Data Flow. Just add @EnableTask and run your app as a Spring Boot app (single application context).

261 questions
0
votes
1 answer

Pass custom environment variables to cloud task while launching from Spring cloud dataflow server

I'm trying to launch a cloud Task from Spring Cloud DataFlow Server and would need to pass some custom environment variables to the application. How can we pass the values during manual launch and thru task scheduler? I'm able to set java_opts via…
Spartan
  • 339
  • 1
  • 3
  • 14
0
votes
1 answer

which command spring cloud data flow uses to run tasks?

Currently I am not using spring cloud dataflow, though I am creating tasks in my application and running them through command line. Currentlt I am thinking to move to spring cloud data flow via kubernetes. So my concern is first, how can I reuse my…
Barkha Bajaj
  • 33
  • 6
0
votes
1 answer

Whether to implement task or stream based approach

I have a data pipeline process which runs for 12 hours. It's polling for files in a directory and gets triggered every 15 minutes. Based on some business logic it's either going to publish message to a messaging queue or does some database…
emmaJ
  • 21
  • 1
  • 3
0
votes
1 answer

Why can't a Composed Task execute other Composed Tasks in Spring Cloud Data Flow?

After I create 2 Composed Tasks named foo and bar, I want to create another Composed Task named baz to run foo && bar. However, I failed to do so because of this error: dataflow:>task create baz --definition "foo && bar" Command failed…
johnlinp
  • 853
  • 6
  • 22
0
votes
1 answer

SCDF server dual database connection error

In my spring batch task I have two datasources configured, one for oracle and another for h2. H2 I'm using for batch and task execution tables and oracle is for real data for batch processing. I'm able to successfully run the task from ide but when…
emmaJ
  • 21
  • 1
  • 3
0
votes
1 answer

Spring Serverless HTTP Poller

I want to implement a serverless function that polls an HTTP endpoint and publishes the response to a messaging queue. My initial thought is to build a spring boot application using spring integration gateway and adapters for HTTP polling and…
Nikhil
  • 345
  • 2
  • 13
0
votes
0 answers

Spring batch and Spring cloud data flow - postgres - java.lang.IllegalArgumentException: Invalid TaskExecution, ID not found

I am getting java.lang.IllegalArgumentException: Invalid TaskExecution, ID not found, when i am running spring batch task using spring cloud data flow. I read that invalid task execution error is because of not using same data source for spring…
Sujith
  • 1,349
  • 1
  • 7
  • 12
0
votes
2 answers

Spring Cloud Data Flow Task Persist Arguments Between Executions

I'm experimenting with SCDF and successfully running Spring Batch Jobs as Tasks. But I'm having a issue with Task Arguments persisting. It seems that each time I need to execute the Task I should provide it with the command line arguments. In my use…
youness.bout
  • 343
  • 3
  • 9
0
votes
1 answer

A job instance already exists and is complete for parameters={-spring.cloud.task.executionid=2}. If you want to run this job again, change the parame

I am working on Spring Cloud Data Flow and Spring Batch by taking a reference from https://github.com/spring-cloud/spring-cloud-task/tree/master/spring-cloud-task-samples. I'm executing the batch-job and when executed this example two times, on 2nd…
Jeff Cook
  • 7,956
  • 36
  • 115
  • 186
0
votes
2 answers

Spring Cloud Task - Support Multiple Application Contexts

It appears that Spring Cloud Task lifecycle is incorrectly managed when spring boot application has hierarchical application contexts. When i add @EnableTask annotation to the parent ApplicationContext, it registers the task, but records execution…
Pavel F
  • 53
  • 1
  • 6
0
votes
0 answers

unable to execute second application in composed-task-runner

In spring-cloud-data-flow shell, using composed-task-runner I have registered task as: COMMAND: task create my-composed-task --definition "taskcsv && proccess" and launched it by giving the required parameters as: COMMAND: task launch…
Namani Priyanka
  • 9
  • 2
0
votes
0 answers

Spring Boot ApplicationRunner runs during startup - not after

I've created a class that implements the ApplicationRunner interface. As of my understanding the public void run(ApplicationArguments applicationArguments) method should run after the application has completed its startup, but in my case it runs…
ddev
  • 65
  • 1
  • 9
0
votes
0 answers

Spring Batch Remote Partitioning : Worker partitions not running in parallel

I have a Spring Batch remote partitioning application which is generating the partition's ok and the partitions functionally are working. However, at the moment the partition's are running sequentially and not in parallel. I am running the…
Karl Widmer
  • 1
  • 1
0
votes
0 answers

Spring Cloud Task Launcher who handles failured

I'm building a small sample application using a simple task launcher to start new tasks locally (spring-cloud-deployer-local:2.2.2.RELEASE). The code below receives events via a stream and starts new tasks locally as expected.…
Chris
  • 3,437
  • 6
  • 40
  • 73
0
votes
1 answer

Spring Cloud Task - Remote Partitioning Concerns

We have Spring Cloud Data Flow local setup and the task is running the Spring Batch Job which reads from a Database and writes to AWS S3, all of this works fine. When it comes to stopping the JOB, the task stops but resuming the job is not possible…
JinishaVora
  • 3
  • 2
1 2 3
…
17 18