Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-dataflow]

Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines. Pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. This makes Spring Cloud Data Flow suitable for a range of data processing use cases, from import/export to event streaming and predictive analytics.

Use this tag for questions about the Spring Cloud Data Flow project. It is not intended for general questions about integrating other Spring projects with other technologies.

Spring Cloud Data Flow's Official Project Site

Spring Cloud Data Flow Website

Spring Cloud Data Flow's Github Repo

How to contribute

How to report issues

Related tags , , , , , .

1276 questions
2
votes
2 answers

Spring Dataflow concepts clarification

I started using Spring Dataflow, and I find myself with some questions I'm unable to answer, reading the documentation, and doing some testing. Any clarification would be welcomed (if you can't answer all of them at once, answer those you can, I'll…
Alexandre FILLATRE
  • 1,305
  • 11
  • 20
2
votes
1 answer

Is it safe to use Spring Cloud Dataflow Local Server on production?

We are looking into implementing spring cloud data flow in a local system environment to process streams and task jobs for day to day transactions. Without using PCF, Kubernetes, YARN or Mesos, we are thinking of using the local server for…
J.D.
  • 23
  • 2
2
votes
2 answers

Is there a way to configure the Kafka client timeout settings in Spring Cloud Data Flow?

When starting a Spring Cloud Data Flow stream, quite often the apps fail to deploy on my machine because of various Kafka related errors. For instance: org.springframework.cloud.stream.binder.BinderException: Cannot initialize binder [...] …
Remon Sinnema
  • 51
  • 1
  • 10
2
votes
1 answer

How to use Rabbitmq binder in spring cloud dataflow stream

I have a stream which does launches a task based on given time interval. I want to use rabbit binder with it but I am missing syntax of providing the rabbitmq broker properties. Could someone please help me. Here is the steps and configuration I…
Sunil Chauraha
  • 525
  • 1
  • 7
  • 21
2
votes
1 answer

How to execute spring cloud task using rest-api

I know a cloud task can be scheduled and can be configured using stream also to be executed. As a developer I want to execute my spring cloud task using rest-api so that I can execute the task on demand. Basically i have a work flow management…
Sunil Chauraha
  • 525
  • 1
  • 7
  • 21
2
votes
1 answer

Externalizing Spring Cloud Data Flow Config - Spring Cloud Config Server

Still trying to tackle this task. I have the following stuff: Pivotal Cloud Foundry - Elastic Runtime 1.7.5 Spring Cloud Data Flow Server Cloudfoundry - 1.0.0.M4 Spring Cloud Config Server (SCCS) service (service name "scdf-sccs") The SCCS…
Channing Jackson
  • 163
  • 10
2
votes
1 answer

How to create Processor with Transaction and DLQ with Rabbit binding?

I'm just starting to learn Spring Cloud Streams and Dataflow and I want to know one of important use cases for me. I created example processor Multiplier which takes message and resends it 5 times to output. @EnableBinding(Processor.class) public…
Mati
  • 2,476
  • 2
  • 17
  • 24
2
votes
1 answer

Spring Cloud DataFlow documentation has missing sections

I am reading right now the Spring Cloud DataFlow documentation, but it turn out that the sections contained in PART IV (Modules) has some kind of error, because the whole section is fill up with this kind of text Unresolved directive in…
Jose Alejandro Niño Mora
  • 43
  • 3
2
votes
1 answer

ConcurrentModificationException while using Spring Integration DSL Mail

I am trying to use Spring Integration Java DSL for recieving email (gmail). I am also using Redis. When I recieve mail I get ConcurrentModificationException . While searching I also found that people are getting the same error in Kafka as well.…
Amol
  • 479
  • 5
  • 18
2
votes
2 answers

Simple counter example with spring-cloud-dataflow

I'm exploring spring-cloud-dataflow and I could successfully walk through the twitterstream sample and the field-value-counters contained some useful values. But I fail to create other simple examples like: stream create test --definition 'http…
James
  • 11,654
  • 6
  • 52
  • 81
2
votes
0 answers

Any way to provide hadoop as Source in spring-cloud-dataflow

Is there a way to provide hadoop as Source in spring-cloud-dataflow ? I have read the documentation of spring-cloud-dataflow and found that it supports hadoop as Sink only. But I need to run a map-reduce job that will read data from hdfs , do…
Gomathy
  • 31
  • 2
1
vote
0 answers

Spring Cloud Data Flow (version 2.11.0) is failing at launch with DB2 instance (DB2 v11.5)

After building the SCDF with custom Db2 driver, while trying to launch the server (spring-cloud-dataflow-server-2.11.0-SNAPSHOT) is failing with: Caused by: org.springframework.cloud.dataflow.common.flyway.DataFlowSchemaMigrationException: An…
Subhayu
  • 21
  • 2
1
vote
1 answer

Migrating Spring Cloud Connectors to java-cfenv in Cloudfoundry causes TLS failure with Rabbit-MQ service

While upgrading Spring Cloud Services from 2.4.1 to 3.5.5, we are seeing issues with the app not able to connect to Rabbit MQ service in cloud foundry. It throws the following exception:- c.r.client.impl.SocketFrameHandler : TLS connection failed:…
Aravind1986
  • 15
  • 5
1
vote
0 answers

Spring cloud stream not recover channel on timed out error

I know it uses spring-amqp to handle recovery. One case I found where it doesn't recover the channel is that if a spring cloud stream app couldn't process message within 30 mins (default timeout for a message not being acked), the rabbitmq will…
user3908406
  • 1,416
  • 1
  • 18
  • 32
1
vote
1 answer

Spring Cloud Data Flow - relaunch/retry Composed Task from the middle

I have a Composed Task in Spring Cloud Data Flow server as below: If task-b produces the exit message as FAIL then it will execute task-d and end the flow. I would like to retry this job/composed-task from task-b again once the issue was fixed so…
adesai
  • 370
  • 3
  • 22
1 2 3
…
84 85