Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-dataflow]

Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines. Pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. This makes Spring Cloud Data Flow suitable for a range of data processing use cases, from import/export to event streaming and predictive analytics.

Use this tag for questions about the Spring Cloud Data Flow project. It is not intended for general questions about integrating other Spring projects with other technologies.

Spring Cloud Data Flow's Official Project Site

Spring Cloud Data Flow Website

Spring Cloud Data Flow's Github Repo

How to contribute

How to report issues

Related tags , , , , , .

1276 questions
0
votes
1 answer

spring-cloud-deployer - specifying maven remote repository URLs

Spring Cloud Data Flow - Cloudfoundry Server (v1.0.0.M4) In working on trying to externalize configuration info in a properties file, and then use Spring Cloud Config Server to provide these environment settings at installation time, I've got a…
Channing Jackson
  • 163
  • 10
0
votes
1 answer

How to monitor streaming apps Inside SCDF?

I am novice to Spring Cloud Data flow and Stream Cloud Streaming Applications. Currently my project diagram looks like following : I route a POST request from outside client using zuul API gateway to a microservice called Composite. Composite…
Sachin Giri
  • 189
  • 11
0
votes
2 answers

Unable to launch task from a spring cloud data flow stream

I registered my task app in Spring Cloud Data Flow, created a definition for it and the status shows 'unknown'. I created the stream and trying to launch the task through task-sink and I get an error: java.lang.IllegalStateException: failed to…
Gaffar
  • 1
  • 4
0
votes
2 answers

Spring Cloud Stream App that is both sink and source

Can I create Spring Boot Application which is Spring Cloud Stream App having both the bindings Sink and Source?
Sachin Giri
  • 189
  • 11
0
votes
1 answer

Spring Cloud DataFlow and Kafka Security

Is it possible to configure authentication for Spring Cloud DataFlow for Apache Kafka? Where can I see examples? Thanks.
Dzmitry
  • 33
  • 3
0
votes
1 answer

Spring Cloud Data Flow in a Kerberos Enabled Hadoop Cluster

Will spring-cloud-data-flow-yarn and the hdfs sink work in a kerberos enabled Hadoop cluster?
Vinay Joshi
  • 51
  • 1
0
votes
1 answer

Exception while consuming data from kafka source in Spring Cloud Data Flow

I am getting kafka exception when tried kafka topic as source Here is how i created stream stream create --definition ":myDestination > log" --name ingest_from_broker stream deploy ingest_from_broker --properties…
Viren Balaut
  • 55
  • 2
  • 6
0
votes
0 answers

Exception while using LoggingAspect with Spring Cloud Data Flow Custom Sink

I am trying to write custom sink in Spring Cloud Data Flow. It was all working fine. Then I introduced Logging Aspect for Logging and I started getting this issue org.springframework.beans.factory.BeanCreationException: Error creating bean with name…
Viren Balaut
  • 55
  • 2
  • 6
0
votes
1 answer

How to run my Spring cloud stream using SCDF

what is easiest way to run my spring cloud stream application using spring cloud data flow ? My idea is to create custom source using kafka binder and sink as prebuilt starter ,file. I am creating applciation which is pretty basic , similar to this.…
Dheeraj
  • 173
  • 3
  • 12
0
votes
1 answer

Spring cloud data flow distributed processing

How does Spring Cloud Data Flow take care of distributed processing? If the server is deployed on PCF and say there are 2 instances, how will the input data be distributed between these 2 instances? Also, how are failures handled when deployed on…
Abhishek
  • 88
  • 1
  • 6
0
votes
1 answer

Spring cloud data flow - File as input with Cloud Foundry Deployment

I have few applications in Spring XD and now I want to use Spring cloud dataflow deployed on Cloud Foundry. My input source is file. In Spring XD, I used to place the files in the local file system and XD streams used to read from that location.…
Abhishek
  • 88
  • 1
  • 6
0
votes
1 answer

Unable to write streamed data to sink file using Spring cloud dataflow

I am trying to create data flow pipeline using spring cloud data flow using shell(Not UI). Source being twitterstream and sink as File. Here is what i did to configure file-sink : dataflow:>stream create demo --definition "twitterstream…
Dheeraj
  • 173
  • 3
  • 12
0
votes
1 answer

Register Jar from the lib-Folder as an Application in Spring Data Flow

I'm trying to create a self-contained application with Spring Data Flow (Mesos). To do that i want to register sinks/processors/sources that are maven-dependencies of my project. I know that spring-data-flow accepts classpath:// as a scheme for…
Laures
  • 5,389
  • 11
  • 50
  • 76
0
votes
1 answer

Spring Cloud Dataflow on Bluemix - Ticktock example error

I was experimenting with Spring Cloud Data Flow (version 1.0.0.M2) on Cloud Foundry. Specifically I'm using, Bluemix for my task. I used those references to sucessfully build a Cloud Foundry…
Luca
  • 45
  • 6
0
votes
1 answer

Spring Data Flow support for Aurora and Mesos

Is there any plans to support Aurora and Mesos similar to Marathon and Mesos ? Thanks
Shane Gilmartin
  • 1
  • 1
1 2 3
…
84 85