Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-dataflow]

Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines. Pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. This makes Spring Cloud Data Flow suitable for a range of data processing use cases, from import/export to event streaming and predictive analytics.

Use this tag for questions about the Spring Cloud Data Flow project. It is not intended for general questions about integrating other Spring projects with other technologies.

Spring Cloud Data Flow's Official Project Site

Spring Cloud Data Flow Website

Spring Cloud Data Flow's Github Repo

How to contribute

How to report issues

Related tags , , , , , .

1276 questions
0
votes
1 answer

SCDF on PCF - bits have not been uploaded

i'm running through a simple and useless toy using PCF on azure, trying to create and run the stream 'time | log' i successfully get SCDF started, and the stream created, but when i try to deploy the stream, SCDF creates two (cf) apps that won't run…
Wings_Of_Fire Equinox_AJ
  • 1
  • 2
0
votes
2 answers

Spring cloud stream transform expression syntax

I am experimenting with Spring Cloud Stream using the local Spring Cloud Dataflow server and the shell. I've gotten simple examples like this dataflow:>stream create --name test --definition "time --trigger.time-unit=SECONDS | log" --deploy working…
user944849
  • 14,524
  • 2
  • 61
  • 83
0
votes
1 answer

Maven Coordinates on Spring Cloud Data flow - Cloud Foundry

I am unable to refer a jar from my jfrog-maven repository on Spring Cloud data flow server installed on PCF. I have given the repository location inside an ENV variable SPRING_APPLICATION_JSON as {"maven": { "remote-repositories": { "repo1": {…
rahul
  • 71
  • 1
  • 1
  • 7
0
votes
0 answers

batch-job example in spring cloud dataflow

batch-job example seems doesn't works when I try deployed it in SpringCloudDataFlow local. To make test I've used spring-cloud-task 1.2.1.RELEASE and cloud-dataflow-server-local-1.2.3.RELEASE. To make test I've follow these steps: Build…
fbalicchia
  • 67
  • 1
  • 3
0
votes
1 answer

SCDF on k8s: Producer exception when sending message to Kafka - ticktock + no messages on ticktock.time topic

The timer application throws a per-second error when trying to send its message to Kafka: 2017-08-03 10:20:58,805 ERROR kafka-producer-network-thread | producer-2 o.s.k.s.LoggingProducerListener:76 - Exception thrown when sending a message with…
user3350314
  • 1
  • 1
0
votes
1 answer

Docker configuration - Spring Cloud DataFlow server

I am new to spring cloud data flow, and I am trying register the app in the spring-cloud-dataflow-local server using dataflow-shell. With following command on dataflowshell. dataflow:>app register --type task --name my-service --uri…
gvk
  • 156
  • 1
  • 8
0
votes
1 answer

Spring Cloud Data Flow | Rabbit MQ exchanges not getting tied up

I'm pretty sure I'm missing something basic here: I have created a flow using this topology: A | B | C This is the application.properties of A: spring.cloud.stream.bindings.requestChannel.destination=events-exchange This is the…
user1189332
  • 1,773
  • 4
  • 26
  • 46
0
votes
1 answer

spring cloud dataflow enable security on cloudfoundry

I am trying to setup security for SCDF on PCF based on documentation is it possible to enabled security for SCDF dashboard when running examples provided on locally installed server even the easiest example java -jar…
Wojtek Jacko
  • 1
  • 1
0
votes
1 answer

Spring Cloud DataFlow - could not convert messages from Kafka

Using Spring Cloud DataFlow version 1.2.2 with following…
Ezer K
  • 3,637
  • 3
  • 18
  • 34
0
votes
2 answers

Unable to deploy/run tasks on Pivotal CF from Spring Cloud Dataflow container error CF-UnprocessableEntity(10008)

Trying to deploy a Java Spring Boot App/Task using Spring Cloud Data Flow. But it fails with foloowing exception CF-UnprocessableEntity(10008): The request is semantically invalid: Task must have a droplet. Specify droplet or assign current droplet…
Sugata Mazumdar
  • 11
  • 5
0
votes
1 answer

Spring Cloud Dataflow - Deploy Stream Without Starting

When deploying an application in PCF, it is possible to deploy the application without starting by running cf push --no-start. In the same way, is it possible to deploy a Spring Cloud Dataflow stream without starting the underlying applications?
user6448130
0
votes
2 answers

Spring Cloud data Flow on CloudFoundry

I have pushed the 1.2.2 version of spring cloud data flow server into PCF (Pivotal Cloud Foundry). I registered an app using maven but creating a task from the App using Flo UI fails with following exception trace, they are a bit unintelligible but…
Sugata Mazumdar
  • 11
  • 5
0
votes
1 answer

Spring Cloud Data Flow does not work how is expected for file sink and curl client

In Mac, working with Spring XD 1.3.2.RELEASE The following works fine: stream create --name orderFilter --definition "http --port=9090 | filter --expression=#jsonPath(payload,'$.countryCode').equals('US') | file --name=manolito.txt…
Manuel Jordan
  • 15,253
  • 21
  • 95
  • 158
0
votes
2 answers

TaskLauncher cloudfoundry Problems with Tasklaunching

I try to use the task-launcher-cloudfoundry-sink-rabbit-1.2.0.RELEASE but when the Task is creating and is in Staging Mode the Task crashed. Any Ideas? the Tasklauncher log : `2017-06-28T13:34:58.95+0200 [APP/PROC/WEB/0] OUT 2017-06-28 11:34:58.954 …
Sheep
  • 23
  • 5
0
votes
2 answers

SCDF: Can I use an outside microservice as a source?

I am trying to work through a solution where the workflow is like this: User hits a microservice to upload images That microservice de-duplicates the image and if it really is new, queues it up for processing The processing chain lives in Spring…
Berin Loritsch
  • 11,400
  • 4
  • 30
  • 57
1 2 3
…
84 85