Stack Overflow
Stack Overflow

Questions tagged [spring-xd]

Spring XD is a unified, distributed, and extensible system for data ingestion, real time analytics, batch processing, and data export. The project’s goal is to simplify the development of big data applications.

Spring XD is a unified, distributed, and extensible system for data ingestion, real time analytics, batch processing, and data export. The project’s goal is to simplify the development of big data applications.

Big data applications share many characteristics with Enterprise Integration and Batch applications. Spring has provided proven solutions for building integration and batch applications for more than 6 years now via the Spring Integration and Spring Batch projects. Spring XD builds upon this foundation and provides a lightweight runtime environment that is easily configured and assembled via a simple DSL.

Click here for more information about Spring XD.

565 questions
2
votes
1 answer

Passing HeaderInformation as JSONObject in Header in Spring-XD

I am Passing data as JSONObject as String in Header and in next module/processor using below code but data on next module i received as "java.io.DataInputStream@7c6a857" and not able to convert it back to JSONObject as String. messageOut =…
Learner
  • 47
  • 3
2
votes
1 answer

How to enable DEBUG logging in Spring XD?

I need to enable debug mode in spring-xd, how to do that ? I did not find any parameter in servers.yml defining debug mode.
Anas
  • 21
  • 1
2
votes
1 answer

Header Enricher for spring xd to call http-client t pass headers

I am using http header enricher component to pass the headers but I am not able to make a http request using http-client I have a stream like below I am trying to make a http rest Post request and log it to the logger.I have a API-Key header for…
constantlearner
  • 5,157
  • 7
  • 42
  • 64
2
votes
0 answers

Spring XD Job runs on Job Deployment

I have a Spring batch Job with a tasklet Step and it get run when I deploy the Job to Spring XD. I want my job to run only when I launch my Job. Is this the default behavior or something I messed up? …
user1867721
  • 23
  • 3
2
votes
2 answers

Spring XD, Reactor Streams: configuration without XML?

On http://docs.spring.io/spring-xd/docs/1.2.1.RELEASE/reference/html/#reactor-streams it is documented, how a Reactor Stream is implemented in Spring XD. According to this documentation I have built my own…
Johannes Flügel
  • 3,112
  • 3
  • 17
  • 32
2
votes
1 answer

Spring XD 1.2.0+ Custom Module Deployment

Has something changed with the way custom modules should be deployed in Spring XD 1.2.0? I have a development singlenode installed on windows. I have the XD_CONFIG_LOCATION enviroment variable set up to point to my servers.yml configuration file and…
David Geary
  • 1,756
  • 2
  • 14
  • 23
2
votes
1 answer

nameExpression: option named 'nameExpression' is not supported

I am trying to deploy one stream in springXD. stream create --name myfilestream --definition "http --port=9000 | file --nameExpression=payload.trim()" --deploy But the error I am getting is like below: Command failed…
Amaresh
  • 3,231
  • 7
  • 37
  • 60
2
votes
0 answers

Managing custom module releases

I am looking for any best practices and/or recommendations around how best to manage releases for custom modules in a production environment running on the Spring-XD platform. Specifically, if I have a custom module foo-1.0.0 deployed into a farm of…
Mark Fleischman
  • 47
  • 5
2
votes
1 answer

spring-integration-kafka annotation support & example

Although new to spring, I'm usually able to get started with a spring projects fairly well with annotations only. The official examples uses xml without mentioning where they will be placed etc. Is there any sample project on reading from a kafka…
lawal
  • 952
  • 10
  • 19
2
votes
1 answer

Return last value query in MongoDB in Spring XD Source module

I would like to be able to create a query/query-expression that I can use in SprinXD MongoDB Source module to return only the last document that has been inserted. It seems that max-messages-per-poll doesn't do the trick (paginated data with the…
dmendezg
  • 1,888
  • 1
  • 15
  • 23
2
votes
1 answer

Payload Filters/Transforms & Rich Gauges

I have a JMS feed that provides messages with the following JSON structure: { String:currentSessions, Long:duration, Long:rows, Long:fill, Long:execute, String:source, String:category, String:url, String:hostname } What I would like to do is a…
delewis
  • 131
  • 1
  • 8
2
votes
1 answer

Spring XD - Could not find module with name

I have a few custom modules which I use in Spring XD. I can use 'module upload' in singlenode deployment of XD without a problem, but when running in distributed mode I have the following exception:…
gamars
  • 247
  • 2
  • 8
2
votes
1 answer

How to put tweets in avro files and save them in HDFS using Spring XD?

how can I put tweets in avro files and save them in HDFS using Spring XD? The docu only tells me to do the following: xd:>stream create --name mydataset --definition "time | hdfs-dataset --batchSize=20" --deploy This works fine for the source…
Tim
  • 127
  • 2
  • 8
2
votes
1 answer

Spring XD as a Rest Endpoint

Can we integrate Spring XD and Spring MVC, so that we can ingest/process data sent to the REST end point? We have huge amounts of data collected in a Spring MVC app and are wondering if we could use Spring XD for this.
18TillIDie
  • 31
  • 3
2
votes
1 answer

how to share a bean across modules in spring xd

Lets say I want to create a stream with this defintion file | serviceActivator1 | transform | serviceActivator2 So I have two custom modules in this definition. My understanding is that spring xd will create a child context of each component/module…
adeelmahmood
  • 2,371
  • 8
  • 36
  • 59
1 2 3
…
37 38