Questions tagged [spring-xd]

Spring XD is a unified, distributed, and extensible system for data ingestion, real time analytics, batch processing, and data export. The project’s goal is to simplify the development of big data applications.

Spring XD is a unified, distributed, and extensible system for data ingestion, real time analytics, batch processing, and data export. The project’s goal is to simplify the development of big data applications.

Big data applications share many characteristics with Enterprise Integration and Batch applications. Spring has provided proven solutions for building integration and batch applications for more than 6 years now via the Spring Integration and Spring Batch projects. Spring XD builds upon this foundation and provides a lightweight runtime environment that is easily configured and assembled via a simple DSL.

Click here for more information about Spring XD.

565 questions
0
votes
1 answer

Spring XD Failover

Does Spring XD support automatic failover when running in distributed mode? Right now, if I create a simple stream on a setup with two containers, the source gets deployed to one container and the sink get deployed to the other container. If I…
franktylerva
  • 91
  • 1
  • 4
-1
votes
1 answer

Spring XD and Quality of Protection = privacy

Does Spring XD support quality of protection = Privacy ? I have the exception below with Cloudera 5.5.2 and property set to 'hadoop.rpc.protection=privacy' . 2016-03-25T16:22:38+0100 WARN Spring Shell o.a.h.i.Client:673 - Couldn't setup connection…
kb78
  • 19
  • 7
-1
votes
2 answers

Move files to HDFS using Spring XD

How to move the files from local disk to HDFS using Spring XD. I do not want contents , but to move whole file for archival which saves the file with original name and content. Here is what i have tried stream create --name fileapple --definition…
user2230605
  • 2,390
  • 6
  • 27
  • 45
-1
votes
1 answer

Update SpringXD module count after deployment

I did not find a way to update a module count once a stream is deployed. I wonder if it is currently a supported feature? I find it hard to believe that the only way to do it is by un-deploying and re-deploying the stream as it actually mean…
tzachi
  • 26
  • 1
-1
votes
1 answer

spring xd admin instantiation on YARN

We installed spring xd on YARN. I see my applications running on YARN and containers getting deployed on YARN however XD-ADMIN is not getting started by YARN Resource Manager. Just wanted to understand is it an expected behaviour that XD Admin…
-1
votes
1 answer

Spring XD on YARN

I am getting the below error, while I am trying to install Spring XD on YARN. Error executing a spring application; nested exception is org.springframework.yarn.YarnSystemException: Call From c01dfobi43.vcac.dc1.dsghost.net/100.98.226.45 to…
-2
votes
1 answer

configuring springXD Horthonworks

I try to Configuring Spring XD to use Hadoop (horthonworks) but when I excute this line In a terminal "./xd-singlenode --hadoopDistro hadoop11" ,I get error 'hadoop11' is not a valid value for option --hadoopDistro Possible values are [cdh5, hdp22,…
nejm
  • 1
  • 3
-2
votes
1 answer

Spring XD demo - connected car - Open source?

Came across this Spring XD demo on connected car - thought it's interesting (https://www.youtube.com/watch?v=qkm2GV57hzY). Wonder if the source code is OSS, available on github or somewhere.
-3
votes
1 answer

Future of Spring-XD

I heared rumors that Spring XD lost development drive and focus at Spring shifts towards cloud services. Since I'm considering XD (the otehr one I consider is Apache Beam, though not yet mature enough imho), I'd like to get some facts / release plan…
benjist
  • 2,740
  • 3
  • 31
  • 58
-6
votes
1 answer

JDBCHDFS job failed with Filesystem closed exception

We tried following jdbchdfs job in current environment Our environment is: spring-xd version :1.2.1 hadoop distribution : PHD3.0 job create rcd_prod --definition "jdbchdfs --driverClassName=com.microsoft.sqlserver.jdbc.SQLServerDriver…
NEO
  • 389
  • 8
  • 31
1 2 3
37
38