0

As per the documentation, Spring Cloud Dataflow Service used RDBMS for storing stream/task definitions, application registration and job repositories. Instead of using RDBMS, is there a way to use Redis for storing this information.

krajwade
  • 133
  • 1
  • 12

1 Answers1

0

RDBMS is the default repository implementation for the Data Flow server core. You can still override this default repositories (except task/job execution repositories) by having Redis based implementations from your custom Data Flow server configuration. While you can have 'redis' based repositories for stream/task definitions and application registration, you still need to have RDBMS for the task/batch job execution repositories. That's the reason Spring Cloud Data Flow by default goes with RDBMS based ones for all.

Ilayaperumal Gopinathan
  • 4,099
  • 1
  • 13
  • 12
  • Thank for the prompt reply. Can you please give me a pointer ( example/documentation ) to start using Redis repositories for stream definition and application registration. – krajwade Jan 24 '17 at 12:32
  • We used to have Redis based implementations in 1.0.0.RELEASE: https://github.com/spring-cloud/spring-cloud-dataflow/blob/v1.0.0.RELEASE/spring-cloud-dataflow-server-core/src/test/java/org/springframework/cloud/dataflow/server/repository/RedisStreamDefinitionRepository.java You can use/customise those. – Ilayaperumal Gopinathan Jan 24 '17 at 13:59
  • Thanks for the link. Let me try this out. – krajwade Jan 25 '17 at 04:50
  • I was able to register the application in Redis. However I am not able to create the stream as the "Create" button is disabled in the UI and it's not asking me for the Stream name. – krajwade Jan 29 '17 at 19:38
  • I have another question. How can I inject my custom implementation of StreamDefinitionRepository into StreamDefinitionController so that it can use my implementation. – krajwade Jan 29 '17 at 20:03
  • I have opened a new issue for not been able to create new stream ( https://github.com/spring-cloud/spring-cloud-dataflow-ui/issues/154 ) – krajwade Jan 30 '17 at 09:39
  • ok, thanks! for the custom repository injection, as long as you have the new custom StreamDefinitionRepository bean in your dataflow server that will get used because of the `ConditionalOnMissingBean` condition in the data flow server core – Ilayaperumal Gopinathan Jan 30 '17 at 12:05
  • Thanks. I got the custom repository injection working but thenI could not test it because of the other UI issue that I am facing. – krajwade Jan 30 '17 at 12:36
  • I was able to write custom implementation for using Redis as datasource for spring cloud dataflow. Thanks to @Ilayaperumal Gopinathan for providing useful link. – krajwade Feb 06 '17 at 12:01