4

Are there any implementations of the Spring Cloud Data Flow Service Provider Interface for Amazon EC2 Container Service as a runtime platform?

Does it make sense to consider using ECS as a runtime platform for Spring Cloud Data Flow?

If there are no current implementations does anyone know of any plans to implement one? This would seem to fit in the existing 'Spring Cloud for Amazon Web Services' project?

David Geary
  • 1,756
  • 2
  • 14
  • 23

1 Answers1

2

There aren't any plans for Spring Cloud Deployer SPI implementation for ECS. Likewise, there aren't anything officially scheduled for SCDF implementation either.

The SPI abstraction is setup for easier extension and we encourage users to implement for different runtime platforms where they see fit. For example, please check out the community implementations of SCDF for Nomad and Openshift platforms.

Does it make sense to consider using ECS as a runtime platform for Spring Cloud Data Flow?

From the surface, it looks like the primitives to orchestrate Docker containers is in ECS. We distribute Docker variant of stream and task app-starters, too. Apart from this, routing, LB, logging, security, HA, and resilient orchestration of apps (embedded in SCDF streams/tasks) matter for production deployments. You may have to dig into these specifics for decision.

Sabby Anandan
  • 5,636
  • 2
  • 12
  • 21
  • Are you able to figure out the AWS implementation of SCDF? - @david-geary – Chandru Apr 10 '17 at 17:33
  • Is it a good option to Configure Kubernetes on AWS and use , SCDF Spring Cloud Data Flow with Kubernetes on AWS. – tx fun May 29 '17 at 08:34
  • Sure thing! It'd be equally a good option to provision any supported platforms (cf, k8s, yarn, mesos) for SCDF for that matter. You'd use the core AWS IaaS infrastructure (VMs) and provision the platform of your choice and [SCDF](http://cloud.spring.io/spring-cloud-dataflow/#spring-cloud-data-flow-implementations). The provisioning aspect could be automated via scripting tools such as CloudFormation, Chef, or Puppet, etc. – Sabby Anandan May 29 '17 at 15:48
  • For those like myself that don't want to have to setup and manage a container infrastructure for a few SCDF applications - there may be hope in the form of AWS "managed" Kubernetes service - https://aws.amazon.com/eks/. – shawnjohnson May 09 '18 at 18:16