Stack Overflow
Stack Overflow

Questions tagged [orchestration]

Orchestration refers to a very high level of control, coordination and management of computer systems and services in order to automate processes.

From Wikipedia : Orchestration describes the automated arrangement, coordination, and management of complex computer systems, middleware, and services.

Orchestration is often used in the context of Business Process automation, at an enterprise level of control. Business Process Execution Language (BPEL) and Microsoft's XLang are examples of languages which can be used to implement the orchestration of such processes.

387 questions
411
votes
12 answers

How do I define the name of image built with docker-compose

I'm using docker-compose to create my development environment. I want to build a specific image, but I don't know how to set a name for that image. wildfly: build: /path/to/dir/Dockerfile container_name: wildfly_server ports: - 9990:9990 …
Robert
  • 10,403
  • 14
  • 67
  • 117
246
votes
8 answers

Orchestrating microservices

What is the standard pattern of orchestrating microservices? If a microservice only knows about its own domain, but there is a flow of data that requires that multiple services interact in some manner, what's the way to go about it? Let's say we…
Roger Johansson
  • 22,764
  • 18
  • 97
  • 193
46
votes
2 answers

What is the role of Zookeeper vs Eureka for microservices?

I am going to implement the orchestration of a set of microservices in my application. Two widely using tools I found Apache Zookeeper and Netflix Eureka. Can anyone please give a comparison based on fundamental differences, those two services…
Supun Wijerathne
  • 11,964
  • 10
  • 61
  • 87
22
votes
4 answers

Passing parameters to Airflow's jobs through UI

Is it possible to pass parameters to Airflow's jobs through UI? AFAIK, 'params' argument in DAG is defined in python code, therefore it can't be changed at runtime.
Alexander Ershov
  • 1,105
  • 2
  • 12
  • 26
16
votes
3 answers

Orchestration engines and frameworks?

I'm looking for an orchestration framework/engine/toolkit with which to replace/upgrade an existing software, mainly because of scalability limitations. By orchestration I mean asynchronous and distributed execution of generic tasks and…
Eugene Marin
  • 1,706
  • 3
  • 23
  • 35
16
votes
7 answers

Is orchestration an ESB responsibility?

Is an Enterprise Service Bus (a tool that acts as a mediator, a message broker, a service enabler, schema transformation enhancer, transparent location provider, service aggregator, load balancer, monitor, and all that stuff) responsible to…
paulosuzart
  • 1,082
  • 2
  • 13
  • 28
12
votes
2 answers

Dynamic task definition in Airflow

I’m currently trying to use Airflow to orchestrate a process where some operators are defined dynamically and depend on the output of another (earlier) operator. In the code below t1 updates a text file with new records (these are actually read…
Dawid
  • 652
  • 1
  • 11
  • 24
11
votes
2 answers

About the Mediator in Event-Driven Topology

I was reading this article called Variations in event-driven architecture in which they demonstrate both the mediator and broker topologies. According to the article the mediator topology looks somewhat like this: The event flow starts with the…
Edwin Dalorzo
  • 76,803
  • 25
  • 144
  • 205
11
votes
3 answers

Is there an easy way to generate a graph of Ansible role dependencies?

Since version 1.3, Ansible has supported role dependencies to encourage reuse of role definitions. To audit and maintain larger orchestrations, it would be nice to have some way to easily generate a dependency graph of which roles depend on which…
Martin Thorsen Ranang
  • 2,394
  • 1
  • 28
  • 43
10
votes
1 answer

parallelizing tasks in Luigi Orchestrator

I defined three tasks T1, T2, and T3, and then a task T4 as follows: class T4(luigi.Task) def requires(self): return [T1(), T2(), T3()] Is there a natural way to tell Luigi that I want these tasks T1, T2, and T3 to be executed in…
sweeeeeet
  • 1,769
  • 4
  • 26
  • 50
9
votes
1 answer

airflow - how to 'Filling up the DagBag' once only

My dag takes about 50seconds to parse, I only use external triggers to start dag runs, no schedules. I notice airflow wants to fill the dagbag a lot --> On every trigger_dag command AND in the background it keeps checking the dags folder AND…
tooptoop4
  • 234
  • 3
  • 15
  • 45
9
votes
2 answers

Orchestrated vs Choreographed Service-Oriented Architecture in large scale?

I'm an architect in a large scale financial company and we are in the beginning of implementing a new business oriented infosystem across our different countries. From the very early on the core idea has been to follow microservice oriented…
kingmaple
  • 4,200
  • 5
  • 32
  • 44
8
votes
1 answer

What are good practices for creating monorepo kubernetes infrastructure?

I’m having really hard time trying to construct workflow with k8s that would include: Having monorepo for multiple microservices Having single command to start all of them and being able to start local development Having docker-like experience of…
Adam Pietrasiak
  • 12,773
  • 9
  • 78
  • 91
8
votes
4 answers

Orchestration vs Message Driven Architecture

What are the responsibilities of an Orchestration engine vs a Message Driven System. If I have to build a system which have to string together different independent components(cross-technology/platform components which need not expose a web service…
raja00cs
  • 151
  • 2
  • 4
7
votes
2 answers

Coverage for android tests using orchestrator

I am working on a project where in we are trying to use the ANDROID TEST ORCHESTRATOR for it's obvious benefits of isolating crashes. But while executing the test suite, it appears to me that as the orchestrator initiates a new process for every…
Shredder
  • 150
  • 1
  • 1
  • 15
1
2 3
…
25 26