I am deploying several workflows with a common deployment file and passing variables with dbx jinja option:
dbx deploy --jinja-variables-file=conf/vars.yml
If I change anything at the deployment file or any of the variables in vars.yml
, this commands creates a new workflow instead of updating the same workflow. However, if I hard-code the variables in several separate deployment files, doing changes in a deployment file and re-deploying it works as expected, that is, updates the existing pipeline.
Ideally, I would have one vars
file per each workflow and would be able to update existing workflows. Any ideas how to achieve this or tips for work arounds without duplicating the deployment file?