I have a scenario of executing glue jobs from the step function. If i need to pass the parameters from first glue job to second glue job, How can i achieve that? I researched on it and didn't found any documentation on it.
Asked
Active
Viewed 843 times
2
-
Does this answer your question? [How to return output from AWS Glue jobs back to the calling Step Function workflow?](https://stackoverflow.com/questions/58222209/how-to-return-output-from-aws-glue-jobs-back-to-the-calling-step-function-workfl) – ms12 Feb 04 '22 at 18:33
-
Thanks for the reply, Actually No, I have seen that post but it is long back, so just want to clarify if there is any way of doing that. – Sujitha Chinnu Feb 04 '22 at 18:41
-
I don't have a great answer, but here's a couple of options. 1) Job1 drops the params in SQS and Job2 pulls them. 2) Use Glue Workflow in addition, or in place of, Step Functions for the Job orchestration. Workflows have Properties and Job1 could add a Property that Job2 could access – Bob Haffner Feb 04 '22 at 18:59