Questions tagged [aws-step-functions]

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

AWS Step Functions

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

Workflows

A workflow describes how people get work done from start to finish. A workflow consists of the steps and states in a process. Workflows can appear as a series of steps in a checklist, or as a diagram that visualizes those steps. Workflows promote logical separation between the control flow of your job's stepwise logic and the actual units of work that contain your unique business logic. With this division, you can manage, maintain, and scale the state machinery of your application separately from the core business logic. As your business requirements change, you can easily change application logic without changing the underlying state machinery, task dispatch, and flow control. Workflows

Amazon States Language

Step Functions implements the open source Amazon States Language (ASL), which is a JSON-based workflow definition language. ASL models workflows as a state machine, where you define a set of states with transitions between them. ASL includes several state types that support the flow of data through your workflow and control of the logic (e.g., Pass State, Choice State, Parallel State, and Fail State). Task states are used to execute work.

The state machine model for ASL has the advantage of making these workflows inherently visual. This is true for creation, editing, and sharing of workflow definitions but also for interpreting and observing historical behavior of workflow executions.

Step Functions Service Integrations

Step Functions includes direct integration with over 220 AWS Services. Optimized Service Integrations provide simplification to make it easier to integrate with services such as AWS Lambda, AWS Glue, Amazon SQS, and Amazon EMR. In addition, AWS SDK Service Integrations provide direct integration with over 11,000 API Actions from over 220 AWS Services.

Workflow Studio

Workflow Studio is a low-code visual workflow designer for Step Functions. Workflow Studio is available in the AWS Console and makes it easy build, edit, visualize, and share your workflows.

When to use this tag?

Use this tag when you have a question about the Step Functions service, about using the Step Functions service along with other AWS Services, or if you have questions about how to build cloud workflows in AWS. Also use this tag for questions you have about the Amazon States Language

Other Step Functions Resources

1505 questions
0
votes
3 answers

How do I modify an AWS Step function?

From the AWS console it seems like AWS Step functions are immutable. Is there a way to modify it ? If not how does the version control work ? Do I have to create a new State machine every time I have to make incremental changes to the state machine…
Hexy
  • 828
  • 14
  • 24
0
votes
3 answers

Step Functions for tens or hundreds of executions per second?

I'm considering to use step functions for scenarios like retrieving data from a few sources, composing a mail with it and sending that mail - with appropriate retries. The step function is triggered from API Gateway, so by calling…
Free Willaert
  • 1,139
  • 4
  • 12
  • 24
-1
votes
0 answers

NodeJS to push JSON data to eventbridge and eventbridge rule will trigger step function

From NodeJS application need to send JSON request to event bridge and event bridge should send the same input request to step function. Can you please help me to provide the details? Tried eventbridge rule but keep on getting event pattern is not…
-1
votes
0 answers

AWS API Gateway HTTP API pass query parameters to step functions intergration

I am using the AWS console to configure HTTP API that calls a step function. I want to pass query parameters to the step function. How can I do this in the AWS console?
YulePale
  • 6,688
  • 16
  • 46
  • 95
-1
votes
2 answers

Add tags to s3 objects using step functions

I have millions of s3 objects, now i wanted to add tags to those objects. if prefix have 111 keyword then it should add related tags to all objects under that keyword prefix. like showed below keys tags ----- …
-1
votes
1 answer

How to filter out what gets returned to client when invoking api gateway?

I have api gateway integration with step function. When I invoke it I get in a response more than I want to return to client. How do I filter out what gets returned to client? I only want values in "output" field. Currently, I get following { …
epitka
  • 17,275
  • 20
  • 88
  • 141
-1
votes
1 answer

run SSM from step functions

I am trying to run SSM commands from step functions and am able to run the commands. But it is not able to capture the response correctly. Even though the command fails with some error, the step succeeds in step function. I am using the following…
-1
votes
1 answer

Manipulate JSON input to produce a JSON list of items

I am trying to find a way to manipulate my input JSON so that I can pass it to a map function which would call another step function for processing. My input JSON looks like this: "notificationType": "Received", "mail": { "timestamp":…
-1
votes
1 answer

AWS ETL extraction from RDBMS/CSV

I am trying to see what's best AWS tools anyone using for extraction like Step/Lambda/Glue/Athena etc I got about 50 tables(Oracle to Redshift) and CSV' as source data Looking to load Delta daily basis Will it be better step functions with Lambda or…
-1
votes
2 answers

How to create a dynamic definition for AWS state machine on Terraform?

I'm trying to create a definition for AWS state machine generating it from this list of object: state_object_list = [ { name = "task1", type = "Task", resource = "arn:aws:lambda:us-east-1:123456789:function:test", end =…
-1
votes
1 answer

AWS CLI JMESPath Query to get details of get-execution-history using --query option

I am trying to execute below cli command to get the execution details of the stepfunction aws stepfunctions get-execution-history --execution-arn --no-paginate --output json --query 'events[*].executionStartedEventDetails.input' and above…
SwapnilM
  • 155
  • 2
  • 6
  • 16
-1
votes
1 answer

How can we hold variable in entire aws step function?

Actually My aws lambda returns some value, as you can see in the image. I want access this value in last glue script as an input. Is there any way to use this value in last glue step? I have tried with resultpath and inputpath also but it's not…
-1
votes
1 answer

can object´s s3 bucket path decide upon lambda in step function?

i want to make the following process: An object is placed in a folder of a s3 bucket. There is three folder available folder1, folder2 and folder3. From a event bridge notification a step function shall be invoked that offers three lambda functions…
-1
votes
1 answer

AWS stepfunction array job

I want to make one of AWS job as an array job(to execute things parallely), I have list of inputs for the child job in single json file on s3. I am trying to convert the job into array job by adding array job into defination as follows: "Array": { …
-1
votes
1 answer

Alternate of If condition in AWS state

I do have a scenario in which input Json field has a map of 3 fields and on the existence of each I want to execute a lambda. I am trying this with choice state which works fine till not more than one condition is true. In my scenario ,I can have 2…
1 2 3
99
100