Questions tagged [aws-step-functions]

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

AWS Step Functions

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

Workflows

A workflow describes how people get work done from start to finish. A workflow consists of the steps and states in a process. Workflows can appear as a series of steps in a checklist, or as a diagram that visualizes those steps. Workflows promote logical separation between the control flow of your job's stepwise logic and the actual units of work that contain your unique business logic. With this division, you can manage, maintain, and scale the state machinery of your application separately from the core business logic. As your business requirements change, you can easily change application logic without changing the underlying state machinery, task dispatch, and flow control. Workflows

Amazon States Language

Step Functions implements the open source Amazon States Language (ASL), which is a JSON-based workflow definition language. ASL models workflows as a state machine, where you define a set of states with transitions between them. ASL includes several state types that support the flow of data through your workflow and control of the logic (e.g., Pass State, Choice State, Parallel State, and Fail State). Task states are used to execute work.

The state machine model for ASL has the advantage of making these workflows inherently visual. This is true for creation, editing, and sharing of workflow definitions but also for interpreting and observing historical behavior of workflow executions.

Step Functions Service Integrations

Step Functions includes direct integration with over 220 AWS Services. Optimized Service Integrations provide simplification to make it easier to integrate with services such as AWS Lambda, AWS Glue, Amazon SQS, and Amazon EMR. In addition, AWS SDK Service Integrations provide direct integration with over 11,000 API Actions from over 220 AWS Services.

Workflow Studio

Workflow Studio is a low-code visual workflow designer for Step Functions. Workflow Studio is available in the AWS Console and makes it easy build, edit, visualize, and share your workflows.

When to use this tag?

Use this tag when you have a question about the Step Functions service, about using the Step Functions service along with other AWS Services, or if you have questions about how to build cloud workflows in AWS. Also use this tag for questions you have about the Amazon States Language

Other Step Functions Resources

1505 questions
0
votes
1 answer

Get ARN from AWS Step Functions Activity Name

Is there a way to get ARN of a Step Functions "Activity" from the "Name" of the activity using Java? For example, the ARN is in the following format: arn:aws:states:us-east-1:acct-number:activity:activity-name Is there an API available that looks…
DilTeam
  • 2,551
  • 9
  • 42
  • 69
0
votes
0 answers

AWS Lambda: Create archive from s3 files and store it in back on s3

My service stored a lot of files on AWS S3. According to GDPR, I have to implement the possibility to create an archive of these files and store it on S3 as well (for downloading). Also, I have to filter these files. The best options as for me, it…
RredCat
  • 5,259
  • 5
  • 60
  • 100
0
votes
1 answer

AWS Step Functions Activity Worker not seeing execution when worker was stopped

Version of AWS SDK for Go? v2.0.0-preview.3 Version of Go (go version)? go1.9.3 darwin/amd64 What issue did you see? I'm writing an Activity Worker for Step Functions in Go. When: The activity worker is running, Then, we start a workflow…
Yos Riady
  • 880
  • 2
  • 11
  • 18
0
votes
1 answer

Batch Execution of AWS Step-Function State Machines

I'm somewhat of an AWS noob, and have just started working with Lambda task-based step functions and state machines. I created a multi-step state machine that passes a a request object from step to step and acts on it. What I don't understand is how…
LandonC
  • 889
  • 1
  • 16
  • 28
0
votes
1 answer

Upsert to Redshift within transaction

I am very new to the whole Lambda, AWS, step functions and Redshift. But I think I've pinpointed a problem that was given to me to investigate. The step function invokes a lambda node js code to do a copy from S3 into Redshift. Relevant step…
Tin Ng
  • 937
  • 2
  • 11
  • 25
0
votes
1 answer

Get all statemachines with their name and ARN

I want to create some metrics around step functions that we currently have. I was able to make that list using python but for some reason, we are limited to use java in our company. I want to List ALL statemachines which are defined in current…
Em Ae
  • 8,167
  • 27
  • 95
  • 162
0
votes
1 answer

boto3 - Step Functions generate_presigned_url InvalidSignatureException

I'm attempting to generate a pre-signed URL for describe_execution. After trying different variations of request methods, headers, requests bodies, etc. any request I send to the presigned url will always fail. Canonical Request Hex in the…
0
votes
1 answer

Assumed IAM Role is not authorized to perform: states:GetActivityTask on resource: arn:aws:states::012345678910:role/

I have a Cloudformation stack like, --- AWSTemplateFormatVersion: '2010-09-09' Transform: AWS::Serverless-2016-10-31 Resources: MyFavoriteActivity: Type: "AWS::StepFunctions::Activity" Properties: Name: "my-special-name" …
0
votes
1 answer

Exception with new line in Lambda doesn't report properly to Step Function

Consider a Step Function with a .net Lambda in it. If the lambda throws an exception which contains a new line in the message, the Step Function does not recognise the type properly and instead reports: Error Lambda.Unknown Cause The cause could…
Lee Oades
  • 1,638
  • 17
  • 24
0
votes
1 answer

Suitability of app for AWS Step Functions

I have a use case that I need to implement using aws lambda functions. I have two or more functions that make calls to web service to get data with a criteria. I need to use results from all the process, compare it against other input criteria and…
suvi
  • 1
0
votes
2 answers

Hide Execution Details and Step Details from AWS Step Functions console

we're planning to use AWS Step Functions. We've done some tests and we see that AWS is logging a lot of information in the Execution Details and Step Details section of the Step Functions console. We're planning to have some PII data there that we…
vgaltes
  • 1,150
  • 11
  • 18
0
votes
2 answers

How to call AWS Simple Work Flow (SWF) from API Gateway

I am designing a workflow which should get call from API gateway as it is a platform service and all user authentication and API auth is handled by API gateway, I first considered using step function but throttling limit is just 2 per second which…
0
votes
2 answers

What is the best practice to run SWF Decider and Worker on Amazon cloud?

I've created AWS SWF workers\Decider using "Node.js" and I can run on my machine, Could you please advise about best practice to deploy and run SWF\Worker\Decider on the Amazon background.
0
votes
2 answers

AWS Step Functions: Invoke different instances of a specific step?

I have a list of items. The length of this list is unknown. I would like to use a loop to perform some fairly heavy processing on each item. I am wondering if it is possible to do this using a state machine. More specifically, can I have one step of…
na1368
  • 127
  • 9
0
votes
2 answers

How to send TaskSuccess to the right activity with AWS Step Functions?

So, I'm working on a state machine. It can have up to 20 or 30 executions of it running at the same time, with different parameters. One of it's states is an activity worker (needs to wait for some input from another step function execution started…
ElFitz
  • 908
  • 1
  • 8
  • 26