Stack Overflow
Stack Overflow

Questions tagged [aws-step-functions]

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

AWS Step Functions

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

Workflows

A workflow describes how people get work done from start to finish. A workflow consists of the steps and states in a process. Workflows can appear as a series of steps in a checklist, or as a diagram that visualizes those steps. Workflows promote logical separation between the control flow of your job's stepwise logic and the actual units of work that contain your unique business logic. With this division, you can manage, maintain, and scale the state machinery of your application separately from the core business logic. As your business requirements change, you can easily change application logic without changing the underlying state machinery, task dispatch, and flow control. Workflows

Amazon States Language

Step Functions implements the open source Amazon States Language (ASL), which is a JSON-based workflow definition language. ASL models workflows as a state machine, where you define a set of states with transitions between them. ASL includes several state types that support the flow of data through your workflow and control of the logic (e.g., Pass State, Choice State, Parallel State, and Fail State). Task states are used to execute work.

The state machine model for ASL has the advantage of making these workflows inherently visual. This is true for creation, editing, and sharing of workflow definitions but also for interpreting and observing historical behavior of workflow executions.

Step Functions Service Integrations

Step Functions includes direct integration with over 220 AWS Services. Optimized Service Integrations provide simplification to make it easier to integrate with services such as AWS Lambda, AWS Glue, Amazon SQS, and Amazon EMR. In addition, AWS SDK Service Integrations provide direct integration with over 11,000 API Actions from over 220 AWS Services.

Workflow Studio

Workflow Studio is a low-code visual workflow designer for Step Functions. Workflow Studio is available in the AWS Console and makes it easy build, edit, visualize, and share your workflows.

When to use this tag?

Use this tag when you have a question about the Step Functions service, about using the Step Functions service along with other AWS Services, or if you have questions about how to build cloud workflows in AWS. Also use this tag for questions you have about the Amazon States Language

Other Step Functions Resources

1505 questions
0
votes
2 answers

How to create stages for AWS state machine?

I have created a simple AWS state machine with lambda functions. Like below { "Comment":"Validates data", "StartAt": "ChooseDocumentType", "States": { "ChooseDocumentType": { "Type": "Choice", "Choices":[ { …
LP13
  • 30,567
  • 53
  • 217
  • 400
0
votes
1 answer

Execution of a particular stepfunction(state machine) among multiple executions of same state machine

I am trying to restart a state machine which is in pause state,In my case there are multiple executions of the same state machine in which I am restarting state machine and state machine is restarting the executions which are paused first(FIFO…
akhil gollapudi
  • 1
  • 1
0
votes
1 answer

Any way to get tasks in batch from Step Function Activity

Currently, to get the tasks using poller from Step Function Activity, I am using following: https://docs.aws.amazon.com/step-functions/latest/apireference/API_GetActivityTask.html But it gives the task one by one. Is there any way, I could take the…
hatellla
  • 4,796
  • 8
  • 49
  • 101
0
votes
0 answers

AWS: Stepfunctions cloud not be deployed from SAM

The error below occurred When I deploy a stepfunction by using SAM deployment. Are there any idea why it happened. ■ template.yaml AWSTemplateFormatVersion: '2010-09-09' Transform: AWS::Serverless-2016-10-31 Description: Test Stack Resources: …
Tamajin
  • 155
  • 5
0
votes
2 answers

Workflow design in AWS Ec2 instances not involving lambda

Thanks in advance for your time and answers. I have multiple, say 3 AWS EC2 windows instances. I have .NET executables A, B and C in each of the 3 windows instances. (I could also have java programs in the mix) They need to be run, one after the…
VenVig
  • 645
  • 1
  • 10
  • 14
0
votes
1 answer

Use JSONPath to extract nodes from different levels

Given this document: { "k1": "v1", "k2": "v2", "k3": "v3", "k4": { "k4.1": "v4.1", "k4.2": "v4.2", "k4.3": "v4.3" } } I need to extract this subset, in this exact form: { "k2": "v2", "k3": "v3", "k4.1": "v4.1" "k4.2":…
Kevin Pauli
  • 8,577
  • 15
  • 49
  • 70
0
votes
1 answer

Invoke aws lambda from another lambda at a defined specific time

I have a lambda function (say A) which needs to invoke another lambda function (say B). But that other function (B) should not run at the time of invoke but should run at the time defined by A. Given below is how I'm trying to invoke function B…
Yasith Prabuddhaka
  • 859
  • 1
  • 11
  • 17
0
votes
1 answer

Masking IP for outgoing traffic

I have created a EC2 instance with ASG and attached a eni . Third party service we invoke will accept traffic only if it got initiated from the eni IPs. ASG won’t allow us to assign eni as primary ip . Is there a work around for this ?
HelloWorld
  • 1
  • 3
0
votes
1 answer

Is there a way to create step functions graph using CDK?

Currently step functions graph are defined in json using ASL (Amazon States Language). There is no good way to to unit testing of the graphs being created and we have to rely on running the graph with mocked/some implementation of lambda functions…
Scorpion
  • 633
  • 3
  • 11
  • 24
0
votes
0 answers

Data in lambda event is not persistent

I want to pass some data from one lambda function to the other for which I am using lambda 'events'. First lambda Function - event['data'] = "value" return event Second Lambda Function - def lambda_handler(event,context): value_of_data =…
TeeKay
  • 1,025
  • 2
  • 22
  • 60
0
votes
0 answers

How to manage AWS glue jobs from a microservice need suggestions

We have a requirement to manage the AWS glue job from a microservice (rest service ). the microservice will provide a REST endpoint to start, stop and find the status of a glue job. We are looking for suggestion on how this can be achieved. What we…
Prakash
  • 578
  • 1
  • 5
  • 22
0
votes
1 answer

Step function cloud formation issue with Fn::Sub when passing list as second parameter

I am trying to create step function using cloud formation. I want to pass the lambda arns as second argument to Fn::Sub function. It works if I pass just one Arn but fails when I pass multiple. (with Fn::Get). I checked the template with Yml…
sujith
  • 665
  • 2
  • 9
  • 22
0
votes
1 answer

Step Functions: How to share context between Lambdas?

I have a data processing workflow like this. The Download task creates a session ID (GUID) and pass it to Parse task and then the Post task. If any exception occurs in these three tasks, the workflow jumps to Failed task. The Failed task would…
Ken Zhang
  • 1,454
  • 2
  • 13
  • 27
0
votes
1 answer

AWS StepFunction : Getting Error as "error": "KeyError"

I am new to AWS and Step functions. I am trying to run simple program from Step function using Lambda function. I have tried below code to run the Step function. code: import boto3 import json import os def lambda_handler(event, context): …
lakshmiprathyusha
  • 155
  • 1
  • 3
  • 12
0
votes
1 answer

(Step Functions Activity Worker) Best practice for handling long polling timeouts in boto?

I am working on my first Step Functions Activity Worker (EC2). Predictably, after 5 minutes of long polling with no activity from the Step Functions state machine, the client connection times out with the error: botocore.exceptions.ReadTimeoutError:…
Andrew6850
  • 113
  • 2
  • 8
1 2 3
…
99 100