Questions tagged [aws-step-functions]

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

AWS Step Functions

AWS Step Functions is a visual workflow service that helps developers use AWS services to build distributed applications, automate processes, orchestrate microservices, and create data and machine learning (ML) pipelines.

Workflows

A workflow describes how people get work done from start to finish. A workflow consists of the steps and states in a process. Workflows can appear as a series of steps in a checklist, or as a diagram that visualizes those steps. Workflows promote logical separation between the control flow of your job's stepwise logic and the actual units of work that contain your unique business logic. With this division, you can manage, maintain, and scale the state machinery of your application separately from the core business logic. As your business requirements change, you can easily change application logic without changing the underlying state machinery, task dispatch, and flow control. Workflows

Amazon States Language

Step Functions implements the open source Amazon States Language (ASL), which is a JSON-based workflow definition language. ASL models workflows as a state machine, where you define a set of states with transitions between them. ASL includes several state types that support the flow of data through your workflow and control of the logic (e.g., Pass State, Choice State, Parallel State, and Fail State). Task states are used to execute work.

The state machine model for ASL has the advantage of making these workflows inherently visual. This is true for creation, editing, and sharing of workflow definitions but also for interpreting and observing historical behavior of workflow executions.

Step Functions Service Integrations

Step Functions includes direct integration with over 220 AWS Services. Optimized Service Integrations provide simplification to make it easier to integrate with services such as AWS Lambda, AWS Glue, Amazon SQS, and Amazon EMR. In addition, AWS SDK Service Integrations provide direct integration with over 11,000 API Actions from over 220 AWS Services.

Workflow Studio

Workflow Studio is a low-code visual workflow designer for Step Functions. Workflow Studio is available in the AWS Console and makes it easy build, edit, visualize, and share your workflows.

When to use this tag?

Use this tag when you have a question about the Step Functions service, about using the Step Functions service along with other AWS Services, or if you have questions about how to build cloud workflows in AWS. Also use this tag for questions you have about the Amazon States Language

Other Step Functions Resources

1505 questions
0
votes
2 answers

Nested Cron Job in AWS Lambda Function

Requirement: To send reminder to n users at their appropriate time. E.g user 1 at 9:10AM, user 2 at 10:50PM, user 3 at 4:20 AM and so on. Solution in Nodejs I have a Nodejs Cron job which runs at every 55 min (i.e. 9:55, 10:55, 11:55). At first it…
Manoj
  • 483
  • 2
  • 8
  • 18
0
votes
1 answer

How to specific the resource ARN (Amazon Resource Name) in the state machine

I follow this tutorial (https://aws.amazon.com/blogs/machine-learning/analyzing-contact-center-calls-part-1-use-amazon-transcribe-and-amazon-comprehend-to-analyze-customer-sentiment/) to create a workflow using the state machine (Step Functions) in…
Harry
  • 3,072
  • 6
  • 43
  • 100
0
votes
0 answers

AWS Batch cannot create c5d.18xlarge instance type

I'm trying to submit job with c5d.18xlarge (vcpus: 72, memory: 144000) but it never coming up till 20 mins even my maximum vcpus of compute enviroment is 256? let containerInfo = { jobDefinition: '', jobName: '', jobQueue: , …
PPShein
  • 13,309
  • 42
  • 142
  • 227
0
votes
0 answers

How to attempt a retry of AWS lambda from within my service?

new to backend development. I have a service that executes a step function which is essentially a countdown timer step function that triggers a lambda. This lambda takes a url from the step function to hit my service's endpoint. In the event that my…
0
votes
0 answers

Trigger AWS Step Function state machine with S3 event from a different AWS account

Well the title says it all. What I am trying to achieve: Have a Cloudwatch event rule checking for PutObject event in a Bucket from AWS Account X When the objects are stored in the S3 bucket, the state machine in AWS Account Y needs to be…
0
votes
1 answer

Branch Flow in AWS Step Function Based on Number of Items in Array

I want to branch the flow of an AWS State Machine based on how many items are in an array. If the array has 0 items, I want to end the flow. If it has more than 0 items, I want to do some stuff. For example, I want to do something like the…
Adam
  • 3,891
  • 3
  • 19
  • 42
0
votes
1 answer

Is StartExecution api for AWS Step Function asynchronous?

I have a use case where I want to start a step function asynchronously from one of my existing lambda function. For this, I am using the StartExecution API. (https://docs.aws.amazon.com/step-functions/latest/apireference/API_StartExecution.html) so…
Sanjib
  • 119
  • 1
  • 1
  • 15
0
votes
2 answers

AWS SDK in java - How to get activities from worker when multple execution on going for a state machine

AWS Step Function My problem is to how to sendTaskSuccess or sendTaskFailuer to Activity which are running under the state machine in AWS . My Actual intent is to Notify the specific activities which belongs to particular State machine execution.…
Nilay Tiwari
  • 492
  • 5
  • 16
0
votes
1 answer

Custom sagemaker container for training, write forecast to AWS RDS, on a daily basis

I have 3 main process to perform using Amazon SageMaker. Using own training python script, (not using sagemaker container, inbuilt algorithm) [Train.py] -> For this, I have referred to this link: Bring own algorithm to AWS sagemaker and it seems…
0
votes
1 answer

Getting Two Step Function Executions in serverless for one call [AWS]

I am working with serverless framework and step functions, I have a lambda function that triggered by an s3 object upload, then that lambda is programmed to start a state machine execution, but each time I upload some file it always shows two…
0
votes
1 answer

How to check Spark step status programmatically (submitted on EMR cluster)?

I created a simple step function as follows : Start -> Start EMR cluster & submit job -> End I want to find out a mechanism to identify whether my spark step completed successfully or not? I am able to start EMR cluster and attach a spark job to…
0
votes
0 answers

Step Function Triggered In a loop

I am starting a step function from Lambda and the Lambda function is tied to an API Gateway. For some reason, when I try to test the Lambda function, I see hundreds of executions failed and running in loop. I just triggered the step function once. I…
0
votes
2 answers

How can we trigger multiple jobs in AWS glue?

I'm new to AWS glue, can anyone please explain how we can triggers multiple jobs together through a single jobs or through any other means.
0
votes
1 answer

How much time does AWS step function keeps the execution running?

I am new to AWS Step Function. I have created a basic step function with Activity Worker in the back end. For how much time, does the Step Function keeps the execution alive and not time out if the execution is still not picked by the activity…
hatellla
  • 4,796
  • 8
  • 49
  • 101
0
votes
1 answer

Value null at 'stateMachineArn' failed to satisfy constraint: Member must not be null

I followed AWS Step Functions and added the AWS Step Functions. But when I used the code below to try to call the Step Functions, import { ajax } from 'rxjs/ajax'; // ... ajax.post( url, { input: JSON.stringify({ formId:…
Hongbo Miao
  • 45,290
  • 60
  • 174
  • 267