Stack Overflow
Stack Overflow

Questions tagged [aws-batch]

AWS Batch enables you to run batch computing workloads on the AWS Cloud. Batch computing is a common way for developers, scientists, and engineers to access large amounts of compute resources. AWS Batch removes the undifferentiated heavy lifting of configuring and managing the required infrastructure.

420 questions
0
votes
1 answer

Tensorboard in aws batch docker container

I am running a aws batch service, containing tensorflow code in a docker file. I can see that the code executes, but, the problem is I want to get the tensorboard access url so that I can access it in my local browser. I am confused, can anyone help…
Manjil Shrestha
  • 11
  • 2
0
votes
2 answers

Scheduling Automated Emails in AWS

I recently created my first AWS web application using elastic beanstalk and the MERN (MongoDB, Express, React, NodeJS) stack and now I need to query my database daily to trigger emails. Initially I was thinking about just creating a hook in my web…
Sean Merron
  • 442
  • 4
  • 15
0
votes
1 answer

CannotStartContainerError: API error (400): OCI runtime create failed: container_linux.go:348

I am trying to run a script through AWS Batch, following the tutorial from here. In particular, the entry point script is the same: it is a script that downloads the code to be executed in AWS Batch from an S3 bucket. However, no matter how I try to…
gc5
  • 9,468
  • 24
  • 90
  • 151
0
votes
1 answer

How to handle ECS container agent docker container logs?

I am using aws batch with ECS. ECS tasks can be configured in task definition to use awslogs logDriver and send the logs to cloudwatch, which prevent them taking up space in EC2 instance. But the ECS container agent itself also lives in a docker…
Harry Su
  • 169
  • 4
  • 11
0
votes
1 answer

Does AWS Batch charge you when no jobs are running?

I have setup AWS Batch compute environment. Mostly jobs will run on daily or weekly basis. My question is when there is no jobs are running on ec2 compute environment, am i charged for it. How AWS Batch is managing compute environment? After…
palani.p
  • 521
  • 1
  • 7
  • 13
0
votes
1 answer

How do I support passing a unique job name via environment variable to a Spring Batch Job?

I'm just getting started with using Spring Batch. I'm working on a command line launcher using AWS Batch with a Docker image. Trying to just sort the job instance naming. Would it be acceptable to use a @Value for the below literal string in…
Jim Hankins
  • 1,055
  • 1
  • 11
  • 27
0
votes
1 answer

How to process Objective-c on AWS

I have created a data engine in objective-c that requires immense processing. Rather than go buy 100 graphics cards, I'd like to just rent an AWS product like AWS Batch, and run my number crunching over there for cheap. I can export my project as a…
Albert Renshaw
  • 17,282
  • 18
  • 107
  • 195
0
votes
1 answer

How to expose a port for AWS Batch container?

Per my understanding, "task definition" for ECS is being created by Batch, and some fields, like env variables or mounting points, can be described in "job definition" and that is reflected in "task definition". But what about other "task…
dveim
  • 3,381
  • 2
  • 21
  • 31
0
votes
1 answer

AWS Batch tag EBS volume for cost analysis

I am currently developing an AWS Batch processing system with CloudFormation that needs to be analyzed for the total cost of the CFT including the EC2 instances and any IOPS from the EBS volumes. I am performing this analysis based on a tag on the…
Preston Martin
  • 2,789
  • 3
  • 26
  • 42
0
votes
1 answer

AWS Batch jobs stuck in PENDING when they `dependsOn`

I have an issue chaining AWS Batch jobs. There are 3 Compute environments (CE_A, CE_B, CE_C) and they have associated one Job queue each (JQ_A, JQ_B, JQ_C). There are 6 Job definitions (JD_1, JD_2, ..., JD_6). Let -- be a Job…
Costin
  • 2,699
  • 5
  • 25
  • 43
0
votes
1 answer

Outputs JobQueueName instead of ARN for an AWS::Batch::JobQueue resource

Is it possible to export the JobQueueName instead of the ARN of an AWS::Batch::JobQueue resource in the Outputs section of CloudFormation (actually serverless.yml)? This is how I export the ARN: Outputs: epJobQueueMedium: Description: Batch…
Costin
  • 2,699
  • 5
  • 25
  • 43
0
votes
2 answers

Template validation error - Invalid template resource property

I am trying to create jobqueue template in which I declare output values so that jobqueue can be imported into other stacks. Template: { "Resources": { "MyJobQueue": { "Type": "AWS::Batch::JobQueue", "Properties": { …
nad87563
  • 3,672
  • 7
  • 32
  • 54
0
votes
1 answer

Get Creation Time of an AWS Batch job

When executing an AWS Batch job, I would like to know when the job was created. The API provides a way to get job details, including createdAt. But how do I know the job id to fetch those details?
linqu
  • 11,320
  • 8
  • 55
  • 67
0
votes
1 answer

Using AWS Batch to Update to RDS

Hi , I am new to AWS and I have a use case where I have to process bulk updates on Amazon RDS DB based on the input files received in my S3 Bucket. Please validate my solution on this use case and correct me if I am wrong. I will be using AWS…
Abhi
  • 6,471
  • 6
  • 40
  • 57
0
votes
2 answers

How to code/implement AWS Batch?

I am pretty new to AWS Batch. I have prior experience of batch implementation. I gone through this link and got how to configure a batch on AWS. I have to implement simple batch which will read incoming pipe separated file, read out data from that…
NGR
  • 1,230
  • 2
  • 15
  • 44
1 2 3
…
27
28