Questions tagged [azure-batch]

The azure-batch tag should be used to ask questions regarding all aspects of the Azure Batch service including job scheduling, compute node provisioning, and pool orchestration. Extended ecosystem questions are also welcome that are related to Azure Batch accelerator offerings, Azure Portal Batch blades, and Batch Explorer.

Azure Batch is a job scheduling and compute management orchestration solution for the Microsoft Azure cloud. The service is available in all Azure regions and can deploy with nearly all Azure VM sizes available, including those with specialized hardware such as GPUs and Infiniband/RDMA interfaces.

Azure Batch is a managed job scheduling solution where the underlying compute resources are allocated as pools. Pools may be comprised of Linux or Windows VMs and any number of dedicated and low priority nodes and can be automatically scaled through autoscale formulas. An Azure Batch Job can be thought of as a queue for tasks. Each Azure Batch Job can be assigned to a pool. Any number of tasks can be assigned to jobs, including multi-instance tasks (i.e., multi-node) which support MPI jobs. Azure Batch also supports containerized execution.

For a full introductory treatment of Azure Batch, see the Azure Batch Technical Overview. The service team also provides a GitHub repository for issue tracking, feature requests, and change logs.

416 questions
-1
votes
1 answer

How Create Nested Azure Resources using Azure SDK

Using ARM template, we can define a storage account under a batch account. But how we can do this using .NET SDK? Currently I can create BatchAccount and StorageAccount as separate resources, but what to do if a StorageAccount should be appeared…
-1
votes
2 answers

when we create AzureBatchLinkedService in azure data factory it's give error for azure batch pool i am using cloud service

when we create AzureBatchLinkedService in azure data factory it's give error for azure batch pool i am using cloud service Error Entity provisioning failed: Azure Batch operation failed. Code: 'BadRequest' Message: 'The input is not a valid…
user3843858
  • 321
  • 1
  • 5
  • 21
-1
votes
1 answer

Is there a disadvantage if I keep completed tasks in a job while using Azure Batch

I am planning to use Azure Batch Service. I will add several permanent jobs (in a permanent pool), and add new tasks to job now and then. Therefore number of completed (and incomplete) tasks will be increased over time. Should I delete the completed…
Nuri Tasdemir
  • 9,720
  • 3
  • 42
  • 67
-1
votes
1 answer

azure batch starttask giving error

I am trying to create a azure batch service. While creating a pool, i am trying to give a starttask which should be run when the VM's are spinned up for the first time. After the pool is committed when i try to observe the progress on the Azure…
Manish Mehra
  • 1,381
  • 1
  • 16
  • 24
-2
votes
1 answer

How to schedule a work in Azure Batch from Logic App?

everyone. Is there any way to schedule a work on Azure Batch from Logic App? I would like to process a file by its insertion event in Blob Storage. If you know other methodologies to do that, I will appreciate your help. :-) Thank you!
-2
votes
1 answer

use Azure Batch as Jenkins' node

I have a Jenkins server that is running well with other machines as node. I have also a Azure Batch account and a working pool. Is there a way to connect both so that Jenkins tasks are sent to the Azure Batch pool? So far I have only found this…
RockScience
  • 17,932
  • 26
  • 89
  • 125
-2
votes
1 answer

Python Azure Batch - Permission Denied Linux node

I am running a python script on several Linux nodes (after the creation of a pool) using Azure Batch. Each node uses 14.04.5-LTS version of Ubuntu. In the script, I am uploading several files on each node and then I run several tasks on each one of…
RobLoc
  • 1
  • 1
-2
votes
1 answer

Maximum cloud computing utilization - pay for computing, not idle time

I have one big task to do every day, with no need to scale, that takes about 30 minutes and is DB, processor and memory intensive. This means actual 16h/month of computation time. WebJobs require constantly running WebSite 744h/month WebRole is…
Erik
  • 20
  • 3
-3
votes
1 answer

Local network batch

I have been playing around with azure batch for a project at work. My work has 100-1000s of computers running win10 mostly chewing over Outlook and not much else. Is there some framework that can leverage 'idle' CPU time in this environment? Seems a…
Jon
  • 2,280
  • 2
  • 25
  • 33
-3
votes
2 answers

What Microsoft Azure service would be the best for me?

I am mainly a low level system developer so I am kind of lost with all those high level tools that Azure offers and all those buzz words. So here's what I am trying to build: I am building a server that has a processing part (probably using Azure…
1 2 3
27
28