Stack Overflow
Stack Overflow

Questions tagged [apache-aurora]

Apache Aurora is a Mesos framework for long-running services and cron jobs, responsible for scheduling and executing tasks across a shared pool of machines.

Apache Aurora is a Mesos framework for long-running services and cron jobs, responsible for scheduling and executing tasks across a shared pool of machines. When machines experience failure, Aurora intelligently reschedules those jobs onto healthy machines.

Getting Started

Check out the project's Downloads to download the source, and follow the project's hello world tutorial to get started.

29 questions
49
votes
4 answers

Marathon vs Aurora and their purposes

Both Marathon and Aurora are built on Mesos and supposedly are engineered for running long running services. My questions are: What are their differences? I have struggled in finding any good explanations regarding their key differences Do these…
user1340582
  • 19,151
  • 35
  • 115
  • 171
2
votes
1 answer

Launching jobs with large docker images in mesos via aurora can be slow

When launching a task over mesos via aurora that uses a rather large docker image (~2GB) there is a long wait time before the task actually starts. Even when the task has been previously launched and we would expect the docker image to already be…
andrei
  • 339
  • 3
  • 12
2
votes
2 answers

Run a large amount of tasks on a cluster

I'm looking for a solution to running a large amount of tasks and monitoring their status on a cluster. In detail: Each task consists of 3-4 processes which are docker contained (each process is a docker run command). All of the processes have to…
Lior Regev
  • 450
  • 1
  • 6
  • 9
2
votes
2 answers

Apache Aurora GPU Resources

I am checking out Apache Aurora with the scope of running scientific workflows (assuming a set of python scripts in a particular sequence). I've successfully managed to run a few of these aurora Jobs, and it looks great for my particular use-case. I…
Andrea DeMarco
  • 21
  • 2
1
vote
1 answer

The command status stop "Creating job WordCountTopology" after submit a Topology

I attempted to build a Heron Cluster using Apache Mesos, Apache Aurora, ZooKeeper and HDFS. However, When I submit the WordCountTopology after finished it, the command ouput as following: Stopping the "Creating job…
Yitian Zhang
  • 314
  • 1
  • 3
  • 18
1
vote
0 answers

Individual Apache Mesos taks real resource usage monitoring

Does anyone knows if it's possible to monitoring the real (not allowed, configured by aurora), resources usage that a task in Mesos is doing? I've look into all the Mesos HTTP Endpoints but I've only been able to found configuration information…
Miguel N. Moreno
  • 7
  • 3
1
vote
1 answer

Aurora file define host port

Okay, after a week, or more, my Aurora Cluster is running. This was not really easy but, nevertheless, I got it. I have a simple aurora file # copy frontend into the local sandbox clone_service = Process( name = 'copy service', cmdline = 'git…
Citrullin
  • 2,269
  • 14
  • 29
1
vote
1 answer

Apache Aurora cron jobs are not scheduled

I setup a Mesos cluster which runs Apache Aurora framework, and i registered 100 cron jobs which run every min on a 5 slave machine pool. I found after scheduled 100 times, the cron jobs stacked in "PENDING" state. May i ask what kind of logs i can…
Ken Chen
  • 159
  • 2
  • 7
1
vote
1 answer

Some questions on Apache Aurora

I have been comparing Marathon with Aurora. Marathon: Easy to use Light weight More active to add new features Aurora: More feature sets, and more flexible object configurations Heavy and difficult to use More conservative adding new…
user3772724
  • 125
  • 6
1
vote
1 answer

Does Apache Aurora have an API?

Is the command-line client the only way to submit jobs? Is there a REST or language-specific API?
CheatEx
  • 2,082
  • 2
  • 19
  • 28
1
vote
3 answers

Mesos Framework

I want to distribute Docker containers on a cluster by using java and define dependencies, so that when one container is finished I can parse the produced output in my java code. There are many mesos frameworks that can achieve that and I'm not sure…
Whatever
  • 115
  • 1
  • 2
  • 7
0
votes
0 answers

Connecting Aurora in AWS Data Pipeline

I'm having issue connecting data pipeline to Aurora as destination. I'm getting this error message Unable to load driver com.mysql.cj.jdbc.Driver from s3://****/aws-mysql-jdbc-1.1.1.jar Any help would be appreciated, Thank you.
Tom
  • 432
  • 2
  • 9
0
votes
1 answer

force pull docker image in Apache Aurora

I'm trying to launch a Apache Aurora job in a Mesos cluster from a Docker image. My configuration is: Job(cluster = 'my_cluster', environment = 'devel', role = 'my_role', service = True, constraints = { …
Jean-Mathieu Vermosen
  • 107
  • 1
  • 2
  • 12
0
votes
1 answer

How to modify the size of RAM requirement of aurora task in Heron cluster deployed on Aurora scheduler?

I deployed Heron cluster using aurora-scheduler and Mesos. And when I ran the default WordCountTopology using this cluster, I found the ram demand of aurora task is 4G. However, the WordCountToplogy's configuration as follows: componentRam:…
Yitian Zhang
  • 314
  • 1
  • 3
  • 18
0
votes
1 answer

Heron Failed to set packing plan for topology 'WordCountTopology'

When I submitted WordCountTopology to the Heron Cluster that deployed with Aurora scheduler and Zookeeper, this error happened as follows： yitian@heron01:~$ heron submit aurora/yitian/devel --config-path ~/.heron/conf…
Yitian Zhang
  • 314
  • 1
  • 3
  • 18
1
2