Questions tagged [mesosphere]

Mesosphere (now D2iq) was a company that productized Apache Mesos, the Marathon scheduler, and other applications to support Mesos applications and infrastructure inside their DCOS software.

Mesosphere (now D2iQ) provided the Datacenter Operating System (DCOS), a distributed OS with Apache Mesos as its kernel. DCOS allowed combining individual Linux machines into a single pool of shared resources running a variety of workloads, from batch (Chronos, MapReduce, etc.) over stream processing (Spark, Storm) to PaaS-level (Marathon). In addition, (distributed) storage services incl. HDFS, Cassandra, ArangoDB, Elasticsearch and Quobyte were applications supported on DCOS.

See the official website for more details.

445 questions
3
votes
2 answers

Mesososphere DCOS cluster on AWS. EC2 instances are terminated and again restarted after they are stopped

I have created a Mesosphere DCOS cluster on AWS using the DCOS template. I want to stop the instances after the day end. But after stopping the instances they are terminated and replaced by new instances. Please suggest how to stop the instances. If…
Rajasi Kulkarni
  • 111
  • 1
  • 11
3
votes
1 answer

Spot Instances Support DCOS

Is it possible to change the DCOS template to use spot instances? I have looked around and there does not seem to be much information regarding this.
gkumar7
  • 325
  • 1
  • 2
  • 10
3
votes
2 answers

What's the service name mesos-dns provides to access Cassandra when using the Cassandra-mesos framework?

We're using a slightly modified community mesosphere cluster. This has mesos-dns installed - so we can resolve master.mesos, and x.marathon.mesos, no problem. The question is which name we should use to access the Cassandra database (whether with…
Elise Huard
  • 241
  • 1
  • 7
3
votes
1 answer

Spark framework on Mesos

I have few questions around Mesos-spark: When I submit spark job with different spark context on Mesos, does it invoke different mesos-spark framework instance or use the same. How can I ensure that each time different spark framework is…
Nitin Goel
  • 45
  • 4
3
votes
5 answers

how know container name with marathon rest API

I'm using Apache Mesos + Marathon + Zookeeper to deploy my rails app. I need share data between rails app and other container. I found some reference here to do it with marathon as follow: marathon/docs/native-docker.html { "id":…
enrique-carbonell
  • 5,836
  • 3
  • 30
  • 44
3
votes
2 answers

Private networking necessary for Mesos and Marathon?

I am working through this tutorial: http://mesosphere.io/docs/getting-started/cloud-install/ Just learning on an Ubuntu instance on Digital Ocean, I let the master process bind to the public IP, and the Mesos and Marathon web interfaces became…
Peter Becich
  • 989
  • 3
  • 14
  • 30
2
votes
1 answer

How are frameworks in Mesos notified when tasks scheduled by them finish?

My question is a combination of this and this question on stackoverflow, however, answers there don't help me. I want to know that when in a Mesos cluster a task corresponding to a framework finishes how is the framework scheduler informed of this.…
PHcoDer
  • 1,166
  • 10
  • 23
2
votes
1 answer

how does resource offer works with mesos for a spark streaming application?

As I understand reading through mesos documentation, is a resource offer is done to a application/framework and it is upto the application to accept/reject offer. I have a "never-ending" spark streaming app where I configured the…
brain storm
  • 30,124
  • 69
  • 225
  • 393
2
votes
2 answers

Marathon exited with status 1

I am installing mesosphere on ubuntu 16.04 xenial .zookeeper and mesos-master and mesos-slave are running fine ,while starting marathon I am getting this issue . Required option 'master' not found .I have created folder in /etc/marathon/conf .These…
Chintamani
  • 1,076
  • 7
  • 23
  • 47
2
votes
1 answer

DC/OS: Service vs Marathon App

I have the following two questions: 1) Are DC/OS Services just marathon apps? (Or: What's the difference between a DC/OS Service (like Cassandra) and a Cassandra app installed via Marathon?) 2) Scaling: Do DC/OS services like Cassandra…
2
votes
1 answer

What is the difference between Apache Mesos and Nomad?

What is the difference between Apache Mesos and Nomad? Nomad seems to claim that it can do resource management so I wonder how that is different from Apache Mesos? Nomad also claims the following on their website Nomad is architecturally much…
user1870400
  • 6,028
  • 13
  • 54
  • 115
2
votes
1 answer

How to read mesos task stdout/stderr from Mesos framework Scheduler class?

I am developing a Mesos framework, it is working perfectly fine, my only issue is that I am unable to read task stdout or stderr from inside the the Scheduler class. I am providing a code sample below, I would like to read the stdout and stderr of a…
Thanos
  • 21
  • 2
2
votes
1 answer

Modify mesos agent to add custom resources that change dynamically

I'm developing a new mesos-slurm framework where jobs from outside mesos can also be pushed to slurm queues. UPDATE to explain better the problem: The mesos agent has a slurm workload manager installed in the same computer that orchestrates jobs in…
Javi Carnero
  • 409
  • 4
  • 9
2
votes
1 answer

Where is endpoint to monitor tasks on agents?

I am wondering where can I find the Mesos rest api endpoint documentation. In my on prem Mesos 0.28 + Marathon version, I can get the statistics from endpoint http://agent.com:5051/monitor/statistics.json But in my aws dc/os installation, I couldn't…
2
votes
1 answer

How to View Long Term Utilization Trends (Graphs) in the DCOS Dashboard

I need to view long term utilization trends for DC/OS and be able to drill down (a la graphana/graphite) in my DC/OS dashboard, but I can't seem to find such a feature there. Is this available in the DCOS dashboard, in DC/OS , or if neither via some…
Traiano Welcome
  • 783
  • 2
  • 12
  • 24