Stack Overflow
Stack Overflow

Questions tagged [mesosphere]

Mesosphere (now D2iq) was a company that productized Apache Mesos, the Marathon scheduler, and other applications to support Mesos applications and infrastructure inside their DCOS software.

Mesosphere (now D2iQ) provided the Datacenter Operating System (DCOS), a distributed OS with Apache Mesos as its kernel. DCOS allowed combining individual Linux machines into a single pool of shared resources running a variety of workloads, from batch (Chronos, MapReduce, etc.) over stream processing (Spark, Storm) to PaaS-level (Marathon). In addition, (distributed) storage services incl. HDFS, Cassandra, ArangoDB, Elasticsearch and Quobyte were applications supported on DCOS.

See the official website for more details.

445 questions
3
votes
1 answer

difference between dcos-kafka-service and mesos-kafka

I’m doing a POC to deploy Kafka as an application on Mesos Cluster. I came across these 2 codebases on github. One developed by apache-mesos (github page) & other developed by mesosphere and can run only on DCOS (github page). Question: Would like…
satya karthik
  • 58
  • 6
3
votes
2 answers

When using mesos, marathon, and zookeeper my mesos-slave doesnt start when I specify the "containerizers" file with "docker,mesos"?

I have 3 CentOS VMs and I have installed Zookeeper, Marathon, and Mesos on the master node, while only putting Mesos on the other 2 VMs. The master node has no mesos-slave running on it. I am trying to run Docker containers so i specified…
kmahesh3
  • 31
  • 2
3
votes
1 answer

What conditions cause a Marathon leader election?

I'm using using Mesos and Marathon to manage application deployments, and have run into this bug in Marathon https://github.com/mesosphere/marathon/issues/3783 , which is to say that a leader election during a deployment scales instances down to 0.…
Mike Sherov
  • 13,277
  • 8
  • 41
  • 62
3
votes
1 answer

DC/OS service development with Akka

First of all, I'm new to DC/OS ... I installed DC/OS locally with Vagrant, everything worked fine. Then I installed Cassandra, Spark and I think to understand the container concept with Docker, so far so good. Now it's time to develop an Akka…
Simon
  • 349
  • 2
  • 18
3
votes
0 answers

apache marathon: my docker image keeps failing

Im following steps on here I've created a json file as such: { "id": "/myjavabuild-2", "cmd": null, "cpus": 1, "mem": 1024, "disk": 0, "instances": 1, "container": { "type": "DOCKER", "volumes": [], "docker": { …
ealeon
  • 12,074
  • 24
  • 92
  • 173
3
votes
0 answers

Thrift on Spark on Mesos using DC/OS

I've installed Zeppelin from the DC/OS universe. My question is, and I've been unable to find any answer for this - How do I Install Thrift on Mesos in order to use SparkSQL? What are the steps I need to perform? Thanks
user1477327
  • 144
  • 8
3
votes
0 answers

Mesos Resources Best Practices

I was wondering if there were any best practices for restricting the amount of resources available to Mesos. Specifically, CPU resources. We have a busy mesos cluster running CPU intensive tasks within docker containers. Is it a good idea to…
blockcipher
  • 2,144
  • 4
  • 22
  • 35
3
votes
1 answer

DC/OS - Dashboard showing 0 connected nodes

After restarting my 3 masters in my DC/OS cluster, the DC/OS dashboard is showing 0 connected nodes. However from the DC/OS cli I see all 6 of my agent nodes: $ dcos node HOSTNAME IP ID 172.16.1.20 172.16.1.20 …
ndachel
  • 31
  • 2
3
votes
2 answers

Can't start Confluent 2.0 (apache-kafka) Schema-Registry in DC/OS

DC/OS doesn't run Schema-registry and Rest-Proxy components of confluent 2.0. I've launched Confluent 2 that contains the apache-kafka package in DC/OS 1.7 via Marathon, see also the Marathon app spec. As I understand, Marathon runs…
Hryhorii Liashenko
  • 178
  • 2
  • 12
3
votes
1 answer

Does the DCOS installation process work the same with an existing Mesos installation or do we need to start from scratch?

We have an existing Apache Mesos cluster and want to try DCOS in its shiny new Open Source form. However, it would be painful to do a destructive re-install of DCOS. So is it possible to just 'overlay' DCOS on an existing Mesos installation? Would…
Venkat Krishnamurthy
  • 31
  • 2
3
votes
2 answers

Spark submit using mesos dcos cli

I'm trying to start a spark streaming job on mesos using the DCOS cli. I'm able to start the job. My program expects a config file to be passed as cli parameter. How do I achieve this with dcos spark run --submit-args? I tried --files…
Cheeko
  • 1,193
  • 1
  • 12
  • 23
3
votes
2 answers

Flocker data migration

I'm using flocker to persist and migrate docker containers data through ZfS Dataset backend. docker run -v test:/data --volume-driver flocker busybox sh -c "echo hello world > /data/file.txt" I had this error for a week: Unable to find image…
DiStephane
  • 105
  • 1
  • 7
3
votes
2 answers

Marathon stop working when consul starts

I have 6 machines mesos cluster (3 masters and 3 slaves), I acces to mesos User interface 172.16.8.211:5050 and it works correctly and redirect to the leader if it is not. Then If I access to marathon User interface 172.16.8.211:8080 it works…
Asier Gomez
  • 6,034
  • 18
  • 52
  • 105
3
votes
1 answer

How to use Docker volumes as persistent volumes for Mesos/Marathon?

I'm running Mesos and Ceph clusters on CoreOS with a working Ceph RBD Docker volume plugin, but it's very unclear to me how this can be used with Mesos/Marathon... Creating/using rbd volumes for single Docker containers is working flawlessly…
Tobi
  • 31,405
  • 8
  • 58
  • 90
3
votes
1 answer

How to run PySpark (possibly in client mode) on Mesosphere cluster?

I am trying to run a PySpark job on a Mesosphere cluster but I cannot seem to get it to run. I understand that Mesos does not support cluster deploy mode for PySpark applications and that it needs to be run in client mode. I believe this is where…
Jeff
  • 31
  • 1
1 2 3
…
29 30