Questions tagged [mesosphere]

Mesosphere (now D2iq) was a company that productized Apache Mesos, the Marathon scheduler, and other applications to support Mesos applications and infrastructure inside their DCOS software.

Mesosphere (now D2iQ) provided the Datacenter Operating System (DCOS), a distributed OS with Apache Mesos as its kernel. DCOS allowed combining individual Linux machines into a single pool of shared resources running a variety of workloads, from batch (Chronos, MapReduce, etc.) over stream processing (Spark, Storm) to PaaS-level (Marathon). In addition, (distributed) storage services incl. HDFS, Cassandra, ArangoDB, Elasticsearch and Quobyte were applications supported on DCOS.

See the official website for more details.

445 questions
7
votes
1 answer

Fig / Docker-Compose-like JSON to feed into Mesosphere/Marathon to setup Multi-Tier Application

Does anyone know if it is possible to setup a JSON file to feed into Mesosphere/Marathon to deploy multi-tier application with application dependency? Something along the lines of fig or docker compose when there is one yaml file describing…
user2362699
  • 586
  • 6
  • 22
7
votes
1 answer

Main differences between mesosphere and coreos

Firstly, is it correct to compare these two products? If yes, what is the main difference between them?
Dante
  • 451
  • 4
  • 12
6
votes
0 answers

Mesos 1.2.1 & 1.3.1 slave - docker job exits normally but reporting as failure

My mesos version was recently upgraded from 0.28 to 1.2.1. Jobs are being scheduled using Chronos. My docker job is being invoked properly, but still getting TASK_FAILED error event it completes with exit status ZERO. This is reproducible always. I…
user1578872
  • 7,808
  • 29
  • 108
  • 206
6
votes
2 answers

Consul deregister 'failing' services

I have consul running on Consul v0.5.2 version & services running in Mesos. Services keep moving from 1 server to another. Is there way to deregister services in consul that are in 'failing' state? I am able to get the list of services in failing…
DevOpsNewB
  • 185
  • 2
  • 14
5
votes
1 answer

Why do containers fail to fetch URIs in DC/OS?

I have created a cluster on Digital Ocean (DC/OS 1.9) using terraform following these instructions here Everything seems to have installed correctly, to pull from a private docker repo, I need to add a compressed .docker file to my /core/home/ and…
Dominic Cabral
  • 962
  • 9
  • 21
5
votes
7 answers

Mesos Failed to connect error to IP:5050

I am new to Mesos and just finished setting up mesos and along with zookeeper on my test server. Unfortunately I keep getting this error message on my mesos console indicating i am unable to connect to mesos on port 5050 and can't seem to figure…
crusadecoder
  • 651
  • 1
  • 11
  • 26
5
votes
1 answer

Apache Spark on Mesos: Initial job has not accepted any resources

I am running Apache Spark on cluster mode using Apache Mesos. But, when I start Spark-Shell to run a simple test command (sc.parallelize(0 to 10, 8).count) I receive the following warning message: 16/03/10 11:50:55 WARN TaskSchedulerImpl: Initial…
JuniorStack2
  • 113
  • 1
  • 2
  • 8
5
votes
1 answer

How to connect spark-shell to Mesos?

I am trying to set up Apache Spark to run on Mesos, but I get the following message on terminal: W0309 10:37:10.570291 4017 sched.cpp:700] Ignoring framework registered message because it was sent from 'master@127.0.1.1:5050' instead of the…
JuniorStack2
  • 113
  • 1
  • 2
  • 8
5
votes
2 answers

How to get the IP of current leader master from the quorum?

Is there any way to get the IP of current leading Mesos-master from the quorum? Does any variable stores that value?
Madhurima Mishra
  • 1,063
  • 3
  • 14
  • 27
5
votes
3 answers

Is HDFS necessary for Spark workloads?

HDFS is not necessary but recommendations appear in some places. To help evaluate the effort spent in getting HDFS running: What are the benefits of using HDFS for Spark workloads?
BAR
  • 15,909
  • 27
  • 97
  • 185
5
votes
4 answers

How should a .dockercfg file be hosted in a Mesosphere-on-AWS setup so that only Mesosphere can use it?

We have set up a test cluster with Mesosphere on AWS, in a private VPC. We have some Docker images which are public, which are easy enough to deploy. However most of our services are private images, hosted on the Docker Hub private plan, and require…
5
votes
1 answer

Mesos: mesos-slave offer additional ports

I've got some mesos-slave nodes that I would like to expose to the internet. As such, I would like mesos-slave to offer port 80 and 443 in addition to its default slew of ports/resources. From what I have gathered, I need to adjust the --resources…
advait
  • 6,355
  • 4
  • 29
  • 39
5
votes
1 answer

Mesos applications, why not use Marathon for everything?

I see Mesosphere building all kinds of applications on the Mesos Framework like Hadoop, Kubernetes, etc. but since there is the Marathon applications for long-running services, why not just use that? E.g. why not setup Kubernetes nodes on a bunch of…
user1340582
  • 19,151
  • 35
  • 115
  • 171
5
votes
1 answer

It's possible only install Hadoop HDFS?

I'm new on Hadoop world, and I need install mesos with Hadoop HDFS to make a fault-tolerant distributed file system, but all installation references include necessary components for my scenario as for example: MapReduce. Do you have any idea or…
enrique-carbonell
  • 5,836
  • 3
  • 30
  • 44
5
votes
1 answer

Does Apache Mesos recognize GPU cores?

In slide 25 of this talk by Twitter's Head of Open Source office, the presenter says that Mesos allows one to track and manage even GPU (I assume he meant GPGPU) resources. But I cant find any information on this anywhere else. Can someone please…
GuSuku
  • 1,371
  • 1
  • 14
  • 30
1
2
3
29 30