Questions tagged [cloudera-manager]

Cloudera's end-to-end administration tool for Apache Hadoop, its ecosystem components, and related applications from Cloudera

From Cloudera Manager 5 Overview:

Cloudera Manager is an end-to-end application for managing CDH clusters. Cloudera Manager sets the standard for enterprise deployment by delivering granular visibility into and control over every part of the CDH cluster—empowering operators to improve performance, enhance quality of service, increase compliance and reduce administrative costs. With Cloudera Manager, you can easily deploy and centrally operate the complete CDH stack and other managed services. The application automates the installation process, reducing deployment time from weeks to minutes; gives you a cluster-wide, real-time view of hosts and services running; provides a single, central console to enact configuration changes across your cluster; and incorporates a full range of reporting and diagnostic tools to help you optimize performance and utilization.

Additional Information

Related Tags

380 questions
4
votes
1 answer

dncp_block_verification log file increases size in HDFS

We are using cloudera CDH 5.3. I am facing a problem wherein the size of "/dfs/dn/current/Bp-12345-IpAddress-123456789/dncp-block-verification.log.curr" and "dncp-vlock-verification.log.prev" keeps increasing to TBs within hours. I read in some of…
Devidas
  • 45
  • 4
4
votes
1 answer

Hadoop name node and journal node consuming disk space automatically

I'm new to hadoop. I have installed my hbase setup using Cloudera (normal installation) on 5 servers. I created some table and filled some data. Now I monitored the hdfs folder sizes. I can see that the data node is keeping giving consistent…
4
votes
6 answers

HDFS Under replicated blocks

I am using Cloudera Manager Free Edition on my "Cluster" with all services on my single machine. My machine acts as the datanode,namenode as well as the secondary namenode. Settings in HDFS related to replication, dfs.replication …
Suvarna Pattayil
  • 5,136
  • 5
  • 32
  • 59
3
votes
0 answers

Cannot monitor impala queries on Cloudera Manager

I got installed a new cloudera cluster with versions CM-6.3.1 and CDH-6.3.2 and now facing a problem never had with previous cloudera distributions, Cloudera Management Services (including Cloudera Service Monitor), Impala (Sentry Enabled), and all…
belce
  • 203
  • 2
  • 5
3
votes
0 answers

Datanode denied communication with namenode - hdfs

I have installed HDFS in a 12 node cluster. It is deployed in EC2(AWS) instances. All these EC2 instances have 2 network interfaces - eth0 and eth1. eth1 has static IP address and eth0 has an IP address which changes when instances are rebooted.…
codinglover
  • 179
  • 1
  • 2
  • 10
3
votes
2 answers

Hive Databases Only List default DB

When I try to list all hive databases through Spark (1.6) scala> val tdf = sqlContext.sql("SHOW DATABASES"); tdf: org.apache.spark.sql.DataFrame = [result: string] scala> tdf.show +-------+ | result| +-------+ |default| +-------+ When I try to list…
Mahadi Siregar
  • 615
  • 3
  • 17
  • 38
3
votes
2 answers

Large number of messages from Kafka consumer_offset topic

I have been playing around with Kafka for a few months now and I have noticed that I have a rather large number of message/sec under the internal Kafka topic called __consumer_offsets. Now we have a hand full of other topics that are rather small in…
unreal
  • 53
  • 6
3
votes
2 answers

Find duplicates in JSON using python

I'm new to python and I'm trying to achieve the following: Send a get request to an IP of cloudera-Manager which returns a JSON of hosts with the following structure: { "items" : [ { "hostId" : "ddcfbea6-8a7c-462c-38f9-0116338e438a", …
John Doe
  • 159
  • 1
  • 10
3
votes
1 answer

Can not start Cloudera Manger Server, because of RuntimeException: Upgrade not allowed from CM3.x

I had trouble installing Cloudera Manager(ver 5.8.3). I installed cloudera-manager-agent-5.8.3-1.cm583.p0.8.el6.x86_64, cloudera-manager-server-5.8.3-1.cm583.p0.8.el6.x86_64, cloudera-manager-daemons-5.8.3-1.cm583.p0.8.el6.x86_64 on CentOS 6.5…
Lee. YunSu
  • 416
  • 6
  • 21
3
votes
2 answers

Service Monitor did not find an active Master in HBase service

I made a cluster with one master node and three slaves using cloudera CDH 5.8.0. After some configuration work I got all the services healthy but one: HBase. Some few minutes after restarting it gets bad health. The error displayed from Cloudera…
daloman
  • 309
  • 3
  • 10
3
votes
1 answer

Cannot access embedded PostgreSQL database of Cloudera Manager

I'm having problems accessing the Cloudera Manager UI because of problems with the embedded PostgreSQL database. The web UI shows me: HTTP ERROR 500 Problem accessing /cmf/home. Reason: org.hibernate.exception.GenericJDBCException: Could not open…
Def_Os
  • 5,301
  • 5
  • 34
  • 63
3
votes
0 answers

How to increase the query size (POST) on Solr Cloud managed by CDH5.5?

We're using Solr Cloud as a component of Cloudera's CDH5.5. A colleague built an application that POSTing long queries that exceed the default maxFormContentSize (200,000 bytes). I ran a ps -ef on one of the cluster nodes, and see that Solr's…
Alex Woolford
  • 4,433
  • 11
  • 47
  • 80
3
votes
2 answers

cloudera host with bad health during install

Trying again & again with all required steps completed but cluster Installation when install selected Parcels, always shows every host with bad health. setup never completed at full. i am installing cm 5.5 on CentOS 6.7 using virtualbox. The…
Verka
  • 31
  • 1
  • 3
3
votes
1 answer

Running Spark job on YARN

I am trying to utilise all the resources which I have on the cluster to run the Spark job. I have Cloudera Manager installed on all of the nodes. This is the command which I use to submit the job. spark-submit --master yarn …
mr. Holiday
  • 1,780
  • 2
  • 19
  • 37
3
votes
1 answer

Quickstart VM Cloudera parcel won't start

I have a problem understanding something with the Cloudera Quickstart VM. Let me try to explain by outlining my steps so far. I want to write something using Kafka to connect to a web service and ingest a data feed. I'm going to use the Cloudera…
1
2
3
25 26