Stack Overflow
Stack Overflow

Questions tagged [analytics-for-apache-hdp]

IBM Bluemix 'Analytics for Apache Hadoop' service.

For more information see: https://www.ng.bluemix.net/docs/#services/AnalyticsforHadoop/index.html#analyticsforhadoop

20 questions
2
votes
1 answer

How to add a column in the middle of a ORC partitioned hive table and still be able to query old partitioned files with new structure

Currently I have a Partitioned ORC "Managed" (Wrongly created as Internal first) Hive table in Prod with atleast 100 days worth of data partitioned by year,month,day(~16GB of data). This table has roughly 160 columns.Now my requirement is to Add a…
cheapcoder
  • 183
  • 1
  • 3
  • 12
2
votes
2 answers

Unable to view logs for yarn-resource-manager

I tried with various command and I still do have issues in viewing the yarn logs and here are the steps that I followed to view logs [root@iop-rm1 /]# yarn application -list 17/04/03 13:15:21 INFO client.RMProxy: Connecting to ResourceManager at…
klee
  • 1,554
  • 2
  • 19
  • 31
1
vote
2 answers

Q: Is Analytics for Apache Hadoop still available on Bluemix? (Not in my catalog for any geo)

I'm looking for the Analytics for Apache Hadoop service in Bluemix to try out SystemT Text Analytics for a project I'm working on. It seems like it's not available any more. It this the case? Is there any replacement or is the service just…
Tuukka Vartiainen
  • 11
  • 2
1
vote
1 answer

Analytics for Apache Hadoop - can I Import data by using Hadoop shell commands?

I'm trying to import data into my Analytics for Apache Hadoop instance using Hadoop shell commands. The Analytics for Apache Hadoop bluemix documentation provides a link to BigInsight documentation in the related links section. The link is:…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
vote
1 answer

Nodered boilerplate and Analytics for Apache Hadoop binding issue

I have created the nodered boilerplate and i have binded the Analytics for Apache Hadoop service. So it clearly appears as a binded service into the dashboard. But when I launch the Nodered app and add a HDFS node, I get the following…
edevregille
  • 209
  • 2
  • 12
1
vote
1 answer

Analytics for Apache Hadoop not visible in IBM Bluemix, why?

I am trying to run Hadoop Ibm Biginsights, but ibm bluemix not display. Details: I have registered (free trail) and login into ibm bluemix, but unfortunately in Service category, Analytics for Hadoop not appear in the bigdata session. please find…
Venu A Positive
  • 2,992
  • 2
  • 28
  • 31
0
votes
0 answers

how to Modify HDFS Configuration according to dedicated config group

we have HDP cluster with 528 data nodes machines  in Ambari HDFS Configs , we configured 3 config group because the following:  212 data nodes machine are with 32G 119 data nodes machines are with 64G 197 data nodes machines are with 128G so in…
Judy
  • 1,595
  • 6
  • 19
  • 41
0
votes
1 answer

Livy : Run spark job in yarn mode

Not able to run Spark job in yarn(cluster or client) mode through Livy, I am able to run spark job using Livy, but the jobs are running local mode and not visible on resource manager. I want to run these jobs in yarn-cluster mode. I am using…
Shantanu Sharma
  • 3,661
  • 1
  • 18
  • 39
0
votes
1 answer

Hive table creation in HDP using Apache Spark job

I have written following Scala program in Eclipse for reading a csv file from a location in HDFS and then saving that data into a hive table [I am using HDP2.4 sandbox running on my VMWare present on my local machine]: import…
Chauhan B
  • 461
  • 8
  • 27
0
votes
1 answer

Hive installation issue on Apache Ambari HDP 2.5

I am getting following error when I am intalling Hive on Apache Ambari. resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install hive2_2_5_3_0_37' returned 1. Error: Package:…
Jain Hemant
  • 150
  • 2
  • 19
0
votes
1 answer

tpc-ds does not load data to table (it generates data but stuck in the loadinf step, just load table 17 out of 24 and after does nothing)

i am working in the hive benchmarking https://github.com/hortonworks/hive-testbench i have a problem in loading data to tables. in face the TPC-ds data generator generates the data and then tryes to load them in tables but in table 17 out of 24…
Fardin Behboudi
  • 459
  • 4
  • 15
0
votes
1 answer

Adding new Node to Cluster using Ambari Cluster Install wizard

I've initially installed 2 slave nodes(node01, node02) cluster using Ambari Cluster Install wizard successfully. My Ambari Server is running on other node ( node 00 ). Problem is at the time of install wizard i gave only 2 slave node (because it…
Srinathji
  • 159
  • 1
  • 4
  • 14
0
votes
1 answer

Bluemix Analytics for Apache Hadoop Big SQL - How to access logs for debug?

I am using Big SQL from Analytics for Apache Hadoop in Bluemix and would like to look into logs in order to debug (e.g. map reduce job log - usually available under http://my-mapreduce-server.com:19888/jobhistory, bigsql.log from the Big SQL worker…
HLeu
  • 13
  • 2
0
votes
1 answer

Are Oozie Java Actions supported with Analytics for Apache Hadoop?

I've been trying to run a Shell Action on Analytics for Apache Hadoop, however I have run into some issues. For more information, see how to debug failed oozie workflows on Analytics for Apache Hadoop?. In response to the issues, I have asked…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
0 answers

how to debug failed oozie workflows on Analytics for Apache Hadoop?

I'm trying to run an oozie workflow on Bluemix Analytics for Apache Hadoop, but it it failing. The output from calling Workflow status is as follows: ... { "errorMessage": "Main class [org.apache.oozie.action.hadoop.ShellMain], exit…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
2