Stack Overflow
Stack Overflow

Questions tagged [analytics-engine]

IBM Analytics Engine - a single Hadoop and Spark service providing an environment to develop and deploy advanced analytics applications in minutes.

What is Analytics Engine?

Build and deploy clusters within minutes with simplified user experience, scalability, and reliability. Custom configure the environment. Administer through multiple interfaces. Scale on demand.

31 questions
0
votes
1 answer

How can I configure Analytics Engine use Hive LLAP using the Ambari UI?

Is Hive LLAP feature supported by IAE? If yes, how to enable it using the Ambari UI? I tried to enable based on a tutorial from Hortonworks but I am getting errors: $ hive Logging initialized using configuration in…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
2 answers

Error trying to provision Analytics Engine from IBM Cloud console: BXNIM0511E

I'm trying to provision an Analytics Engine. These are the steps that I followed: Log into IBM Cloud console Select a Standard Hourly instance for the UK Region Click on Configure ... I received the following error in my browser…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

How to read and write to hive tables from Apache Spark on Analytics Engine

I would like to use Spark on analytics engine from a Jupyter notebook in Watson Studio to be able to read and write to Hive tables, but it isn't clear how I can do this by just reading the Spark documentation. The reason that it isn't clear is that…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
2 answers

spark-submit command fails to connect to spark node for bluemix analytics engine service

I am trying to deploy spark application (Java) to spark engine as part of analytics engine service on Bluemix. I followed the step mention here…
Manoj K Sardana
  • 153
  • 1
  • 4
  • 14
0
votes
1 answer

How to generate the IAM access tokens for analytics engine requests using python?

The documentation for Analytics Engine provides a link to generate a IAM access tokens using the CLI, but I need to generate the token with an API call. This is the CLI approach: bx api https://api.ng.bluemix.net bx login
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

How to determine which services to restart after a configuration change?

I need to make some changes to my cluster using the Ambari API. After making the changes, I'm using the following code to restart all of the service: echo "stop and Start Services" curl -k -v --user $AMBARI_USER:$AMBARI_PASSWORD -H "X-Requested-By:…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

Use local jar files in IBM Analytics Engine

I'm trying to falimiarise myself with IBM Analytics Engine. I've managed to create a service and run an example application. I now wish to see how one of my applications runs on it. For this I need two jars(which currently sit on my Mac). I tried to…
pac
  • 491
  • 1
  • 7
  • 30
0
votes
1 answer

ssh-copy-id is copying my public key but I still need to enter my credentials when logging in to IAE

I'm trying to setup passwordless ssh access to my cluster. I've used ssh-copy-id clsadmin@my-clusterhostname and entered the cluster password when promoted. The output from ssh-copy-id shows: Number of key(s) added: 1 However, when I try to ssh…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

How can I replace 'system' libraries on IBM Analytics Engine?

To help debug an issue with a yarn application, I need to modify some of the system code on IAE to provide more debug output. I have retrieved this jar file from the cluster to my local machine: /usr/hdp/current/hadoop-client/hadoop-aws.jar I've…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

How to enable JVM debugging for yarn jobs on IBM Analytic Engine?

I have a problem with a yarn application running on IAE. One option that I would like try to investigate the issue is enabling JVM remote debugging so that I can connect from my IDE and step through the problematic code. Normally jvm options for…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

hadoop fs -copyFromLocal localfile.txt cos://remotefile.txt => Failed to create /disk2/s3a

I'm trying to upload a file to cloud object storage from IBM Analytics Engine: $ hadoop fs -copyFromLocal LICENSE-2.0.txt \ cos://xxxxx/LICENSE-2.0.txt However, I'm receiving warnings about failure to create disks: 18/01/26 17:47:47 WARN…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

How to reduce hdfs replication factor on IBM Analytics Engine?

How can I reduce the data replication factor on HDFS using IAE? The idea is to use all the available HDFS disk space for testing purposes. I have seen quite a few questions asking how to do this on other vendor’s Hadoop clusters but not on IBM…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
2 answers

How to retrieve the name node host name using Ambari?

The python-ambariclient library has an api for retrieving the host_components: ambari.services(service_name).components(component_name).host_components How can I extract the name_node for an IBM Analytics Engine cluster? I think I need to make the…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

ConnectionError connecting to IBM Analytics Engine

I'm trying to use the python-ambariclient with IBM Analytics Engine: $ pip install --quiet python-ambariclient Then from future.standard_library import install_aliases install_aliases() from urllib.parse import urlparse import json vcap =…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

How to programmatically retrieve the name node hostname?

The IBM Analytics Engine docs have the following instructions for getting the name node hostname: Go to Manage Cluster in IBM® Cloud and click the nodes tab to get the name node host name. It's the host name of the management-slave1 node type. How…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
2
3