Stack Overflow
Stack Overflow

Questions tagged [biginsights]

IBM InfoSphere BigInsights brings the power of Hadoop to the enterprise. Apache Hadoop is the open source software framework, used to reliably manage large volumes of structured and unstructured data.

IBM InfoSphere BigInsights

103 questions
0
votes
1 answer

HTTP/1.1 400 Bad Request executing oozie spark job

I'm trying to execute the spark oozie example on the oozie_spark branch against a BigInsights for Apache Hadoop basic cluster. The workflow.xml looks like this:
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

How can I download a file using the WebHDFS knox groovy library?

The WebHDFS examples shows how to list files and folders in hdfs, make a directory and upload a file using BigInsights WebHDFS? How can I adapt the examples to download a file for BigInsights WebHDFS?
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

how can I programmatically get the hostname for the BIGSQL_HEAD?

I need to programmatically retrieve the BIGSQL_HEAD hostname of my BigInsihgts on Cloud enterprise cluster from a script so I can automate connecting to that host. The BIGSQL_HEAD hostname is in Ambari - how can I retrieve this information using…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

where should HADOOP_HOME variable point to on BigInsights on Cloud?

I'd like to use the kite-dataset tool on BigInsights on cloud, and have installed it on the mastermanager node in my home folder as per the installation instructions: curl…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

Error: BigR[bigr.connect]: Required library 'BigRResultSet' could not be found

I'm trying to connect to bigr: connected <- bigr.connect( host = hostname, user = username, password = password, ssl = TRUE, trustStorePath = paste(projdir, "/truststore.jks", sep=""), trustStorePassword = "mypassword", …
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

Set up IBM Open Platform with an external Oracle Database

I'm a little confused when I try to install a single node IBM Open Platform cluster using an Oracle database as RDBMS. Firstly, I understand that the Hadoop part of the IBM Big Insights is not a modified version of the corresponding Apache version…
Cheloute
  • 783
  • 2
  • 11
  • 27
0
votes
2 answers

How to connect to remote hive running on BigInsights on Cloud from a Spark as a Service notebook?

I would like to connect to a hive service running on BigInsights from a spark notebook using jdbc. The jdbc url format is: jdbc:hive2://${env.hostname}:10000/default;ssl=true;sslTrustStore=./truststore.jks;trustStorePassword=mypassword; As you can…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
2 answers

how to select by index from a bigr.frame?

In standard r, I can select by index using something like the following: newdf <- df[1:4,] However, if I try the above on a bigr.frame, I get: Error: BigR[bigr.frame.[]]: The given filtering condition must be a logical bigr.vector. The…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
0 answers

bigr dataframe error 'do not know how to convert 'df$V3' to class “POSIXct”'

I'm trying to create a calculated column with bigr. First load the data: > df <- bigr.frame (dataPath = "/data.csv", dataSource="DEL", delimiter=",", header=F, coltypes = c("integer", "character",…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

how to delete a dataframe wirth BigR?

I have a dataframe created as such (from the BigR tutorials): airfile <- system.file("extdata", "airline.zip", package="bigr") airfile <- unzip(airfile, exdir = tempdir()) airR <- read.csv(airfile, stringsAsFactors=F) # Upload the data to the…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

BigInsight Quick Start Edition 4.1 - BigSheet can't access HDFS from WebUI

I have started to use BigInsight Quick Start Edition 4.1 and the BigSheet Service. I encountered following problem. I've started with this tutorial:…
steM
  • 1
  • 2
0
votes
2 answers

How to load a flat file(not delimited file) into HBase?

I am new to hbase and I have a flat file(not delimited file) that I would like to load into a single hbase table. Here is a preview of a row in my file: 0107E07201512310015071C11100747012015123100 I know fo example that from position 1 to 7 it's…
user3531429
  • 31
  • 3
0
votes
1 answer

IBM BlueMix - Provisioning a BigInsights 4 cluster

I am new to BlueMix and got registered yesterday. I am trying to follow the manual here (https://www.ng.bluemix.net/docs/services/BigInsights/index-gentopic1.html#provisioncluster) to provision a new cluster. Step 2 reads "From the IBM Bluemix…
Anand
  • 21
  • 1
0
votes
0 answers

Porting R code to BigR

I am trying to port existing R code, to BigR. But the dist method triggers an error in the ported code. Existing code: mydata <- read.csv2("mydata.csv",header=T, sep=";", dec=",") d1 <- dist(x = mydata,method = "euclidean") Ported code: …
peleitor
  • 459
  • 7
  • 24
0
votes
0 answers

How to load data into Hbase table from BIGSQL table?

I am new to Hadoop Development. In our company, we are using IBM BigInsights cluster and we are working on an HBASE project. We have a requirement to load data from HDFS to HBASE. To do that, I am familiar with 3 ways: 1. Load data from HDFS into…
LazyBones
  • 113
  • 6
1 2 3 4
5
6 7