Spark on Hbase Jars

Question

I am trying to run an example of SparkOnHbase as mentioned here -> Spark On Hbase

But i am just trying to compile and run the code on my local windows machine. My build.sbt snippet below

scalaVersion := "2.11.8"

libraryDependencies +="org.apache.spark" % "spark-core_2.11" % "2.1.0"
libraryDependencies += "com.typesafe" % "config" % "1.3.1"
libraryDependencies += "org.apache.hbase" % "hbase-client" % "1.3.1"
libraryDependencies += "org.apache.hbase" % "hbase-server" % "1.3.1"
libraryDependencies += "org.apache.hbase" % "hbase-common" % "1.3.1"

And as mentioned in the Link i am just trying to put this code :

val hbaseContext = new HBaseContext(sc, config)
rdd.hbaseBulkDelete(hbaseContext,
                  tableName,
                  putRecord => new Delete(putRecord),
                  4)

But i am not even getting HbaseContext. I don't know which package to import

gorros · Answer 1 · 2017-09-20T16:44:04.857

0

I use Maven, but dependencies should be the same. I assume you are missing this dependency:

<dependency>
<groupId>org.apache.hbase</groupId>
<artifactId>hbase-spark</artifactId>
<version>1.2.0-cdh5.7.0</version>
</dependency>

edited Sep 20 '17 at 16:44

answered Sep 20 '17 at 12:33

gorros

1,411
1
18
29

I did not any such dependency by name hbase-spark on maven website. I am not looking for a cloudera version as of now – AJm Sep 20 '17 at 15:05
Actually I use Cloudera version – gorros Sep 20 '17 at 15:23
Well i can try with the Cloudera Version too let me know the dependencies that worked for u – AJm Sep 20 '17 at 15:27
Hello, did that help @AJm I am mapr user and i am facing the same problem. My spark hbase dependency version is 2.0.0-alpha4 – Kanav Sharma Jun 01 '19 at 15:47

Spark on Hbase Jars

1 Answers1