How to add a jar in zeppelin?

Question

How to add a jar in Zeppelin for %hive interpreter?

I have tried

%z.dep('');
add jar <jar path>

Also zeppelin hive interpreter throws ClassNotFoundException

Adding to ./interpreter/hive/ throughs thrift exception while add jar says file not found.

How to do it? I am trying to add jsonserde.jar by Amazon to parse DynamoDB imports.

Rockie Yang · Answer 1 · 2016-08-12T16:01:41.743

8

The recommended way is using Zeppelin's Dependency Management

It can add jar file or maven artifact.

the dependency jar will be downloaded to local-repo.

NOTE: If the jar file is compiled from source, when you compile again, it will NOT be synchronised automatically(download again). You need go to interpreter setting, click edit and OK will trigger another download to local-repo.

NOTE: If you use one scala version first, and compiled again with another version. It will report Exception in thread “main” java.lang.NoSuchMethodError: scala.reflect.api.JavaUniverse.runtimeMirror. remove already downloaded jar with rm -rf local-repo/*

NOTE: z.dep is deprecated.

edited Aug 12 '16 at 16:01

answered Aug 11 '16 at 04:30

Rockie Yang

4,725
31
34

1

This is cool! 1. What is the property name to add a jar which is stored locally on the host 2. What will the relative path from root or from Zeppelin install directory? – user 923227 Aug 11 '16 at 18:33
1

I just simply use absolute path. – Rockie Yang Aug 11 '16 at 20:07
What is the property name that you used? – user 923227 Aug 11 '16 at 21:29
It is NOT in `Properties` part. it is in `Dependencies` part – Rockie Yang Aug 11 '16 at 21:51
I do not have that segment. Possibly the zeppelin version is old. – user 923227 Aug 11 '16 at 22:07
This method is annoying because there is absolutely no way to automate it. The nice thing about using the %dep was that you could use the notebook API to load the jar – samthebest Dec 02 '16 at 21:03

score 4 · Answer 2 · answered Mar 11 '19 at 19:20

Updated on Zeppelin 0.8.x

You can now load external dependencies or jars using %dep or %spark.dep (if using Spark). Documentation is on zeppline website: Dynamic Dependency Loading

%dep z.load("/path/to/your/packages.jar")

or

%spark.dep
z.reset() // clean up previously added artifact and repository

// add maven repository
z.addRepo("RepoName").url("RepoURL")

// add maven snapshot repository
z.addRepo("RepoName").url("RepoURL").snapshot()

// add credentials for private maven repository
z.addRepo("RepoName").url("RepoURL").username("username").password("password")

score 2 · Answer 3 · answered Apr 30 '19 at 20:33

Example, tested in Zeppelin 0.8.1:

%dep
z.addRepo("Spark Packages Repo").url("http://dl.bintray.com/spark-packages/maven")
z.addRepo("OSS SNAPSHOTS").url("https://oss.sonatype.org/content/repositories/snapshots")
z.load("org.zouzias:spark-lucenerdd_2.11:0.3.7")

score 0 · Accepted Answer · answered Sep 22 '16 at 22:00

0

I have the version 0.5.6 for me the following worked:

%hive
add jar /home/hadoop/jsonserde.jar

answered Sep 22 '16 at 22:00

user 923227

2,528
4
27
46

no, it is not working because I am not using hive `org.apache.zeppelin.interpreter.InterpreterException: paragraph_1510199763504_1388344895's Interpreter %hiv not found` – Haha TTpro Nov 09 '17 at 04:04

How to add a jar in zeppelin?

4 Answers4

Updated on Zeppelin 0.8.x