Install sparklyr with initialize_connect error

Question

I'm trying to follow the simple guide on SparklyR, but it throws me errors right at the very beginning. I install SparklyR and a local version of Spark as written in the guide:

library("sparklyr")

spark_install(version="1.6.2")

I then open a connection, and here's where the error occurs:

sc <- spark_connect(master="local")

I get "R code execution error" and the following:

Using Spark: 2.2.0 Error in force(code) : Failed during initialize_connection: java.lang.ExceptionInInitializerError

score 0 · Answer 1 · answered Sep 15 '17 at 19:02

0

"1.6.2" is way old.

Does this work?

spark_install(version="2.2.0")
sc <- spark_connect(master="local", version="2.2.0)

answered Sep 15 '17 at 19:02

Charlie

11
2

I know it is old, I was trying to follow a tutorial. Actually I have tried 2.2.0, it still give me the same error – Akira Sep 16 '17 at 01:11

score 0 · Accepted Answer · answered Sep 20 '17 at 17:47

0

Actually the author of Sparklyr answered my question. Since I have both Java 8 and Java 9 installed, which Sparklyr is currently not working with Java 9. so I simply uninstall Java 9, then it works fine.

answered Sep 20 '17 at 17:47

Akira

273
5
15

Install sparklyr with initialize_connect error

2 Answers2