0

I am trying to connect from a Plat 2.0.8 based Scala application to a Berkeley Shark context to fetch data from Shark tables. Can you please tell me how to do this. The Spark documentation is sparse. Thanks

ChrisGPT was on strike
  • 127,765
  • 105
  • 273
  • 257
user2941602
  • 1

2 Answers2

1

If you want to run SQL queries using Shark, Shark's sharkserver behaves like a regular Hive Thrift server, so you should be able to re-use existing Scala methods for connecting to Hive:

Shark Server also supports Hive's JDBC interface, so you can use that to run queries from Scala; just use the Shark Server's address in place of the Hive Server address.

Community
  • 1
  • 1
Josh Rosen
  • 13,511
  • 6
  • 58
  • 70
0

Shark 0.91 contains sharkserver2, and it equals hiveserver2 with hive version hive 0.11. So it could be connected by jdbc UI tools like "squirrel sql client" or others mentioned in hive page https://cwiki.apache.org/confluence/display/Hive/HiveJDBCInterface. Also it could work with cloudera HUE 2.5, but it could not work with HUE 3.5.

ahll
  • 2,329
  • 1
  • 19
  • 22