In SAP HANA Vora 1.2 on MapR 5.1/Spark 1.5.2 with Spark Controller 1.6 PL1:
I've configured the Spark Controller and started server. Successfully loaded the table and can be seen from VORA tools.
In SAP HANA Studio I can see now folder "spark_velocity" and "M_JCUST" in it, which I created. When I try to add this table my HANA folder with "Add as Virtual Table" option I receive an error:
SAP DBTech JDBC: [476]: invalid remote object name:
Unable to retrieve remote metadata for SparkSQL.spark_velocity.SparkSQL.spark_velocity.M_JCUST: line 0 col 0 (at pos 0)
/var/log/hanaes is below:
16/11/01 20:11:37 INFO Utils: freeing the buffer
16/11/01 20:11:37 INFO DefaultSource: Creating VoraRelation M_JCUST using an existing catalog table
16/11/01 20:11:37 INFO Utils: freeing the buffer
16/11/01 20:11:37 ERROR HanaVoraCatalog: Exception occurred in Lookup Relation
java.lang.ClassCastException: org.apache.spark.sql.sources.BaseRelationSource cannot be cast to org.apache.spark.sq
l.sources.BaseRelation
at org.apache.spark.sql.vora.hana.HanaVoraCatalog.getTableRelation(HanaVoraCatalog.scala:27)
at org.apache.spark.sql.hive.hana.CompositeCatalog$class.getTableRelation(HanaDBCatalog.scala:99)
at org.apache.spark.sql.hive.hana.HanaSimpleCatalog.getTableRelation(SparkCatalog.scala:44)
at org.apache.spark.sql.hive.hana.HanaSQLContext.getTableMetaNew(HanaSQLContext.scala:337)
at com.sap.hana.spark.network.CommandHandler.handleMessage(CommandRouter.scala:516)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2$$anon$1.run(CommandRouter.scala:272)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2$$anon$1.run(CommandRouter.scala:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1575)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2.applyOrElse(CommandRouter.scala:270)
at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
at com.sap.hana.spark.network.CommandHandler.aroundReceive(CommandRouter.scala:231)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke(ActorCell.scala:487)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
at akka.dispatch.Mailbox.run(Mailbox.scala:220)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
:
16/11/01 20:11:37 ERROR CommandHandler:
java.lang.NullPointerException
at org.apache.spark.sql.hive.hana.HanaSQLContext.getTableMetaNew(HanaSQLContext.scala:347)
at com.sap.hana.spark.network.CommandHandler.handleMessage(CommandRouter.scala:516)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2$$anon$1.run(CommandRouter.scala:272)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2$$anon$1.run(CommandRouter.scala:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1575)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2.applyOrElse(CommandRouter.scala:270)
at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
at com.sap.hana.spark.network.CommandHandler.aroundReceive(CommandRouter.scala:231)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke(ActorCell.scala:487)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
at akka.dispatch.Mailbox.run(Mailbox.scala:220)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/11/01 20:11:37 ERROR RequestOrchestrator: java.lang.NullPointerException
at org.apache.spark.sql.hive.hana.HanaSQLContext.getTableMetaNew(HanaSQLContext.scala:347)
at com.sap.hana.spark.network.CommandHandler.handleMessage(CommandRouter.scala:516)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2$$anon$1.run(CommandRouter.scala:272)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2$$anon$1.run(CommandRouter.scala:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1575)
at com.sap.hana.spark.network.CommandHandler$$anonfun$receive$2.applyOrElse(CommandRouter.scala:270)
at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
at com.sap.hana.spark.network.CommandHandler.aroundReceive(CommandRouter.scala:231)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke(ActorCell.scala:487)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
at akka.dispatch.Mailbox.run(Mailbox.scala:220)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
This issue is same issue as posted below: SAP HANA Vora 1.2 : Cannot load as virtual table in HANA Studio
But, I use SAP HANA SPS12, Spark Controller 1.6 PL1 with MapR Support and replaced spark-sap-datasources-1.2.33-assembly.jar correctly.
Any advice on this error ?
Thanks and regards Mana
