1

Deploy the presto on single node . when running Presto-cli ,i got following errors:

presto:default> select * from test1;
Query 20131116_233859_00005_5a2yh failed: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe org.apache.hadoop.hive.contrib.serde2.RegexSerDe does not exist)

hive is Operating normally. why prestodb was failed? my profile:

export JAVA_HOME=/usr/java
export JRE_HOME=/usr/java/jre
export HADOOP_HOME=/usr/hadoop
export HIVE_HOME=/usr/hive
export PRESTO_HOME=/usr/presto
export CLASSPATH=:.:$CLASSPATH:$JAVA_HOME/lib:$JRE_HOME:`find /usr/hadoop -name '*.jar' | grep -v 'test' | grep -v 'example' | perl -e '@jars=<STDIN>;chomp @jars; print join(":",@jars);'`:$PRESTO_HOME/lib:$HADOOP/lib:$HIVE_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PRESTO_HOME/bin:$HIVE_HOME/bin
export HADOOP_HEAPSIZE=4096

I got it,when the table of hive was created by RegEx, the presto-cli running failed. I had no idea. somebody help me please!

user2986668
  • 33
  • 1
  • 6

3 Answers3

3

On Master node:

  1. Place your RegexSerDe.jar into hive connectors plugin directory related to your hadoop distribution. (Ex: for hadoop2 distribution you may place JAR file to ../presto/plugin/hive-hadoop2/)

  2. Make sure the RegexSerDe.jar file has correct ownership as other jar files present in this directory.

  3. Restart the presto-server process. (sudo service presto-server restart). If this do not work, you may need to restart with launcher sudo /usr/lib/presto/bin/launcher restart

Repeat this on all slave nodes !

jc mannem
  • 2,293
  • 19
  • 23
  • Thanks a lot, It worked for me. In my case I was using *com.amazon.elasticmapreduce.JsonSerde* on my local setup. – ruseel Mar 25 '16 at 04:43
1

Followed the same process as you mentioned above getting same error any suggestions please.

Query failed: org/apache/hadoop/hive/serde2/SerDe

Using hive-hadoop2 version placed the serde jar in the following path

presto/plugin/hive-hadoop2/hive-serde-1.0.0.jar and restarted presto.

Sree Eedupuganti
  • 440
  • 5
  • 15
0

You have to put the SerDe jar inside the plugin directory (plugin/hive-cdh4). I didn't use RegexSerDe but it worked for CSVSerDe.

Pradatta
  • 3,000
  • 1
  • 18
  • 22