1

I tried to use lzo in my hive script, but got this error message. It seemed that I did not have the class for lzo in the classpath.

Did anyone else meet this problem before, how to fix this problem, maybe what I need to know is that where I can get the jar file for the lzo compression, thx.

frack
  • 49
  • 1
  • 2
  • 4
  • Is this applicable? [HIVE-2395](https://issues.apache.org/jira/browse/HIVE-2395) –  Sep 20 '11 at 03:42

2 Answers2

0

Lzo configuration is not correct in one (or all) of the nodes.

Add the following configuration in core-site.xml.

<property> 
  <name>io.compression.codecs</name> 
  <value>org.apache.hadoop.io.compress.DefaultCodec,com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec</value> 
</property> 
<property> 
  <name>io.compression.codec.lzo.class</name> 
  <value>com.hadoop.compression.lzo.LzoCodec</value> 
</property>
Charles Xu
  • 558
  • 5
  • 9
0

Here are some detailed instructions on how to setup LZO compression.

Praveen Sripati
  • 32,799
  • 16
  • 80
  • 117