我从下载了hadoop1.1.2http://apache.techartifact.com/mirror/hadoop/common/hadoop-1.1.2/hadoop-1.1.2-bin.tar.gz. 它的本机目录没有lzo本机libs。
$find~/softwares/hadoop-1.1.2/lib/native/
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.la
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.a
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so.1
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so.1.0.0
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.la
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.a
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so.1
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so.1.0.0$
当我在本地模式下使用pigserver运行pig脚本时，我看到以下错误
parquet.hadoop.badconfigurationexception:找不到类com.hadoop.compression.lzo.lzocodec
如何获取jar文件和本地人？
1条答案
按热度按时间7tofc5zh1#
lzo是gpl许可的，因此它不能与hadoop一起提供（与基于bsd的snappy不同），您可以从中构建lzohttps://github.com/toddlipcon/hadoop-lzo 或从下载https://code.google.com/p/hadoop-gpl-packing/