错误2998:未处理的内部错误运行代码

quhf5bfb 于 2021-06-02 发布在 Hadoop

关注(0)|答案(1)|浏览(428)

执行以下命令 -x local -f /Hbase/load_hbase.pig 我得到以下错误

2014-11-08 23:36:47,455 [main] INFO  org.apache.pig.Main - Apache Pig version 0.12.1 (r1585011) compiled Apr 05 2014, 01:41:34
2014-11-08 23:36:47,455 [main] INFO  org.apache.pig.Main - Logging error messages to: /home/eduardo/pig_1415497007452.log
2014-11-08 23:36:47,817 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/eduardo/.pigbootup not found
2014-11-08 23:36:47,918 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
2014-11-08 23:36:48,436 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/filter/WritableByteArrayComparable

下面是我运行的代码：

raw_data = LOAD '/data/QCLCD201211/201201hourly.txt' USING PigStorage(',');
weather_data = FOREACH raw_data GENERATE $1, $10;
ranked_data = RANK weather_data;
final_data = FILTER ranked_data BY $0 IS NOT NULL;
STORE final_data INTO 'hbase://weather' 
         USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:date info:temp');

我不知道我做错了什么我会放下hadoop，hbase和pig的版本。hadoop:hadoop-1.2.1 hbase:hbase-0.96.2-hadoop1 pig:pig-0.12.1

hadoop hbase apache-pig hadoop-plugins

来源：https://stackoverflow.com/questions/26824026/error-2998-unhandled-internal-error-run-the-code

1条答案

按热度按时间

zour9fqk1#

在hadoop中复制pig jar和hbase jar
1）将这些文件复制到hadoop库。

sudo cp /usr/lib/pig/lib/pig-common-0.8.0-cdh3u0.jar  /usr/lib/hadoop/lib/
sudo cp /usr/lib/pig/lib/hbase-0.96.2-cdh3u0.jar  /usr/lib/hadoop/lib/
sudo cp /usr/lib/pig/lib/hbase-0.96.2-cdh3u0.jar  /usr/lib/hadoop/lib/

2）使用以下commond关闭hbase和hadoop

/usr/lib/hadoop/bin/stop-all.sh
/usr/lib/hbase/bin/stop-hbase.sh

3）使用commond重新启动hbase和hadoop

/usr/lib/hadoop/bin/start-all.sh
/usr/lib/hadoop/bin/start-hbase.sh

赞(0）回复(0）举报 2021-06-03

我来回答

错误2998:未处理的内部错误运行代码

1条答案

相关问题

热门标签

最新问答