我正在尝试在运行cdh5.3.0的linux服务器上升级到pydoop1.0.0-rc1。我能够在另一个运行cdh5.1.2的环境中完成安装。我运行命令“pip install--proxy-升级pydoop==1.0.0-rc1”,下载包并完成c++编译。当它到达java构建时失败:
running build_scripts
creating build/scripts-2.7
copying and adjusting scripts/pydoop -> build/scripts-2.7
changing mode of build/scripts-2.7/pydoop from 644 to 755
hadoop_home: '/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/jars'
hadoop_version: '2.5.0-cdh5.3.0'
java_home: '/usr/java/latest'
Building java code for hadoop-2.5.0-cdh5.3.0
Compiling Java classes
src/v1/it/crs4/pydoop/NoSeparatorTextOutputFormat.java:31: cannot find symbol
symbol : class JobConf
location: package org.apache.hadoop.mapred
import org.apache.hadoop.mapred.JobConf;
^
src/v1/it/crs4/pydoop/NoSeparatorTextOutputFormat.java:32: cannot find symbol
symbol : class RecordWriter
location: package org.apache.hadoop.mapred
import org.apache.hadoop.mapred.RecordWriter;
^
src/v1/it/crs4/pydoop/NoSeparatorTextOutputFormat.java:33: cannot find symbol
基于日志记录,它有hadoop库的位置,所以我不知道下一步该怎么做?
这个版本的pydoop支持cdh5.3.0吗?有什么建议可以解决这个问题吗?
谢谢你的建议。
路易斯
1条答案
按热度按时间hts6caw31#
我是pydoop开发者。我在上一个pydoop发行版(1.0.0)上测试了cdh5.3.0,它成功了。也许最好的办法是删除以前的安装并重新运行:sudo pip install pydoop