在cdh5.3.0上安装pydop1.0.0-rc1

lokaqttq  于 2021-06-04  发布在  Hadoop
关注(0)|答案(1)|浏览(325)

我正在尝试在运行cdh5.3.0的linux服务器上升级到pydoop1.0.0-rc1。我能够在另一个运行cdh5.1.2的环境中完成安装。我运行命令“pip install--proxy-升级pydoop==1.0.0-rc1”,下载包并完成c++编译。当它到达java构建时失败:

running build_scripts                                                                                                  
creating build/scripts-2.7                                                                                             
copying and adjusting scripts/pydoop -> build/scripts-2.7                                                              
changing mode of build/scripts-2.7/pydoop from 644 to 755                                                              
hadoop_home: '/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/jars'                                                   
hadoop_version: '2.5.0-cdh5.3.0'                                                                                       
java_home: '/usr/java/latest'                                                                                          
Building java code for hadoop-2.5.0-cdh5.3.0                                                                           
Compiling Java classes                                                                                                 
src/v1/it/crs4/pydoop/NoSeparatorTextOutputFormat.java:31: cannot find symbol                                          
symbol  : class JobConf                                                                                                
location: package org.apache.hadoop.mapred                                                                             
import org.apache.hadoop.mapred.JobConf;                                                                               
                               ^                                                                                       
src/v1/it/crs4/pydoop/NoSeparatorTextOutputFormat.java:32: cannot find symbol                                          
symbol  : class RecordWriter                                                                                           
location: package org.apache.hadoop.mapred                                                                             
import org.apache.hadoop.mapred.RecordWriter;                                                                          
                               ^                                                                                       
src/v1/it/crs4/pydoop/NoSeparatorTextOutputFormat.java:33: cannot find symbol

基于日志记录,它有hadoop库的位置,所以我不知道下一步该怎么做?
这个版本的pydoop支持cdh5.3.0吗?有什么建议可以解决这个问题吗?
谢谢你的建议。
路易斯

hts6caw3

hts6caw31#

我是pydoop开发者。我在上一个pydoop发行版(1.0.0)上测试了cdh5.3.0,它成功了。也许最好的办法是删除以前的安装并重新运行:sudo pip install pydoop

相关问题