我创建了一个java操作,并使用cloudera的色调进行了部署。我注意到jar文件已被复制到工作区的/lib文件夹中,但被截断为64mb(发生在来自其他hdfs文件夹的jar文件和使用sharelib的情况下)。
我跟踪了https://community.cloudera.com/t5/batch-processing-and-workflow/oozie-java-action-classnotfoundexception/td-p/4761 但在将jar复制到workspace/lib文件夹后,工作流失败,出现服务器错误(500)。
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py 111 get_response
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/decorators.py 52 decorate
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/views/editor.py 335 submit_workflow
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/views/editor.py 356 _submit_workflow
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py 79 run
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py 144 deploy
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py 281 _do_as
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py 275 _copy_files
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py 480 copyfile
我没有发现与最大文件大小相关的oozie配置,也不确定它是否与hadoop配置相关。你见过这个案子吗?非常感谢你。
1条答案
按热度按时间8cdiaqws1#
不完全确定,但它可能已经报告在色调问题的链接