oozie-jar文件在复制到cloudera上的lib文件夹时被截断

icnyk63a  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(319)

我创建了一个java操作,并使用cloudera的色调进行了部署。我注意到jar文件已被复制到工作区的/lib文件夹中,但被截断为64mb(发生在来自其他hdfs文件夹的jar文件和使用sharelib的情况下)。
我跟踪了https://community.cloudera.com/t5/batch-processing-and-workflow/oozie-java-action-classnotfoundexception/td-p/4761 但在将jar复制到workspace/lib文件夹后,工作流失败,出现服务器错误(500)。

/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/build/env/lib/python2.6/site-packages/Django-1.4.5-py2.6.egg/django/core/handlers/base.py  111     get_response
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/decorators.py     52  decorate
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/views/editor.py   335     submit_workflow
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/apps/oozie/src/oozie/views/editor.py   356     _submit_workflow
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   79  run
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   144     deploy
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   281     _do_as
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/liboozie/src/liboozie/submittion.py   275     _copy_files
/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py   480     copyfile

我没有发现与最大文件大小相关的oozie配置,也不确定它是否与hadoop配置相关。你见过这个案子吗?非常感谢你。

8cdiaqws

8cdiaqws1#

不完全确定,但它可能已经报告在色调问题的链接

相关问题