当我在Yarn上运行spark时，出了点问题。

cp "launch_container.sh" "/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/launch_container.sh"
chmod 640 "/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/launch_container.sh"

# Determining directory contents

echo "ls -l:" 1>"/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/directory.info"
ls -l 1>>"/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/directory.info"
echo "find -L . -maxdepth 5 -ls:" 1>>"/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/directory.info"
find -L . -maxdepth 5 -ls 1>>"/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/directory.info"
echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/directory.info"
find -L . -maxdepth 5 -type l -ls 1>>"/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/directory.info"
exec /bin/bash -c "$JAVA_HOME/bin/java -server -Xmx16384m -Djava.io.tmpdir=$PWD/tmp '-javaagent:java-inf-agent-1.0-SNAPSHOT.jar' -Dspark.yarn.app.container.log.dir=/mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004 org.apache.spark.deploy.yarn.ApplicationMaster --class 'org.apache.spark.deploy.PythonRunner' --primary-py-file run_xgboost.py --properties-file $PWD/__spark_conf__/__spark_conf__.properties 1> /mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/stdout 2> /mnt/hadoop/yarn/log/application_1586940528900_34220/container_1586940528900_34220_05_000004/stderr"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi

Log Type: stderr
Log Upload Time: Wed Jul 01 10:30:43 +0800 2020
Log Length: 81
Error opening zip file or JAR manifest missing : java-inf-agent-1.0-SNAPSHOT.jar

我通过以下方式提交代码：

spark-submit \
--master yarn  \
--deploy-mode cluster \
--executor-memory 8g \
--num-executors 50 \
--conf spark.default.parallelism=1000 \
--executor-cores 2 \
--driver-memory 16g \
--driver-cores 4 \
--jars /home/aspectjweaver-1.9.1.jar,/home/xgboost4j-0.90.jar \
--py-files /home/sparkxgb.zip \
--conf spark.pyspark.python=python run_xgboost.py