将表数据从hadoop导出到mysql时出错

fnx2tebb  于 2021-07-15  发布在  Hadoop
关注(0)|答案(0)|浏览(204)

在使用sqoop export命令将表数据从hadoop导出到mysql时,我遇到以下错误:文件和目录有适当的权限和用户所有权。
使用的sqoop命令:

sqoop export --connect jdbc:mysql://localhost:3306/test --table retailinfo --username root --password abc --export-dir /user/root/ --fields-terminated-by ',' --lines-terminated-by '\n'

错误

21/01/16 11:45:27 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.15.1
21/01/16 11:45:27 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
21/01/16 11:45:27 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
21/01/16 11:45:27 INFO tool.CodeGenTool: Beginning code generation
21/01/16 11:45:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `retailinfo` AS t LIMIT 1
21/01/16 11:45:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `retailinfo` AS t LIMIT 1
21/01/16 11:45:27 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
Note: /tmp/sqoop-root/compile/776bbbaf6e0724cce128bb1fe8066127/retailinfo.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
21/01/16 11:45:29 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/776bbbaf6e0724cce128bb1fe8066127/retailinfo.jar
21/01/16 11:45:29 INFO mapreduce.ExportJobBase: Beginning export of retailinfo
21/01/16 11:45:29 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
21/01/16 11:45:30 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
21/01/16 11:45:30 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
21/01/16 11:45:30 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
21/01/16 11:45:30 INFO client.RMProxy: Connecting to ResourceManager at ip-172-31-60-27.ec2.internal/172.31.60.27:8032
21/01/16 11:45:32 INFO input.FileInputFormat: Total input paths to process : 2
21/01/16 11:45:32 INFO input.FileInputFormat: Total input paths to process : 2
21/01/16 11:45:32 INFO mapreduce.JobSubmitter: number of splits:3
21/01/16 11:45:32 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
21/01/16 11:45:32 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1610795706578_0002
21/01/16 11:45:32 INFO impl.YarnClientImpl: Submitted application application_1610795706578_0002
21/01/16 11:45:33 INFO mapreduce.Job: Running job: job_1610795706578_0002
21/01/16 11:45:37 INFO mapreduce.Job: Job job_1610795706578_0002 running in uber mode : false
21/01/16 11:45:37 INFO mapreduce.Job:  map 0% reduce 0%
21/01/16 11:45:37 INFO mapreduce.Job: Job job_1610795706578_0002 failed with state FAILED due to:**Application application_1610795706578_0002 failed 2 times due to AM Container for

appattempt\u 1610795706578\u 0002\u000002退出,退出代码:1**
Yarn错误日志:

yarn logs -applicationId application_1610795706578_0002

LogType:stderr
Log Upload Time:Sat Jan 16 10:42:09 +0000 2021
LogLength:1447
Log Contents:
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.service.CompositeService
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        ... 13 more

LogType:stdout
Log Upload Time:Sat Jan 16 10:42:09 +0000 2021
LogLength:0
Log Contents:

LogType:stderr
Log Upload Time:Sat Jan 16 10:42:09 +0000 2021
LogLength:1447
Log Contents:
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.service.CompositeService
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        ... 13 more

LogType:stdout
Log Upload Time:Sat Jan 16 10:42:09 +0000 2021
LogLength:0
Log Contents:

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题