我正在尝试在oozie中运行一个sqoop作业,它将从mssqlserver获取数据。当我运行命令“oozie job-oozie”http://localhost:11000/oozie-config home/uadmin/ramesh/sqoop/job.properties-run“正在创建作业。但是当我检查作业信息的状态时,它是无限运行状态。
log of the oozie job:
2018-04-12 19:44:14,937 INFO ActionStartXCommand:520 - SERVER[hdn03.sasken.com] USER[root] GROUP[-] TOKEN[] APP[sqoop-wf] JOB[0000001-180412153027255-oozie-oozi-W] ACTION[0000001-180412153027255-oozie-oozi-W@:start:] Start action [0000001-180412153027255-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2018-04-12 19:44:14,938 INFO ActionStartXCommand:520 - SERVER[hdn03.sasken.com] USER[root] GROUP[-] TOKEN[] APP[sqoop-wf] JOB[0000001-180412153027255-oozie-oozi-W] ACTION[0000001-180412153027255-oozie-oozi-W@:start:] [***0000001-180412153027255-oozie-oozi-W@:start:***]Action status=DONE
2018-04-12 19:44:14,938 INFO ActionStartXCommand:520 - SERVER[hdn03.sasken.com] USER[root] GROUP[-] TOKEN[] APP[sqoop-wf] JOB[0000001-180412153027255-oozie-oozi-W] ACTION[0000001-180412153027255-oozie-oozi-W@:start:] [***0000001-180412153027255-oozie-oozi-W@:start:***]Action updated in DB!
2018-04-12 19:44:14,997 INFO WorkflowNotificationXCommand:520 - SERVER[hdn03.sasken.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-180412153027255-oozie-oozi-W] ACTION[0000001-180412153027255-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000001-180412153027255-oozie-oozi-W@:start:
2018-04-12 19:44:14,997 INFO WorkflowNotificationXCommand:520 - SERVER[hdn03.sasken.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-180412153027255-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000001-180412153027255-oozie-oozi-W
2018-04-12 19:44:15,012 INFO ActionStartXCommand:520 - SERVER[hdn03.sasken.com] USER[root] GROUP[-] TOKEN[] APP[sqoop-wf] JOB[0000001-180412153027255-oozie-oozi-W] ACTION[0000001-180412153027255-oozie-oozi-W@sqoop-node] Start action [0000001-180412153027255-oozie-oozi-W@sqoop-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
warning in oozie log:
SERVER[hdn03.sasken.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://hdn03.sasken.com:8020/user/sqoop_oozieJob/lib] does not exist
workflow
<?xml version="1.0" encoding="UTF-8"?>
<workflow-app xmlns="uri:oozie:workflow:0.2" name="sqoop-wf">
<start to="sqoop-node"/>
<action name="sqoop-node">
<sqoop xmlns="uri:oozie:sqoop-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<prepare>
<delete path="${nameNode}/user/${FileLocation}/output-data/sqoop"/>
<mkdir path="${nameNode}/user/${FileLocation}/output-data"/>
</prepare>
<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${queueName}</value>
</property>
</configuration>
<command>import --connect jdbc:sqlserver://10.1.38.21;username =sad;password =pass;database=sample --table usage1 --split-by RGE_IND --target-dir ${nameNode}/user/${FileLocation}/output-data</command>
</sqoop>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Sqoop failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>
job.properties
nameNode=hdfs://hdn03.sasken.com:8020
jobTracker=hdn04.sasken.com:2181
queueName=default
FileLocation=sqoop_oozieJob/sqoop
oozie.wf.application.path=${nameNode}/user/${FileLocation}/
我只是被什么错误打动了,有什么建议吗?
暂无答案!
目前还没有任何答案,快来回答吧!