You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "pharrell.wang (JIRA)" <ji...@apache.org> on 2018/08/09 11:13:00 UTC
[jira] [Commented] (OOZIE-3325) Oozie running shell script times
wrong, but hadoopjob running ok
[ https://issues.apache.org/jira/browse/OOZIE-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574699#comment-16574699 ]
pharrell.wang commented on OOZIE-3325:
--------------------------------------
Job Configuration：
<configuration>
<property>
<name>end_date</name>
<value>2028-08-15T14:36+0800</value>
</property>
<property>
<name>wf_application_path</name>
<value>hdfs://emr-cluster:8020/user/bjwwyl/hue/workspaces/workflow-1533625234.69/hue-oozie-1533625234.69</value>
</property>
<property>
<name>oozie.use.system.libpath</name>
<value>True</value>
</property>
<property>
<name>dryrun</name>
<value>False</value>
</property>
<property>
<name>security_enabled</name>
<value>False</value>
</property>
<property>
<name>oozie.coord.action.nominal_time</name>
<value>1533717000000</value>
</property>
<property>
<name>coord.nominal.time</name>
<value>2018-08-08 16:30:00.0</value>
</property>
<property>
<name>user.name</name>
<value>bjwwyl</value>
</property>
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://emr-cluster:8020/user/hue/oozie/deployments/_bjwwyl_-oozie-367-1533710641.93</value>
</property>
<property>
<name>mapreduce.job.user.name</name>
<value>bjwwyl</value>
</property>
<property>
<name>coord.id</name>
<value>0000208-180724190149594-oozie-oozi-C@2</value>
</property>
<property>
<name>oozie.wf.application.path</name>
<value>hdfs://emr-cluster:8020/user/bjwwyl/hue/workspaces/workflow-1533625234.69/hue-oozie-1533625234.69</value>
</property>
<property>
<name>coord.name</name>
<value>vpn_hour_schedule</value>
</property>
<property>
<name>jobTracker</name>
<value>rm1</value>
</property>
<property>
<name>hue-id-c</name>
<value>367</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://emr-cluster:8020</value>
</property>
<property>
<name>start_date</name>
<value>2018-08-08T15:00+0800</value>
</property>
</configuration>
> Oozie running shell script times wrong, but hadoopjob running ok
> ----------------------------------------------------------------
>
> Key: OOZIE-3325
> URL: https://issues.apache.org/jira/browse/OOZIE-3325
> Project: Oozie
> Issue Type: Bug
> Reporter: pharrell.wang
> Priority: Major
>
> **Log as follows
> 2018-08-08 16:38:39,461 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
> 2018-08-08 16:38:39,466 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
> 2018-08-08 16:38:49,461 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
> 2018-08-08 16:38:49,466 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
> 2018-08-08 16:38:59,451 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
> 2018-08-08 16:38:59,457 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
> 2018-08-08 16:39:09,466 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
> 2018-08-08 16:39:09,471 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
> 2018-08-08 16:39:19,467 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
> 2018-08-08 16:39:19,472 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
> 2018-08-08 16:39:29,468 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
> 2018-08-08 16:39:29,473 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
> 2018-08-08 16:39:39,456 WARN SshActionExecutor:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Execution data not set
> 2018-08-08 16:39:39,461 WARN CoordActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] Unexpected workflow 0000212-180724190149594-oozie-oozi-W STATUS RUNNING
> 2018-08-08 16:39:49,837 WARN ActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Exception while executing check(). Error Code [ERR_UNKNOWN_ERROR], Message[ERR_UNKNOWN_ERROR: unknown error]
> org.apache.oozie.action.ActionExecutorException: ERR_UNKNOWN_ERROR: unknown error
> at org.apache.oozie.action.ssh.SshActionExecutor.check(SshActionExecutor.java:156)
> at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:182)
> at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
> at org.apache.oozie.command.XCommand.call(XCommand.java:290)
> at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:334)
> at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:263)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:181)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.oozie.action.ActionExecutorException: unknown error
> at org.apache.oozie.action.ssh.SshActionExecutor.check(SshActionExecutor.java:148)
> ... 10 more
> 2018-08-08 16:39:49,838 WARN ActionCheckXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Failing Job due to failed action [ssh-abd3]
> 2018-08-08 16:39:49,841 WARN LiteWorkflowInstance:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000212-180724190149594-oozie-oozi-W] ACTION[0000212-180724190149594-oozie-oozi-W@ssh-abd3] Workflow Failed. Failing node [ssh-abd3]
> 2018-08-08 16:39:49,862 WARN CoordActionUpdateXCommand:523 - SERVER[wwyl-02p10-hadoopclient] USER[bjwwyl] GROUP[-] TOKEN[] APP[vpn_hour_shell] JOB[0000208-180724190149594-oozie-oozi-C] ACTION[0000208-180724190149594-oozie-oozi-C@2] E1100: Command precondition does not hold before execution, [, workflow is FAILED and coordinator action is FAILED and pending false], Error Code: E1100
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)