You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by "Sun, Lining" <Li...@intuit.com> on 2011/09/23 22:32:19 UTC
how to get notification event or action when coordinator timeout?
Hello,
How to get notification sla event or action notification url when coordinator is timeout, I tried both below, doesn't work.
oozie.coord.action.notification.url
sla:info
Thanks in advance.
Lining
Re: how to use job property in EL functions?
Posted by Ken Ernst <ke...@mobileposse.com>.
Michelle,
Thank you, both forms work.
Ken
On 9/29/11 4:21 PM, "Michelle Chiang" <mc...@yahoo-inc.com> wrote:
>
>Hi Ken,
>
>When refer to a variable in EL function, please try either
>
>${fs:fileSize(concat(hiveWarehousePath,'/myfile/part-m-00000')) ...}
>
>Or
>
>${fs:fileSize(concat(wf:conf('hiveWarehousePath'),'/myfile/part-m-00000'))
> ...}
>
>
>Thanks
>michelle
>
>
>
>-----Original Message-----
>From: Ken Ernst [mailto:kernst@mobileposse.com]
>Sent: Thursday, September 29, 2011 1:11 PM
>To: oozie-users@incubator.apache.org
>Subject: how to use job property in EL functions?
>
>I am trying to use a job property in an EL function so I can make a
>generic work flow. Is it possible to use job properties this way? Am I
>missing some form of escaping?
>
>The error I am getting is "Illegal character in path at index 1:
>${hiveWarehousePath}/myfile/part-m-00000" in the following XML.
>
> <decision name="my-decision">
> <switch>
> <case to="my-action-1">
> ${fs:fileSize('${hiveWarehousePath}/myfile/part-m-00000')
>gt 10 * GB}
> </case>
> <case to="my-action-2">
> ${fs:fileSize('/user/hive/warehouse/myfile/part-m-00000')
>lt 100 * MB}
> </case>
> <default to="my-action-3"/>
> </switch>
> </decision>
>
>
>Thanks.
>
>Ken
RE: how to use job property in EL functions?
Posted by Michelle Chiang <mc...@yahoo-inc.com>.
Hi Ken,
When refer to a variable in EL function, please try either
${fs:fileSize(concat(hiveWarehousePath,'/myfile/part-m-00000')) ...}
Or
${fs:fileSize(concat(wf:conf('hiveWarehousePath'),'/myfile/part-m-00000')) ...}
Thanks
michelle
-----Original Message-----
From: Ken Ernst [mailto:kernst@mobileposse.com]
Sent: Thursday, September 29, 2011 1:11 PM
To: oozie-users@incubator.apache.org
Subject: how to use job property in EL functions?
I am trying to use a job property in an EL function so I can make a generic work flow. Is it possible to use job properties this way? Am I missing some form of escaping?
The error I am getting is "Illegal character in path at index 1: ${hiveWarehousePath}/myfile/part-m-00000" in the following XML.
<decision name="my-decision">
<switch>
<case to="my-action-1">
${fs:fileSize('${hiveWarehousePath}/myfile/part-m-00000') gt 10 * GB}
</case>
<case to="my-action-2">
${fs:fileSize('/user/hive/warehouse/myfile/part-m-00000') lt 100 * MB}
</case>
<default to="my-action-3"/>
</switch>
</decision>
Thanks.
Ken
Re: how to get notification event or action when coordinator timeout?
Posted by Mohammad Islam <mi...@yahoo.com>.
Hi Lining,
Thanks for letting us know all the information. Something looks very fishy!
Let me dig into this further myself with the help of our QE member.
We will let you know.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Thursday, September 29, 2011 4:55 PM
Subject: RE: how to get notification event or action when coordinator timeout?
I did grep the log by actionId. The system was idle. Oozie version is 2.3.0-cdh3u1
Thanks.
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Thursday, September 29, 2011 3:31 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Thanks for the information.
I don't see any notification log after the action moved to TIMEOUT state at 2011-09-29 06:21:31.
Are you sure there is nothing after that for action # 9? It might not be there right-a-way. Just grep for that action id in the that log file and the later log.
Was the system overloaded?
Btw what version of Oozie you are using?
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: Mohammad Islam <mi...@yahoo.com>; "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Thursday, September 29, 2011 2:25 PM
Subject: RE: how to get notification event or action when coordinator timeout?
See below, thanks. Lining
ID : 0000052-110927211153504-oozie-oozi-C@9
------------------------------------------------------------------------------------------------------------------------------------
Action Number : 9
Console URL : -
Error Code : -
Error Message : -
External ID : -
External Status : -
Job ID : 0000052-110927211153504-oozie-oozi-C
Tracker URI : -
Created : 2011-09-29 06:17
Nominal Time : 2011-09-29 06:15
Status : TIMEDOUT
Last Modified : 2011-09-29 06:21
Missing Dependencies : hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:06,963 DEBUG CoordActionMaterializeCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] In storeToDB() action Id 0000052-110927211153504-oozie-oozi-C@9 Size of actionXml 3169
2011-09-29 06:17:07,072 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:07,073 DEBUG CoordActionNotification:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] Notification URL :http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?id=0000052-110927211153504-oozie-oozi-C@9&status=WAITING
2011-09-29 06:17:31,213 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,213 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,215 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:31,215 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:17:31,216 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:31,224 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:17:31,226 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,229 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,232 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:18:31,232 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:18:31,234 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:18:31,234 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:18:31,241 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:18:31,243 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,248 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,250 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:19:31,250 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:19:31,252 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:19:31,252 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:19:31,259 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:19:31,261 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,263 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,265 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:20:31,267 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:20:31,274 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:20:31,276 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,280 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,282 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:21:31,282 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:21:31,284 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:21:31,291 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:21:31,293 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,396 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9 of job Id :0000052-110927211153504-oozie-oozi-C. Timeout value is 5 mins
2011-09-29 06:21:31,398 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Thursday, September 29, 2011 12:33 PM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
It is good that we made some progress.
Now can you please provide this two information:
1. Run the following command : oozie job -info <actionid>
At least give us the value of "Last Modified :"
2. In oozie.log please look for the latest "STARTED Coordinator Notification" log message for the same actionId. Add more relevant logs too.
Note: actionID = <jo...@number>.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Thursday, September 29, 2011 10:17 AM
Subject: RE: how to get notification event or action when coordinator timeout?
It works, but, got status=WAITING only, don't get TIEMOUT that is I look for.
Thanks
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Wednesday, September 28, 2011 12:33 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
The output, that you pasted, is it for runConf or the normal conf from the table (COORD_ACTIONS).
Could you try adding this into your coord properties file:
oozie.coord.action.notification.url=http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining
Please let us know how it went.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: Mohammad Islam <mi...@yahoo.com>>; "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Tuesday, September 27, 2011 3:48 PM
Subject: RE: how to get notification event or action when coordinator timeout?
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>; Mohammad Islam <mi...@yahoo.com>>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>>" <oo...@incubator.apache.org>>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
RE: how to get notification event or action when coordinator
timeout?
Posted by "Sun, Lining" <Li...@intuit.com>.
I did grep the log by actionId. The system was idle. Oozie version is 2.3.0-cdh3u1
Thanks.
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Thursday, September 29, 2011 3:31 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Thanks for the information.
I don't see any notification log after the action moved to TIMEOUT state at 2011-09-29 06:21:31.
Are you sure there is nothing after that for action # 9? It might not be there right-a-way. Just grep for that action id in the that log file and the later log.
Was the system overloaded?
Btw what version of Oozie you are using?
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: Mohammad Islam <mi...@yahoo.com>; "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Thursday, September 29, 2011 2:25 PM
Subject: RE: how to get notification event or action when coordinator timeout?
See below, thanks. Lining
ID : 0000052-110927211153504-oozie-oozi-C@9
------------------------------------------------------------------------------------------------------------------------------------
Action Number : 9
Console URL : -
Error Code : -
Error Message : -
External ID : -
External Status : -
Job ID : 0000052-110927211153504-oozie-oozi-C
Tracker URI : -
Created : 2011-09-29 06:17
Nominal Time : 2011-09-29 06:15
Status : TIMEDOUT
Last Modified : 2011-09-29 06:21
Missing Dependencies : hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:06,963 DEBUG CoordActionMaterializeCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] In storeToDB() action Id 0000052-110927211153504-oozie-oozi-C@9 Size of actionXml 3169
2011-09-29 06:17:07,072 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:07,073 DEBUG CoordActionNotification:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] Notification URL :http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?id=0000052-110927211153504-oozie-oozi-C@9&status=WAITING
2011-09-29 06:17:31,213 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,213 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,215 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:31,215 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:17:31,216 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:31,224 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:17:31,226 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,229 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,232 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:18:31,232 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:18:31,234 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:18:31,234 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:18:31,241 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:18:31,243 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,248 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,250 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:19:31,250 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:19:31,252 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:19:31,252 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:19:31,259 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:19:31,261 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,263 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,265 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:20:31,267 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:20:31,274 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:20:31,276 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,280 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,282 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:21:31,282 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:21:31,284 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:21:31,291 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:21:31,293 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,396 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9 of job Id :0000052-110927211153504-oozie-oozi-C. Timeout value is 5 mins
2011-09-29 06:21:31,398 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Thursday, September 29, 2011 12:33 PM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
It is good that we made some progress.
Now can you please provide this two information:
1. Run the following command : oozie job -info <actionid>
At least give us the value of "Last Modified :"
2. In oozie.log please look for the latest "STARTED Coordinator Notification" log message for the same actionId. Add more relevant logs too.
Note: actionID = <jo...@number>.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Thursday, September 29, 2011 10:17 AM
Subject: RE: how to get notification event or action when coordinator timeout?
It works, but, got status=WAITING only, don't get TIEMOUT that is I look for.
Thanks
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Wednesday, September 28, 2011 12:33 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
The output, that you pasted, is it for runConf or the normal conf from the table (COORD_ACTIONS).
Could you try adding this into your coord properties file:
oozie.coord.action.notification.url=http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining
Please let us know how it went.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: Mohammad Islam <mi...@yahoo.com>>; "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Tuesday, September 27, 2011 3:48 PM
Subject: RE: how to get notification event or action when coordinator timeout?
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>; Mohammad Islam <mi...@yahoo.com>>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>>" <oo...@incubator.apache.org>>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
Re: how to get notification event or action when coordinator timeout?
Posted by Mohammad Islam <mi...@yahoo.com>.
Hi Lining,
Thanks for the information.
I don't see any notification log after the action moved to TIMEOUT state at 2011-09-29 06:21:31.
Are you sure there is nothing after that for action # 9? It might not be there right-a-way. Just grep for that action id in the that log file and the later log.
Was the system overloaded?
Btw what version of Oozie you are using?
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: Mohammad Islam <mi...@yahoo.com>; "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Thursday, September 29, 2011 2:25 PM
Subject: RE: how to get notification event or action when coordinator timeout?
See below, thanks. Lining
ID : 0000052-110927211153504-oozie-oozi-C@9
------------------------------------------------------------------------------------------------------------------------------------
Action Number : 9
Console URL : -
Error Code : -
Error Message : -
External ID : -
External Status : -
Job ID : 0000052-110927211153504-oozie-oozi-C
Tracker URI : -
Created : 2011-09-29 06:17
Nominal Time : 2011-09-29 06:15
Status : TIMEDOUT
Last Modified : 2011-09-29 06:21
Missing Dependencies : hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:06,963 DEBUG CoordActionMaterializeCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] In storeToDB() action Id 0000052-110927211153504-oozie-oozi-C@9 Size of actionXml 3169
2011-09-29 06:17:07,072 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:07,073 DEBUG CoordActionNotification:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] Notification URL :http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?id=0000052-110927211153504-oozie-oozi-C@9&status=WAITING
2011-09-29 06:17:31,213 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,213 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,215 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:31,215 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:17:31,216 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:31,224 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:17:31,226 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,229 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,232 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:18:31,232 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:18:31,234 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:18:31,234 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:18:31,241 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:18:31,243 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,248 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,250 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:19:31,250 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:19:31,252 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:19:31,252 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:19:31,259 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:19:31,261 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,263 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,265 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:20:31,267 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:20:31,274 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:20:31,276 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,280 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,282 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:21:31,282 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:21:31,284 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:21:31,291 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:21:31,293 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,396 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9 of job Id :0000052-110927211153504-oozie-oozi-C. Timeout value is 5 mins
2011-09-29 06:21:31,398 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Thursday, September 29, 2011 12:33 PM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
It is good that we made some progress.
Now can you please provide this two information:
1. Run the following command : oozie job -info <actionid>
At least give us the value of "Last Modified :"
2. In oozie.log please look for the latest "STARTED Coordinator Notification" log message for the same actionId. Add more relevant logs too.
Note: actionID = <jo...@number>.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Thursday, September 29, 2011 10:17 AM
Subject: RE: how to get notification event or action when coordinator timeout?
It works, but, got status=WAITING only, don't get TIEMOUT that is I look for.
Thanks
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Wednesday, September 28, 2011 12:33 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
The output, that you pasted, is it for runConf or the normal conf from the table (COORD_ACTIONS).
Could you try adding this into your coord properties file:
oozie.coord.action.notification.url=http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining
Please let us know how it went.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: Mohammad Islam <mi...@yahoo.com>>; "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Tuesday, September 27, 2011 3:48 PM
Subject: RE: how to get notification event or action when coordinator timeout?
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>; Mohammad Islam <mi...@yahoo.com>>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>>" <oo...@incubator.apache.org>>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
RE: how to get notification event or action when coordinator
timeout?
Posted by "Sun, Lining" <Li...@intuit.com>.
See below, thanks. Lining
ID : 0000052-110927211153504-oozie-oozi-C@9
------------------------------------------------------------------------------------------------------------------------------------
Action Number : 9
Console URL : -
Error Code : -
Error Message : -
External ID : -
External Status : -
Job ID : 0000052-110927211153504-oozie-oozi-C
Tracker URI : -
Created : 2011-09-29 06:17
Nominal Time : 2011-09-29 06:15
Status : TIMEDOUT
Last Modified : 2011-09-29 06:21
Missing Dependencies : hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:06,963 DEBUG CoordActionMaterializeCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] In storeToDB() action Id 0000052-110927211153504-oozie-oozi-C@9 Size of actionXml 3169
2011-09-29 06:17:07,072 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:07,073 DEBUG CoordActionNotification:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] Notification URL :http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?id=0000052-110927211153504-oozie-oozi-C@9&status=WAITING
2011-09-29 06:17:31,213 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED Coordinator Notification actionId=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,213 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:17:31,215 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:17:31,215 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:17:31,216 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:17:31,217 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:17:31,224 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:17:31,226 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[-] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,229 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:18:31,232 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:18:31,232 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:18:31,233 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:18:31,234 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:18:31,234 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:18:31,241 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:18:31,243 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,248 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:19:31,250 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:19:31,250 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:19:31,251 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:19:31,252 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:19:31,252 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:19:31,259 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:19:31,261 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,263 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:20:31,265 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:20:31,266 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:20:31,267 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:20:31,267 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:20:31,274 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:20:31,276 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,280 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,282 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] After store.get() for action ID 0000052-110927211153504-oozie-oozi-C@9 : WAITING
2011-09-29 06:21:31,282 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Action is in WAITING state.
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: Missing deps:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, NonResolvedList:
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkResolvedUris...
2011-09-29 06:21:31,283 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: In checkListOfPaths for: hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-30#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-15#hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-00
2011-09-29 06:21:31,284 DEBUG CoordActionInputCheckCommand:531 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] checking for the file hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45
2011-09-29 06:21:31,291 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] [0000052-110927211153504-oozie-oozi-C@9]::ActionInputCheck:: File:hdfs://rwa03.corp.intuit.net//flume/2011-09-29-05-45, Exists? :false
2011-09-29 06:21:31,293 INFO CoordActionInputCheckCommand:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordActionInputCheckCommand for actionid=0000052-110927211153504-oozie-oozi-C@9
2011-09-29 06:21:31,396 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] STARTED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9 of job Id :0000052-110927211153504-oozie-oozi-C. Timeout value is 5 mins
2011-09-29 06:21:31,398 INFO CoordActionTimeOut:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000052-110927211153504-oozie-oozi-C] ACTION[0000052-110927211153504-oozie-oozi-C@9] ENDED CoordinatorActionTimeOut for Action Id 0000052-110927211153504-oozie-oozi-C@9
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Thursday, September 29, 2011 12:33 PM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
It is good that we made some progress.
Now can you please provide this two information:
1. Run the following command : oozie job -info <actionid>
At least give us the value of "Last Modified :"
2. In oozie.log please look for the latest "STARTED Coordinator Notification" log message for the same actionId. Add more relevant logs too.
Note: actionID = <jo...@number>.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Thursday, September 29, 2011 10:17 AM
Subject: RE: how to get notification event or action when coordinator timeout?
It works, but, got status=WAITING only, don't get TIEMOUT that is I look for.
Thanks
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Wednesday, September 28, 2011 12:33 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
The output, that you pasted, is it for runConf or the normal conf from the table (COORD_ACTIONS).
Could you try adding this into your coord properties file:
oozie.coord.action.notification.url=http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining
Please let us know how it went.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: Mohammad Islam <mi...@yahoo.com>>; "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Tuesday, September 27, 2011 3:48 PM
Subject: RE: how to get notification event or action when coordinator timeout?
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<va...@intuit.com></value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>; Mohammad Islam <mi...@yahoo.com>>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>>" <oo...@incubator.apache.org>>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
how to use job property in EL functions?
Posted by Ken Ernst <ke...@mobileposse.com>.
I am trying to use a job property in an EL function so I can make a generic work flow. Is it possible to use job properties this way? Am I missing some form of escaping?
The error I am getting is "Illegal character in path at index 1: ${hiveWarehousePath}/myfile/part-m-00000" in the following XML.
<decision name="my-decision">
<switch>
<case to="my-action-1">
${fs:fileSize('${hiveWarehousePath}/myfile/part-m-00000') gt 10 * GB}
</case>
<case to="my-action-2">
${fs:fileSize('/user/hive/warehouse/myfile/part-m-00000') lt 100 * MB}
</case>
<default to="my-action-3"/>
</switch>
</decision>
Thanks.
Ken
Re: how to get notification event or action when coordinator timeout?
Posted by Mohammad Islam <mi...@yahoo.com>.
It is good that we made some progress.
Now can you please provide this two information:
1. Run the following command : oozie job -info <actionid>
At least give us the value of "Last Modified :"
2. In oozie.log please look for the latest "STARTED Coordinator Notification" log message for the same actionId. Add more relevant logs too.
Note: actionID = <jo...@number>.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Thursday, September 29, 2011 10:17 AM
Subject: RE: how to get notification event or action when coordinator timeout?
It works, but, got status=WAITING only, don't get TIEMOUT that is I look for.
Thanks
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Wednesday, September 28, 2011 12:33 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
The output, that you pasted, is it for runConf or the normal conf from the table (COORD_ACTIONS).
Could you try adding this into your coord properties file:
oozie.coord.action.notification.url=http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining
Please let us know how it went.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: Mohammad Islam <mi...@yahoo.com>; "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Tuesday, September 27, 2011 3:48 PM
Subject: RE: how to get notification event or action when coordinator timeout?
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
RE: how to get notification event or action when coordinator
timeout?
Posted by "Sun, Lining" <Li...@intuit.com>.
It works, but, got status=WAITING only, don't get TIEMOUT that is I look for.
Thanks
Lining
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Wednesday, September 28, 2011 12:33 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
The output, that you pasted, is it for runConf or the normal conf from the table (COORD_ACTIONS).
Could you try adding this into your coord properties file:
oozie.coord.action.notification.url=http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining
Please let us know how it went.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: Mohammad Islam <mi...@yahoo.com>; "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Tuesday, September 27, 2011 3:48 PM
Subject: RE: how to get notification event or action when coordinator timeout?
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
Re: how to get notification event or action when coordinator timeout?
Posted by Mohammad Islam <mi...@yahoo.com>.
Hi Lining,
The output, that you pasted, is it for runConf or the normal conf from the table (COORD_ACTIONS).
Could you try adding this into your coord properties file:
oozie.coord.action.notification.url=http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining
Please let us know how it went.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: Mohammad Islam <mi...@yahoo.com>; "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Tuesday, September 27, 2011 3:48 PM
Subject: RE: how to get notification event or action when coordinator timeout?
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
RE: how to get notification event or action when coordinator
timeout?
Posted by "Sun, Lining" <Li...@intuit.com>.
No, don't see it as below, what's the correct property name? do you have a working sample?
Thanks
Lining
<property>
<name>oozie.coord.application.path</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows/coordinator.xml</value>
</property>
<property>
<name>outputBaseDir</name>
<value>/redwood/output/beacons</value>
</property>
<property>
<name>coordinatorFrequency</name>
<value>60</value>
</property>
<property>
<name>hbaseConf</name>
<value>rwa05.corp.intuit.net:2181</value>
</property>
<property>
<name>reduceTasks</name>
<value>30</value>
</property>
<property>
<name>mapreduce.jobtracker.kerberos.principal</name>
<value>mapred/_HOST@LOCALHOST</value>
</property>
<property>
<name>endTime</name>
<value>2012-04-15T18:00Z</value>
</property>
<property>
<name>startTime</name>
<value>2011-09-27T20:15Z</value>
</property>
<property>
<name>slaSeContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>group.name</name>
<value>users</value>
</property>
<property>
<name>slaAlertContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>queueName</name>
<value>default</value>
</property>
<property>
<name>zookeeperQuorum</name>
<value>rwa05.corp.intuit.net</value>
</property>
<property>
<name>timeoutInterval</name>
<value>5</value>
</property>
<property>
<name>mysqlConf</name>
<value>rwa02.corp.intuit.net::rsAdmin::hadoop:hadoop</value>
</property>
<property>
<name>workflowAppPath</name>
<value>hdfs://rwa03.corp.intuit.net/redwood/workflows</value>
</property>
<property>
<name>datasetFrequency</name>
<value>15</value>
</property>
<property>
<name>ds_startTime</name>
<value>2011-09-27T19:00Z</value>
</property>
<property>
<name>slaQaContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>inputBaseDir</name>
<value>/flume</value>
</property>
<property>
<name>compress</name>
<value>ture</value>
</property>
<property>
<name>metricsConf</name>
<value>ganglia|org.apache.hadoop.metrics.ganglia.GangliaContext|rwa03.corp.intuit.net:8649</value>
</property>
<property>
<name>useTsvFormat</name>
<value>yes</value>
</property>
<property>
<name>user.name</name>
<value>lining</value>
</property>
<property>
<name>nameNode</name>
<value>hdfs://rwa03.corp.intuit.net/</value>
</property>
<property>
<name>slaDevContact</name>
<value>lining@intuit.com</value>
</property>
<property>
<name>jobTracker</name>
<value>rwa04.corp.intuit.net:8021</value>
</property>
<property>
<name>dfs.namenode.kerberos.principal</name>
<value>hdfs/_HOST@LOCALHOST</value>
</property>
</configuration> |
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Tuesday, September 27, 2011 12:13 AM
To: Sun, Lining; oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com<ma...@yahoo.com>]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>>
To: "oozie-users@incubator.apache.org<ma...@incubator.apache.org>" <oo...@incubator.apache.org>>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com<ma...@gmail.com>]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org<ma...@incubator.apache.org>
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
Re: how to get notification event or action when coordinator timeout?
Posted by Mohammad Islam <mi...@yahoo.com>.
Hi Lining,
It (the second line) clearly shows the code didn't get the notification URL.
Would you please go to your DB and run the SQL statements like :"Select actionId, runConf from COORD_ACTIONS where actionId = '0000015-110922175935058-oozie-oozi-C@1';
Some of the column names could be mis-spelled! Please send us the output.
The both conf columns should contain whatever you defined in <workflow><configuration>. Can you please check the both fields too?
Although code is threr to support the feature, I doubt this special feature was fully tested by Yahoo QE team. You can help us in debugging!
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>; Mohammad Islam <mi...@yahoo.com>
Sent: Monday, September 26, 2011 1:59 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
RE: how to get notification event or action when coordinator
timeout?
Posted by "Sun, Lining" <Li...@intuit.com>.
Found the relevant msg below, any clue why?
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] STARTED Coordinator Notification actionId=0000015-110922175935058-oozie-oozi-C@1 : WAITING
2011-09-23 16:56:14,542 INFO CoordActionNotification:525 - USER[lining] GROUP[users] TOKEN[] APP[redwood-beacon-process-cd] JOB[0000015-110922175935058-oozie-oozi-C] ACTION[-] No Notification URL is defined. Therefore nothing to notify for job 0000015-110922175935058-oozie-oozi-C action ID 0000015-110922175935058-oozie-oozi-C@1
-----Original Message-----
From: Mohammad Islam [mailto:mislam77@yahoo.com]
Sent: Monday, September 26, 2011 1:08 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
Re: how to get notification event or action when coordinator timeout?
Posted by Mohammad Islam <mi...@yahoo.com>.
do you see any relevant log in oozie.log?
In other words, do you see anything like "STARTED Coordinator Notification" in the log?
If yes, please send some more log attributed to class CoordActionNotificationXCommand.
Regards,
Mohammad
________________________________
From: "Sun, Lining" <Li...@intuit.com>
To: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Monday, September 26, 2011 12:30 PM
Subject: RE: how to get notification event or action when coordinator timeout?
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
Re: how to get notification event or action when coordinator timeout?
Posted by "Angelo K. Huang" <an...@apache.org>.
Did you try to add $status to your url for Oozie to propagate the status to
your system?
--angelo
On Mon, Sep 26, 2011 at 12:30 PM, Sun, Lining <Li...@intuit.com> wrote:
> Below is in my coordinator.xml,
>
> <workflow>
> <app-path>${workflowAppPath}</app-path>
> <configuration>
> <property>
> <name>oozie.coord.action.notification.url</name>
> <value>
> http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
> </property>
> <property>
>
> Thanks
>
> Lining
>
> -----Original Message-----
> From: Angelo K. Huang [mailto:angelohuang@gmail.com]
> Sent: Friday, September 23, 2011 3:30 PM
> To: oozie-users@incubator.apache.org
> Subject: Re: how to get notification event or action when coordinator
> timeout?
>
> Hi Lining,
>
> Could you show us how you do at coordinator.xml for
> oozie.coord.action.notification.url?
>
> Thanks,
> Angelo
>
> On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com>
> wrote:
>
> > Hello,
> >
> > How to get notification sla event or action notification url when
> > coordinator is timeout, I tried both below, doesn't work.
> > oozie.coord.action.notification.url
> > sla:info
> >
> > Thanks in advance.
> >
> > Lining
> >
>
RE: how to get notification event or action when coordinator
timeout?
Posted by "Sun, Lining" <Li...@intuit.com>.
Below is in my coordinator.xml,
<workflow>
<app-path>${workflowAppPath}</app-path>
<configuration>
<property>
<name>oozie.coord.action.notification.url</name>
<value>http://c00000010105.pharos.intuit.com/bugzilla/buglist.cgi?lining</value>
</property>
<property>
Thanks
Lining
-----Original Message-----
From: Angelo K. Huang [mailto:angelohuang@gmail.com]
Sent: Friday, September 23, 2011 3:30 PM
To: oozie-users@incubator.apache.org
Subject: Re: how to get notification event or action when coordinator timeout?
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>
Re: how to get notification event or action when coordinator timeout?
Posted by "Angelo K. Huang" <an...@gmail.com>.
Hi Lining,
Could you show us how you do at coordinator.xml for
oozie.coord.action.notification.url?
Thanks,
Angelo
On Fri, Sep 23, 2011 at 1:32 PM, Sun, Lining <Li...@intuit.com> wrote:
> Hello,
>
> How to get notification sla event or action notification url when
> coordinator is timeout, I tried both below, doesn't work.
> oozie.coord.action.notification.url
> sla:info
>
> Thanks in advance.
>
> Lining
>