You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ravi Prakash (Commented) (JIRA)" <ji...@apache.org> on 2011/11/29 23:09:39 UTC
[jira] [Commented] (MAPREDUCE-3484) Job end notification method
should be called before stop() in handle(JobFinishEvent)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159574#comment-13159574 ]
Ravi Prakash commented on MAPREDUCE-3484:
-----------------------------------------
This is the exception we noticed. Although 2 more retries were left, the InterruptedException caused the notification to not happen.
{noformat}
2011-11-29 20:13:09,259 WARN [AsyncDispatcher event handler] org.mortbay.log: Job end notification to <someURL> failed
java.net.UnknownServiceException: no content-type
at java.net.URLConnection.getContentHandler(URLConnection.java:1192)
at java.net.URLConnection.getContent(URLConnection.java:689)
at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notifyURLOnce(JobEndNotifier.java:95)
at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notify(JobEndNotifier.java:139)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:397)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:370)
at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
at java.lang.Thread.run(Thread.java:619)
2011-11-29 20:13:09,259 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Job end notification interrupted for jobID : <some jobID>
java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notify(JobEndNotifier.java:141)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:397)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:370)
at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
at java.lang.Thread.run(Thread.java:619)
{noformat}
Does anyone know if I'm seeing the InterruptedException because the NM is trying to reclaim resources? i.e. did it try killing the AM process?
> Job end notification method should be called before stop() in handle(JobFinishEvent)
> ------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3484
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3484
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am, mrv2
> Affects Versions: 0.23.0
> Reporter: Ravi Prakash
> Assignee: Ravi Prakash
>
> We noticed JobEndNotifier was getting an InterruptedException before completing all its retries.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira