You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2011/01/15 02:39:46 UTC

[jira] Created: (MAPREDUCE-2268) With JVM reuse, JvmManager doesn't delete last workdir properly

With JVM reuse, JvmManager doesn't delete last workdir properly
---------------------------------------------------------------

                 Key: MAPREDUCE-2268
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2268
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: tasktracker
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon
            Priority: Blocker
             Fix For: 0.22.0


In JvmManager, when a Jvm exits, it tries to delete the workdir for {{initalContext.task}} which is null, hence throwing NPE. Currently this NPE is swallowed into the abyss.

We should catch exceptions out of the JvmRunner thread, add a test case that verifies this functionality, and fix this code to properly grab the last task.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] [Assigned] (MAPREDUCE-2268) With JVM reuse, JvmManager doesn't delete last workdir properly

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon reassigned MAPREDUCE-2268:
--------------------------------------

    Assignee:     (was: Todd Lipcon)

nope, no plans to work on this given the impl is different in 0.23

> With JVM reuse, JvmManager doesn't delete last workdir properly
> ---------------------------------------------------------------
>
>                 Key: MAPREDUCE-2268
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2268
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>            Reporter: Todd Lipcon
>             Fix For: 0.22.0
>
>
> In JvmManager, when a Jvm exits, it tries to delete the workdir for {{initalContext.task}} which is null, hence throwing NPE. Currently this NPE is swallowed into the abyss.
> We should catch exceptions out of the JvmRunner thread, add a test case that verifies this functionality, and fix this code to properly grab the last task.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2268) With JVM reuse, JvmManager doesn't delete last workdir properly

Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Konstantin Shvachko updated MAPREDUCE-2268:
-------------------------------------------

    Priority: Major  (was: Blocker)

Agree with Milind.
Todd, let me know if you plan to fix it soon.
Unblocking for now.

> With JVM reuse, JvmManager doesn't delete last workdir properly
> ---------------------------------------------------------------
>
>                 Key: MAPREDUCE-2268
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2268
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.22.0
>
>
> In JvmManager, when a Jvm exits, it tries to delete the workdir for {{initalContext.task}} which is null, hence throwing NPE. Currently this NPE is swallowed into the abyss.
> We should catch exceptions out of the JvmRunner thread, add a test case that verifies this functionality, and fix this code to properly grab the last task.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2268) With JVM reuse, JvmManager doesn't delete last workdir properly

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108197#comment-13108197 ] 

Milind Bhandarkar commented on MAPREDUCE-2268:
----------------------------------------------

jvm reuse has very limited use in practice, especially on a multi-tenant cluster. Also, with security enabled, jvm reuse tends to get used even more rarely. In the 0.22 release notes, we should make a note of this, and should make this jira not-a-blocker. Thoughts ?

> With JVM reuse, JvmManager doesn't delete last workdir properly
> ---------------------------------------------------------------
>
>                 Key: MAPREDUCE-2268
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2268
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Blocker
>             Fix For: 0.22.0
>
>
> In JvmManager, when a Jvm exits, it tries to delete the workdir for {{initalContext.task}} which is null, hence throwing NPE. Currently this NPE is swallowed into the abyss.
> We should catch exceptions out of the JvmRunner thread, add a test case that verifies this functionality, and fix this code to properly grab the last task.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira