You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org> on 2009/05/12 09:28:46 UTC

[jira] Created: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Job submission fails if hadoop.tmp.dir exists
---------------------------------------------

                 Key: HADOOP-5809
                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
             Project: Hadoop Core
          Issue Type: Bug
            Reporter: Sreekanth Ramakrishnan
            Priority: Critical


Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jothi Padmanabhan updated HADOOP-5809:
--------------------------------------

    Status: Patch Available  (was: Open)

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, hadoop-5809-v2.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12710971#action_12710971 ] 

Hadoop QA commented on HADOOP-5809:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12408265/HADOOP-5809-1.patch
  against trunk revision 776438.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/360/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/360/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/360/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/360/console

This message is automatically generated.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sreekanth Ramakrishnan updated HADOOP-5809:
-------------------------------------------

    Status: Patch Available  (was: Open)

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jothi Padmanabhan updated HADOOP-5809:
--------------------------------------

    Status: Open  (was: Patch Available)

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, hadoop-5809-v2.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709848#action_12709848 ] 

Sreekanth Ramakrishnan commented on HADOOP-5809:
------------------------------------------------

The issue cannot be unit tested as it is invoked when job client is called thro' mapred command. I have manually tested and verified the fix works.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sreekanth Ramakrishnan updated HADOOP-5809:
-------------------------------------------

    Attachment: HADOOP-5809-1.patch

Attaching the patch which incorporates the fix and has added a new test case.

Test case does following:

- Writes out a Java program which would create a file in {{test.data.dir}}.
- Use Compiler api to compile the java file.
- Create a runnable jar file from compiled class file.
- Use {{RunJar}} to execute the jar. If {{RunJar}} throws exception or VM exits, the test case reports a Failure/Error.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709629#action_12709629 ] 

Todd Lipcon commented on HADOOP-5809:
-------------------------------------

+1. Patch looks good to me, and I just ran into the same issue.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708731#action_12708731 ] 

Hadoop QA commented on HADOOP-5809:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12407853/HADOOP-5809.patch
  against trunk revision 774018.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no tests are needed for this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/331/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/331/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/331/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/331/console

This message is automatically generated.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Douglas updated HADOOP-5809:
----------------------------------

       Resolution: Fixed
    Fix Version/s: 0.21.0
         Assignee: Sreekanth Ramakrishnan
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

I committed this. Thanks Sreekanth and Jothi.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Assignee: Sreekanth Ramakrishnan
>            Priority: Critical
>             Fix For: 0.21.0
>
>         Attachments: HADOOP-5809-1.patch, hadoop-5809-v2.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sreekanth Ramakrishnan updated HADOOP-5809:
-------------------------------------------

    Status: Open  (was: Patch Available)

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709882#action_12709882 ] 

Devaraj Das commented on HADOOP-5809:
-------------------------------------

Could you add a testcase that would test this please. Thanks!

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sreekanth Ramakrishnan updated HADOOP-5809:
-------------------------------------------

    Status: Patch Available  (was: Open)

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Sreekanth Ramakrishnan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sreekanth Ramakrishnan updated HADOOP-5809:
-------------------------------------------

    Attachment: HADOOP-5809.patch

Attaching patch which fixes this issue. Submitted a sleep job to verify if the patch fixes the issue.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Philip Zeyliger (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12711371#action_12711371 ] 

Philip Zeyliger commented on HADOOP-5809:
-----------------------------------------

+1 on the patch.  This just bit me too.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718615#action_12718615 ] 

Hudson commented on HADOOP-5809:
--------------------------------

Integrated in Hadoop-trunk #863 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/863/])
    

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Assignee: Sreekanth Ramakrishnan
>            Priority: Critical
>             Fix For: 0.21.0
>
>         Attachments: HADOOP-5809-1.patch, hadoop-5809-v2.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709844#action_12709844 ] 

Amar Kamat commented on HADOOP-5809:
------------------------------------

Can someone plz take this forward and commit it.

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5809) Job submission fails if hadoop.tmp.dir exists

Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jothi Padmanabhan updated HADOOP-5809:
--------------------------------------

    Attachment: hadoop-5809-v2.patch

Simplifying the test case quite a bit

> Job submission fails if hadoop.tmp.dir exists
> ---------------------------------------------
>
>                 Key: HADOOP-5809
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5809
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Sreekanth Ramakrishnan
>            Priority: Critical
>         Attachments: HADOOP-5809-1.patch, hadoop-5809-v2.patch, HADOOP-5809.patch
>
>
> Currently in trunk, the job submission fails, stating "Mkdirs failed to create ${hadoop.tmp.dir}" 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.