You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2009/05/27 11:48:45 UTC

[jira] Created: (HADOOP-5920) TestJobHistory fails some times.

TestJobHistory fails some times.
--------------------------------

                 Key: HADOOP-5920
                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.21.0
            Reporter: Amareshwari Sriramadasu
             Fix For: 0.21.0


TestJobHistory fails sometimes with following Error:
User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist

Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Suman Sehgal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suman Sehgal updated HADOOP-5920:
---------------------------------

    Tags: ygridqa

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718362#action_12718362 ] 

Amar Kamat commented on HADOOP-5920:
------------------------------------

Looks like the issue it to do with 
# reuse of same mapred.system.dir and hadoop.log.dir
# restart



> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720843#action_12720843 ] 

Hudson commented on HADOOP-5920:
--------------------------------

Integrated in Hadoop-trunk #869 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/869/])
    . Fixes a testcase failure for TestJobHistory. Contributed by Amar Kamat.


> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amar Kamat
>             Fix For: 0.20.1
>
>         Attachments: HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12720117#action_12720117 ] 

Amar Kamat commented on HADOOP-5920:
------------------------------------

Tested this patch by setting the jobtracker identifier to a fixed value and jobtracker start-time to a different value. With this patch it passes always. 

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>         Attachments: HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amar Kamat updated HADOOP-5920:
-------------------------------

    Attachment: HADOOP-5920-v1.1-branch0.20.patch

Attaching a patch for branch 0.20.

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amar Kamat
>             Fix For: 0.20.1
>
>         Attachments: HADOOP-5920-v1.1-branch0.20.patch, HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amar Kamat updated HADOOP-5920:
-------------------------------

    Attachment: HADOOP-5920-v1.1.patch

Attaching a patch that deletes the mapred.system.dir and hadoop.log.history.location after every test. Result of test-patch
[exec] +1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
     [exec] 
     [exec]     +1 release audit.  The applied patch does not increase the total number of release audit warnings.

ant test passed on my box.

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>         Attachments: HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713726#action_12713726 ] 

Todd Lipcon commented on HADOOP-5920:
-------------------------------------

Anyone know what's up with this? Hints for where to start looking?

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amar Kamat updated HADOOP-5920:
-------------------------------

    Release Note: TestJobHistory fails as jobtracker is restarted very fast (within a minute) and history files from earlier testcases were not cleaned up. This patch cleans up the history-dir and mapred-system-dir after every test.

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amar Kamat
>             Fix For: 0.20.1
>
>         Attachments: HADOOP-5920-v1.1-branch0.20.patch, HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717554#action_12717554 ] 

Ravi Gummadi commented on HADOOP-5920:
--------------------------------------

Amar, Please run the test few times. Seems to be failing once in a while with that error.

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719943#action_12719943 ] 

Ravi Gummadi commented on HADOOP-5920:
--------------------------------------

If this doesn't happen in real world, then fixing the testcase should be fine.
Ran the testcase few times with the patch and passed.
+1

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>         Attachments: HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HADOOP-5920:
--------------------------------

    Assignee: Amar Kamat

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amar Kamat
>             Fix For: 0.20.1
>
>         Attachments: HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das resolved HADOOP-5920.
---------------------------------

       Resolution: Fixed
    Fix Version/s:     (was: 0.21.0)
                   0.20.1
     Hadoop Flags: [Reviewed]

I just committed this. Thanks, Amar!

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.20.1
>
>         Attachments: HADOOP-5920-v1.1.patch
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5920) TestJobHistory fails some times.

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717199#action_12717199 ] 

Amar Kamat commented on HADOOP-5920:
------------------------------------

I tried reproducing this error but I couldnt. Can anyone plz comment as to how to reproduce this bug. It never failed on my machine. 

> TestJobHistory fails some times.
> --------------------------------
>
>                 Key: HADOOP-5920
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5920
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.21.0
>
>
> TestJobHistory fails sometimes with following Error:
> User log file file:/home/hudson/hudson-slave/workspace/Hadoop-Patch-vesta.apache.org/trunk/build/test/data/succeed/output1/_logs/history/localhost_1243294208119_job_200905252330_0001_hudson_test-job-succeed does not exist
> Correspoding failure on the hudson is @ http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/398/testReport/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.