You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2009/11/20 06:53:39 UTC
[jira] Created: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
-----------------------------------------------------------------------------------------------------
Key: MAPREDUCE-1225
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: tasktracker
Affects Versions: 0.21.0
Reporter: Vinod K V
Fix For: 0.21.0
This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1225:
-----------------------------------------------
Status: Resolved (was: Patch Available)
Hadoop Flags: [Reviewed]
Resolution: Fixed
I just committed this. Thanks Zhong !
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated MAPREDUCE-1225:
-------------------------------------
Status: Open (was: Patch Available)
Assignee: Zhong Wang
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhong Wang updated MAPREDUCE-1225:
----------------------------------
Attachment: MAPREDUCE-1225.patch
Grant license to ASF for inclusion in ASF works
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1225:
-----------------------------------------------
Status: Patch Available (was: Open)
Fix Version/s: 0.22.0
(was: 0.21.0)
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhong Wang updated MAPREDUCE-1225:
----------------------------------
Attachment: MAPREDUCE-1225.patch
Fix an error dir name in test case. The local path of workDir2 should be TEST_ROOT_DIR/workdir2.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879669#action_12879669 ]
Amareshwari Sriramadasu commented on MAPREDUCE-1225:
----------------------------------------------------
bq. -1 contrib tests.
Could not see the test report still. The failure is mostly because of MAPREDUCE-1834. Taking Giri's help for confirmation.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhong Wang updated MAPREDUCE-1225:
----------------------------------
Attachment: MAPREDUCE-1225.patch
Patch has attached.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12875998#action_12875998 ]
Hadoop QA commented on MAPREDUCE-1225:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12446428/MAPREDUCE-1225.patch
against trunk revision 951793.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/224/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/224/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/224/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/224/console
This message is automatically generated.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859278#action_12859278 ]
Hadoop QA commented on MAPREDUCE-1225:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12442309/MAPREDUCE-1225.patch
against trunk revision 936166.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/123/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/123/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/123/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/123/console
This message is automatically generated.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12864133#action_12864133 ]
Zhong Wang commented on MAPREDUCE-1225:
---------------------------------------
This patch has passed hudson test and people review for about half of a month. Should we commit this to mapreduce trunk?
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1225:
-----------------------------------------------
Status: Open (was: Patch Available)
Could not see the test report. Re-running through hudson.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858445#action_12858445 ]
Hadoop QA commented on MAPREDUCE-1225:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12442143/MAPREDUCE-1225.patch
against trunk revision 935427.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/118/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/118/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/118/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/118/console
This message is automatically generated.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1225:
-----------------------------------------------
Status: Open (was: Patch Available)
+1 Patch looks good.
I verified the new test in TestTrackerDistributedCacheManager is indeed a regression test. It failed without the fix.
Running the patch through hudson.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated MAPREDUCE-1225:
-------------------------------------
Attachment: MAPREDUCE-1225.patch
Patch went stale; merged with trunk
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858757#action_12858757 ]
Amareshwari Sriramadasu commented on MAPREDUCE-1225:
----------------------------------------------------
Comments on the patch :
* Calling the method checkCacheStatusValidity even for the cache that has not inited does not solve the problem. checkCacheStatusValidity does the check by calling isExistsAndFresh(). isExistsAndFresh does two checks :
## dfsFileStamp != confFileStamp
## dfsFileStamp != lcacheStatus.mtime
Here, the second check is not valid for the file that is not localized. So, isExistsAndFresh() always returns false after the patch. We should refactor the first check into a different method and call only that for cache that is not yet inited. Does that make sense?
* Can you add a unit test in TestTrackerDistributedCacheManager which fails without the patch and passes after the patch ?
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879729#action_12879729 ]
Hadoop QA commented on MAPREDUCE-1225:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12446428/MAPREDUCE-1225.patch
against trunk revision 955198.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/365/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/365/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/365/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/365/console
This message is automatically generated.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879738#action_12879738 ]
Amareshwari Sriramadasu commented on MAPREDUCE-1225:
----------------------------------------------------
Latest hudson run confirms the failure is because of MAPREDUCE-1834. I will check this in.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhong Wang updated MAPREDUCE-1225:
----------------------------------
Attachment: MAPREDUCE-1225.patch
Updated patch from Amareshwari. Patch does the following:
1. Refactor isExistsAndFresh(). Move the first check into checkStampSinceJobStarted().
2. Remove the fileStatus argument from localizeCache(), since this arg is never used.
3. Add a test case in testFreshness() to test whether changing stamp of uninited cache could fail a job.
4. Modify calls of getLocalCache in TestTrackerDistributedCacheManager to use the right timestamp.
Thanks a lot!
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859287#action_12859287 ]
Zhong Wang commented on MAPREDUCE-1225:
---------------------------------------
bq. -1 core tests. The patch failed core unit tests.
What's wrong with the core tests result? It seems not caused by this patch?
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1225:
-----------------------------------------------
Status: Open (was: Patch Available)
Submitting latest patch for hudson.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated MAPREDUCE-1225:
-------------------------------------
Status: Patch Available (was: Open)
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1225:
-----------------------------------------------
Status: Patch Available (was: Open)
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879482#action_12879482 ]
Hadoop QA commented on MAPREDUCE-1225:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12446428/MAPREDUCE-1225.patch
against trunk revision 955198.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/575/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/575/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/575/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/575/console
This message is automatically generated.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858794#action_12858794 ]
Zhong Wang commented on MAPREDUCE-1225:
---------------------------------------
Thanks Amareshwari! I will attach a new patch soon.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1225:
-----------------------------------------------
Status: Patch Available (was: Open)
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Assignee: Zhong Wang
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Zhong Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhong Wang updated MAPREDUCE-1225:
----------------------------------
Status: Patch Available (was: Open)
Affects Version/s: 0.22.0
We should check cache validity even if the cache has not inited.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1225) TT successfully localizes a task
even though the corresponding cache-file has already changed on DFS.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12860160#action_12860160 ]
Hadoop QA commented on MAPREDUCE-1225:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12442402/MAPREDUCE-1225.patch
against trunk revision 936166.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/360/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/360/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/360/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/360/console
This message is automatically generated.
> TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1225
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1225
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Vinod K V
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch, MAPREDUCE-1225.patch
>
>
> This happens with the first task of a job being localized on this TT. TT doesn't check if the file on DFS is fresh according to the timestamps set in job-conf during submission. After the first task incorrectly gets localized, all further tasks fail on this TT as expected.
> Found this issue while trying to improve test-case for MAPREUCE-913.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.