You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Giridharan Kesavan (JIRA)" <ji...@apache.org> on 2010/07/27 17:29:16 UTC
[jira] Created: (MAPREDUCE-1972) TestUserLogCleanup test cant clean
up the toBeDeleted
TestUserLogCleanup test cant clean up the toBeDeleted
-----------------------------------------------------
Key: MAPREDUCE-1972
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1972
Project: Hadoop Map/Reduce
Issue Type: Bug
Environment: http://hudson.zones.apache.org/hudson/view/Mapreduce/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/300
Reporter: Giridharan Kesavan
All the hudson patch test builds are failing as the Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs has a folder created by the following test which doesnt seem to have read permission.
Running org.apache.hadoop.mapred.TestUserLogCleanup
[exec] [junit] 2010-07-14 22:24:54,027 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
...........
[exec] [junit] 2010-07-14 22:24:54,373 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_20100714203911410_0002
[exec] [junit] 2010-07-14 22:24:54,374 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.373_7 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_test_0003
[exec] [junit] 2010-07-14 22:24:54,391 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs/toBeDeleted/2010-07-14_22-24-54.372_6
[exec] [junit] 2010-07-14 22:24:54,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
..............
[exec] [junit] 2010-07-14 22:24:54,441 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-2
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1972) TestUserLogCleanup test cant clean
up the toBeDeleted
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1972:
-----------------------------------------------
Attachment: TestUserLogCleanup.log
Attaching complete log for TestUserLogCleanup from the console output.
> TestUserLogCleanup test cant clean up the toBeDeleted
> -----------------------------------------------------
>
> Key: MAPREDUCE-1972
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1972
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Environment: http://hudson.zones.apache.org/hudson/view/Mapreduce/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/300
> Reporter: Giridharan Kesavan
> Attachments: TestUserLogCleanup.log
>
>
> All the hudson patch test builds are failing as the Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs has a folder created by the following test which doesnt seem to have read permission.
> Running org.apache.hadoop.mapred.TestUserLogCleanup
> [exec] [junit] 2010-07-14 22:24:54,027 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ...........
> [exec] [junit] 2010-07-14 22:24:54,373 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_20100714203911410_0002
> [exec] [junit] 2010-07-14 22:24:54,374 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.373_7 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_test_0003
> [exec] [junit] 2010-07-14 22:24:54,391 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs/toBeDeleted/2010-07-14_22-24-54.372_6
> [exec] [junit] 2010-07-14 22:24:54,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ..............
> [exec] [junit] 2010-07-14 22:24:54,441 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-2
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1972) TestUserLogCleanup test cant clean
up the toBeDeleted
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1972:
-----------------------------------------------
Attachment: TestCompressedEmptyMapOutputs.log
Test log which created the non-deletable user-log directory
> TestUserLogCleanup test cant clean up the toBeDeleted
> -----------------------------------------------------
>
> Key: MAPREDUCE-1972
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1972
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Environment: http://hudson.zones.apache.org/hudson/view/Mapreduce/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/300
> Reporter: Giridharan Kesavan
> Attachments: TestCompressedEmptyMapOutputs.log, TestUserLogCleanup.log
>
>
> All the hudson patch test builds are failing as the Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs has a folder created by the following test which doesnt seem to have read permission.
> Running org.apache.hadoop.mapred.TestUserLogCleanup
> [exec] [junit] 2010-07-14 22:24:54,027 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ...........
> [exec] [junit] 2010-07-14 22:24:54,373 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_20100714203911410_0002
> [exec] [junit] 2010-07-14 22:24:54,374 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.373_7 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_test_0003
> [exec] [junit] 2010-07-14 22:24:54,391 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs/toBeDeleted/2010-07-14_22-24-54.372_6
> [exec] [junit] 2010-07-14 22:24:54,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ..............
> [exec] [junit] 2010-07-14 22:24:54,441 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-2
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1972) TestUserLogCleanup test cant clean
up the toBeDeleted
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated MAPREDUCE-1972:
------------------------------------------
Priority: Blocker (was: Major)
updating the priority as this lets all the patch test builds fail.
> TestUserLogCleanup test cant clean up the toBeDeleted
> -----------------------------------------------------
>
> Key: MAPREDUCE-1972
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1972
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Environment: http://hudson.zones.apache.org/hudson/view/Mapreduce/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/300
> Reporter: Giridharan Kesavan
> Priority: Blocker
> Attachments: TestCompressedEmptyMapOutputs.log, TestUserLogCleanup.log
>
>
> All the hudson patch test builds are failing as the Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs has a folder created by the following test which doesnt seem to have read permission.
> Running org.apache.hadoop.mapred.TestUserLogCleanup
> [exec] [junit] 2010-07-14 22:24:54,027 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ...........
> [exec] [junit] 2010-07-14 22:24:54,373 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_20100714203911410_0002
> [exec] [junit] 2010-07-14 22:24:54,374 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.373_7 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_test_0003
> [exec] [junit] 2010-07-14 22:24:54,391 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs/toBeDeleted/2010-07-14_22-24-54.372_6
> [exec] [junit] 2010-07-14 22:24:54,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ..............
> [exec] [junit] 2010-07-14 22:24:54,441 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-2
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1972) TestUserLogCleanup test cant
clean up the toBeDeleted
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894825#action_12894825 ]
Giridharan Kesavan commented on MAPREDUCE-1972:
-----------------------------------------------
This is the permission that I see for the dir that gets created and ant clean is not able to delete this directory and fails all the builds.
d-wx--x--x 2 <user> <group> 4.0K 2010-07-30 08:04 attempt_20100730080321169_0003_m_000003_0
> TestUserLogCleanup test cant clean up the toBeDeleted
> -----------------------------------------------------
>
> Key: MAPREDUCE-1972
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1972
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Environment: http://hudson.zones.apache.org/hudson/view/Mapreduce/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/300
> Reporter: Giridharan Kesavan
> Priority: Blocker
> Attachments: TestCompressedEmptyMapOutputs.log, TestUserLogCleanup.log
>
>
> All the hudson patch test builds are failing as the Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs has a folder created by the following test which doesnt seem to have read permission.
> Running org.apache.hadoop.mapred.TestUserLogCleanup
> [exec] [junit] 2010-07-14 22:24:54,027 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ...........
> [exec] [junit] 2010-07-14 22:24:54,373 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_20100714203911410_0002
> [exec] [junit] 2010-07-14 22:24:54,374 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.373_7 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name job_test_0003
> [exec] [junit] 2010-07-14 22:24:54,391 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-24-54.372_6 on /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs with original name /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h4.grid.sp2.yahoo.net/trunk/build/test/logs/userlogs/toBeDeleted/2010-07-14_22-24-54.372_6
> [exec] [junit] 2010-07-14 22:24:54,405 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(174)) - Adding job_test_0001 for user-log deletion with retainTimeStamp:7200000
> ..............
> [exec] [junit] 2010-07-14 22:24:54,441 WARN util.MRAsyncDiskService (MRAsyncDiskService.java:run(214)) - Failure in deletion of toBeDeleted/2010-07-14_22-2
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.