You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2010/08/25 11:19:17 UTC
[jira] Created: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
TestJobOutputCommitter fails in ant test run
--------------------------------------------
Key: MAPREDUCE-2032
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Reporter: Amareshwari Sriramadasu
TestJobOutputCommitter fails in a "ant test" run with following exception :
{noformat}
Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
{noformat}
But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905044#action_12905044 ]
Dick King commented on MAPREDUCE-2032:
--------------------------------------
I'll look into that when me back from vacation.
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904938#action_12904938 ]
Amareshwari Sriramadasu commented on MAPREDUCE-2032:
----------------------------------------------------
Can you delete the TEST_ROOT_DIR in tearDown, instead of deleting output directory in every testcase ?
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dick King updated MAPREDUCE-2032:
---------------------------------
Attachment: MR2032--2010-09-07--1628.patch
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dick King updated MAPREDUCE-2032:
---------------------------------
Status: Patch Available (was: Open)
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dick King updated MAPREDUCE-2032:
---------------------------------
Status: Patch Available (was: Open)
Release Note: Clears a problem that {{TestJobCleanup}} leaves behind files that cause {{TestJobOutputCommitter}} to error out.
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-2032:
-----------------------------------------------
Fix Version/s: 0.22.0
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Fix For: 0.22.0
>
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-2032:
-----------------------------------------------
Fix Version/s: 0.21.1
Committed the fix to branch 0.21 as well.
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Fix For: 0.21.1, 0.22.0
>
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-2032:
-----------------------------------------------
Status: Resolved (was: Patch Available)
Hadoop Flags: [Reviewed]
Resolution: Fixed
I just committed this. Thanks Dick !
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dick King updated MAPREDUCE-2032:
---------------------------------
Attachment: MR2032--2010-08-31--1513EDT.patch
I found the problem.
{{TestJobCleanup}} leaves behind files that cause {{TestJobOutputCommitter}} to error out.
This patch, which I ripped out of MAPREDUCE-323 , solves this bug. If it gets committed, I'll strip it from MAPREDUCE-323 .
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Attachments: MR2032--2010-08-31--1513EDT.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated MAPREDUCE-2032:
------------------------------------------
Status: Patch Available (was: Open)
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dick King updated MAPREDUCE-2032:
---------------------------------
Status: Open (was: Patch Available)
I honored the request made in a previous comment
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Giridharan Kesavan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated MAPREDUCE-2032:
------------------------------------------
Status: Open (was: Patch Available)
re-submitting for hudson
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907130#action_12907130 ]
Amareshwari Sriramadasu commented on MAPREDUCE-2032:
----------------------------------------------------
+1 for the patch.
Test passes now during ant test run. Will commit this.
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dick King reassigned MAPREDUCE-2032:
------------------------------------
Assignee: Dick King
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Attachments: MR2032--2010-08-31--1513EDT.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926068#action_12926068 ]
Hudson commented on MAPREDUCE-2032:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See [https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/])
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
> Assignee: Dick King
> Fix For: 0.21.1, 0.22.0
>
> Attachments: MR2032--2010-08-31--1513EDT.patch, MR2032--2010-09-07--1628.patch
>
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2032) TestJobOutputCommitter fails in
ant test run
Posted by "Dick King (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904734#action_12904734 ]
Dick King commented on MAPREDUCE-2032:
--------------------------------------
I assume we have a convention that tests don't leave junk behind, as opposed to having a convention that tests clean out all possible junk before they start.
> TestJobOutputCommitter fails in ant test run
> --------------------------------------------
>
> Key: MAPREDUCE-2032
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2032
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Amareshwari Sriramadasu
>
> TestJobOutputCommitter fails in a "ant test" run with following exception :
> {noformat}
> Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> org.apache.hadoop.fs.FileAlreadyExistsException: Output directory /home/amarsri/mapred/build/test/data/test-job-cleanup/output-2 already exists
> at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:141)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:391)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:350)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1037)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1034)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1034)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testKilledJob(TestJobOutputCommitter.java:192)
> at org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter.testDefaultCleanupAndAbort(TestJobOutputCommitter.java:232)
> {noformat}
> But it passes when it is run individually.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.