You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arun C Murthy (Created) (JIRA)" <ji...@apache.org> on 2011/12/15 09:22:30 UTC

[jira] [Created] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
------------------------------------------------------------------------

                 Key: MAPREDUCE-3563
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 0.23.0
            Reporter: Arun C Murthy
            Assignee: Arun C Murthy


LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-3563:
-------------------------------------

    Component/s: mrv2
    
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173170#comment-13173170 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #133 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/133/])
    Merge -c 1220996 from trunk to branch-0.23 to fix MAPREDUCE-3563.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220997
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172724#comment-13172724 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1527 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1527/])
    MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220996
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172726#comment-13172726 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #307 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/307/])
    Merge -c 1220996 from trunk to branch-0.23 to fix MAPREDUCE-3563.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220997
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170044#comment-13170044 ] 

Hadoop QA commented on MAPREDUCE-3563:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12507484/MAPREDUCE-3563.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The applied patch generated 2298 javac compiler warnings (more than the trunk's current 2297 warnings).

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these unit tests:
                  org.apache.hadoop.yarn.server.resourcemanager.TestRMNodeTransitions

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1458//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1458//console

This message is automatically generated.
                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172745#comment-13172745 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1477 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1477/])
    MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220996
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170537#comment-13170537 ] 

Hadoop QA commented on MAPREDUCE-3563:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12507494/MAPREDUCE-3563.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 2 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The applied patch generated 2298 javac compiler warnings (more than the trunk's current 2297 warnings).

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these unit tests:
                  org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
                  org.apache.hadoop.mapreduce.v2.app.TestJobEndNotifier

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1463//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1463//console

This message is automatically generated.
                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-3563:
-------------------------------------

       Resolution: Fixed
    Fix Version/s: 0.23.1
           Status: Resolved  (was: Patch Available)

I just committed this. Thanks to Daniel for helping validate this for Pig.
                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173149#comment-13173149 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #113 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/113/])
    Merge -c 1220996 from trunk to branch-0.23 to fix MAPREDUCE-3563.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220997
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172727#comment-13172727 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1454 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1454/])
    MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220996
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-3563:
-------------------------------------

    Target Version/s: 0.23.1
              Status: Patch Available  (was: Open)
    
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172728#comment-13172728 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #296 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/296/])
    Merge -c 1220996 from trunk to branch-0.23 to fix MAPREDUCE-3563.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220997
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-3563:
-------------------------------------

    Attachment: MAPREDUCE-3563.patch

Added a unit test.
                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-3563:
-------------------------------------

    Status: Patch Available  (was: Open)
    
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Daniel Dai (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170550#comment-13170550 ] 

Daniel Dai commented on MAPREDUCE-3563:
---------------------------------------

+1. All relevant Pig tests pass.
                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-3563:
-------------------------------------

    Attachment: MAPREDUCE-3563.patch

Straight-fwd patch.
                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-3563:
-------------------------------------

    Status: Open  (was: Patch Available)
    
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172747#comment-13172747 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #318 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/318/])
    Merge -c 1220996 from trunk to branch-0.23 to fix MAPREDUCE-3563.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220997
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173189#comment-13173189 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #933 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/933/])
    MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220996
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3563) LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173144#comment-13173144 ] 

Hudson commented on MAPREDUCE-3563:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #900 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/900/])
    MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1220996
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapred/TestLocalModeWithNewApis.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/FileOutputCommitter.java

                
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3563
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3563
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3563.patch, MAPREDUCE-3563.patch
>
>
> LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter, ran into this debugging PIG-2347.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira