[jira] [Updated] (MAPREDUCE-3607) Port missing new API mapreduce lib classes to 1.x

["Tom White (Updated) (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated MAPREDUCE-3607:
---------------------------------

    Attachment: MAPREDUCE-3607.patch

Here's a new patch which adds FieldSelectionMapper/Reducer, NLineInputFormat, SequenceFile input/output formats, JobControl, and partition classes, along with tests for all of the classes.

The results of test-patch:

{noformat}
     [exec] -1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 100 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
     [exec] 
     [exec]     -1 findbugs.  The patch appears to introduce 5 new Findbugs (version 1.3.9) warnings.
{noformat}

Note the findbugs warnings are present in trunk too, since this is a backport. Tests pass.

I would like this to be considered for inclusion in 1.1.0.
                
> Port missing new API mapreduce lib classes to 1.x
> -------------------------------------------------
>
>                 Key: MAPREDUCE-3607
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3607
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: client
>    Affects Versions: 1.0.0
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: MAPREDUCE-3607.patch, MAPREDUCE-3607.patch
>
>
> There are a number of classes under mapreduce.lib that are not present in the 1.x series. Including these would help users and downstream projects using the new MapReduce API migrate to later versions of Hadoop in the future.
> A few examples of where this would help:
> * Sqoop uses mapreduce.lib.db.DBWritable and mapreduce.lib.input.CombineFileInputFormat (SQOOP-384).
> * Mahout uses mapreduce.lib.output.MultipleOutputs (MAHOUT-822).
> * HBase has a backport of mapreduce.lib.partition.InputSampler and TotalOrderPartitioner (in org.apache.hadoop.hbase.mapreduce.hadoopbackport) - it would be better if it used the ones in Hadoop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira