You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mrunit.apache.org by "Jason E Tedor (JIRA)" <ji...@apache.org> on 2014/04/08 03:33:15 UTC
[jira] [Comment Edited] (MRUNIT-205) Add support for MultipleInput
[ https://issues.apache.org/jira/browse/MRUNIT-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962490#comment-13962490 ]
Jason E Tedor edited comment on MRUNIT-205 at 4/8/14 1:32 AM:
--------------------------------------------------------------
Attached is a patch that adds support for testing jobs that have multiple input sources (i.e., jobs that would use {{MultipleInputs}} in their job configuration).
The main contribution is {{org.apache.hadoop.mrunit.MultipleInputMapReduceDriver}} (old API) and {{org.apache.hadoop.mrunit.mapreduce.MultipleInputMapReduceDriver}} (new API). I have included multiple input versions of all of the unit tests in {{org.apache.hadoop.mrunit.TestMapReduceDriver}} and {{org.apache.hadoop.mrunit.mapreduce.TestMapReduceDriver}}, respectively.
The patch also includes a slight refactoring of already-existing classes to enable reuse in the above.
Please let me know your thoughts.
was (Author: jasonetedor):
Attached is a patch that adds support for testing jobs that have multiple input sources (i.e., jobs that would use {{MultipleInputs}} in their job configuration).
The patch includes a slight refactoring of already-existing classes to enable reuse.
The main contribution is {{org.apache.hadoop.mrunit.MultipleInputMapReduceDriver}} (old API) and {{org.apache.hadoop.mrunit.mapreduce.MultipleInputMapReduceDriver}} (new API). I have included multiple input versions of all of the unit tests in {{org.apache.hadoop.mrunit.TestMapReduceDriver}} and {{org.apache.hadoop.mrunit.mapreduce.TestMapReduceDriver}}, respectively.
Please let me know your thoughts.
> Add support for MultipleInput
> -----------------------------
>
> Key: MRUNIT-205
> URL: https://issues.apache.org/jira/browse/MRUNIT-205
> Project: MRUnit
> Issue Type: New Feature
> Reporter: Jason E Tedor
> Attachments: MRUNIT-205.patch
>
>
> Some MapReduce jobs have multiple input sources that can even feed different Mapper implementations within the same job.
> MRUnit does not have a driver that natively supports testing these types of jobs.
> Note that this is not the same as MRUNIT-64. However, there are comments in that ticket that adding such support could be a good feature.
--
This message was sent by Atlassian JIRA
(v6.2#6252)