You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Yiping Han (JIRA)" <ji...@apache.org> on 2008/03/22 00:19:24 UTC

[jira] Created: (HADOOP-3072) Multiple mappers join into reducer

Multiple mappers join into reducer
----------------------------------

                 Key: HADOOP-3072
                 URL: https://issues.apache.org/jira/browse/HADOOP-3072
             Project: Hadoop Core
          Issue Type: New Feature
          Components: mapred
            Reporter: Yiping Han


We would like to have multiple different mappers that takes input from different locations and output records with the same format. So the output of the mappers could be joint in the reducer easily. We know this can be achieved in the current framework. But the way to achieve it is not natural, less flexibility (need code change). Thus this would be a convenient feature to have. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Re: [jira] Created: (HADOOP-3072) Multiple mappers join into reducer

Posted by arkady borkovsky <ar...@yahoo-inc.com>.
Can you suggest the API?
Currently, you check the input name and select the Map action -- how  
do you suggest to parametrize it more naturally?  (I'm with you --  
but there are many ways to skin a cat...)
--ab
On Mar 21, 2008, at 4:19 PM, Yiping Han (JIRA) wrote:

> Multiple mappers join into reducer
> ----------------------------------
>
>                  Key: HADOOP-3072
>                  URL: https://issues.apache.org/jira/browse/ 
> HADOOP-3072
>              Project: Hadoop Core
>           Issue Type: New Feature
>           Components: mapred
>             Reporter: Yiping Han
>
>
> We would like to have multiple different mappers that takes input  
> from different locations and output records with the same format.  
> So the output of the mappers could be joint in the reducer easily.  
> We know this can be achieved in the current framework. But the way  
> to achieve it is not natural, less flexibility (need code change).  
> Thus this would be a convenient feature to have.
>
> -- 
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>


[jira] Resolved: (HADOOP-3072) Multiple mappers join into reducer

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved HADOOP-3072.
-----------------------------------

    Resolution: Duplicate

This duplicates HADOOP-372.

> Multiple mappers join into reducer
> ----------------------------------
>
>                 Key: HADOOP-3072
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3072
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Yiping Han
>
> We would like to have multiple different mappers that takes input from different locations and output records with the same format. So the output of the mappers could be joint in the reducer easily. We know this can be achieved in the current framework. But the way to achieve it is not natural, less flexibility (need code change). Thus this would be a convenient feature to have. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.