You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Somnath (JIRA)" <ji...@apache.org> on 2011/06/14 11:02:47 UTC

[jira] [Created] (MAPREDUCE-2590) How to access Job Configuration file in Partitioner

How to access Job Configuration file in Partitioner
---------------------------------------------------

                 Key: MAPREDUCE-2590
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2590
             Project: Hadoop Map/Reduce
          Issue Type: Task
            Reporter: Somnath
            Priority: Minor


I need to access Job Configuration file in partitioner to fetch some information. Generally we can access job configuration file easily in map or reduce side by this code 

Configuration config = context.getConfiguration();
But this same code cannot be used in partitioner. To solve this issue I followed the patch https://issues.apache.org/jira/browse/MAPREDUCE-2474 but it is a doc so I downloaded the latest trunk code and generate the jar but I did not get any extra feature from that to call the job configuration file So any one knows the code to call Job Configuration file in partitioner.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (MAPREDUCE-2590) How to access Job Configuration file in Partitioner

Posted by "Harsh J (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J resolved MAPREDUCE-2590.
--------------------------------

    Resolution: Invalid

Somnath,

Thank you for taking time to file an issue!

MAPREDUCE-2474 added a API doc that specifies how to make your Partitioners configurable (API doc is clear on how to do so as well). You don't need to apply the patch, since its a docfix improvement.

However, you can find a detailed, example-ized solution here: http://cornercases.wordpress.com/2011/05/06/an-example-configurable-partitioner/

Resolving as Invalid (covered by MAPREDUCE-2474).

> How to access Job Configuration file in Partitioner
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-2590
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2590
>             Project: Hadoop Map/Reduce
>          Issue Type: Task
>            Reporter: Somnath
>            Priority: Minor
>              Labels: configuration, hadoop, job, partitioners
>
> I need to access Job Configuration file in partitioner to fetch some information. Generally we can access job configuration file easily in map or reduce side by this code 
> Configuration config = context.getConfiguration();
> But this same code cannot be used in partitioner. To solve this issue I followed the patch https://issues.apache.org/jira/browse/MAPREDUCE-2474 but it is a doc so I downloaded the latest trunk code and generate the jar but I did not get any extra feature from that to call the job configuration file So any one knows the code to call Job Configuration file in partitioner.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira