You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2010/10/18 20:07:22 UTC

[jira] Assigned: (HBASE-3076) Allow to disable automatic shipping of dependency jars for mapreduce jobs

     [ https://issues.apache.org/jira/browse/HBASE-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon reassigned HBASE-3076:
----------------------------------

    Assignee: Bruno Dumon

> Allow to disable automatic shipping of dependency jars for mapreduce jobs
> -------------------------------------------------------------------------
>
>                 Key: HBASE-3076
>                 URL: https://issues.apache.org/jira/browse/HBASE-3076
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>            Reporter: Bruno Dumon
>            Assignee: Bruno Dumon
>            Priority: Minor
>         Attachments: tablemapreduceutil-optional-adddependencies-patch.txt
>
>
> Since HBASE-3001, TableMapReduceUtil.initTableMap/ReduceJob will automatically upload the HBase jars needed to execute a map reduce job.
> In my case I am building a job jar using Maven's assembly plugin, this way all the necessary dependencies are in the job jar. So in such case the default behavior of HBase causes some needless upload work. It also uploads hadoop-core itself which is not necessary.
> Therefore I propose to add a variant of the initTableMap/ReduceJob methods with an extra boolean argument to disable the automatic adding of dependency jars.
> I will attach a patch with the proposed change.
> Note that everything works as is, this is just an optimization.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.