[jira] [Resolved] (CRUNCH-664) [crunch-hbase] HBase configuration properties overwritten

["Josh Wills (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CRUNCH-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills resolved CRUNCH-664.
-------------------------------
    Resolution: Fixed

yep, that's a bug. Fix pushed to master-- thank you [~nathan.schile@gmail.com]!

> [crunch-hbase] HBase configuration properties overwritten
> ---------------------------------------------------------
>
>                 Key: CRUNCH-664
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-664
>             Project: Crunch
>          Issue Type: Improvement
>    Affects Versions: 0.14.0
>            Reporter: Nathan Schile
>            Priority: Minor
>             Fix For: 1.0.0
>
>         Attachments: 0001-CRUNCH-664-Fixes-HBase-configuration-properties-bein.patch
>
>
> When constructing a MRPipeline with a Hadoop Configuration that contains HBase configuration properties, those properties are overwritten by the default values from hbase-default.xml and hbase-site.xml. This is because the HBaseTarget and HFileTarget classes take the Hadoop configuration and then applies the HBase defaults [1]. Patch for the fix is attached.
> [1]
> {code:java}
> public void configureForMapReduce(Job job, PType<?> ptype, Path outputPath, String name) {
>   Configuration conf = job.getConfiguration();
>   HBaseConfiguration.addHbaseResources(conf);
>   ...
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)