You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2013/10/22 22:26:42 UTC

[jira] [Updated] (PIG-3529) Upgrade HBase dependency from 0.95-SNAPSHOT to 0.96

     [ https://issues.apache.org/jira/browse/PIG-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Jarcec Cecho updated PIG-3529:
------------------------------------

    Attachment: PIG-3529.patch

The issue was in following exception: 

{code}
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hbase.replication.regionserver.Replication.decorateMasterConfiguration(Replication.java:295)
	at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:461)
{code}

The problem is that property HBASE_MASTER_LOGCLEANER_PLUGINS that is being access in Replication.java:295 is not defined when it's expected to be. I've investigated the issue and found out that {{hbase-default.xml}} won't get it into the configuration. So, I've added call for {{HBaseConfiguration.create}} to propagate all HBase resources to the used configuration object. This wasn't an issue with 0.94 and 0.95 because the code in question will be executed only if replication is enabled which is not the case on those versions. The replication got enabled by default in 0.96 via HBASE-9505. I don't think that NPE is correct way how to handle this, so I'll follow up on HBase suggesting to be more careful in the code.

Verification steps for HBase 0.95 profile:

{code}
ant clean test -Dtestcase=TestHBaseStorage -Dhbaseversion=95 -Dprotobuf-java.version=2.5.0
{code}

Verification steps for HBase 0.94 profile:
{code}
ant clean test -Dtestcase=TestHBaseStorage
{code}

I'll file a follow up JIRA to tweak the ant build for fetching proper dependencies in order to get the HBase tests working on Hadoop 2 (e.g. that is not included in this patch).

> Upgrade HBase dependency from 0.95-SNAPSHOT to 0.96
> ---------------------------------------------------
>
>                 Key: PIG-3529
>                 URL: https://issues.apache.org/jira/browse/PIG-3529
>             Project: Pig
>          Issue Type: Task
>    Affects Versions: 0.12.0
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>             Fix For: 0.13.0
>
>         Attachments: PIG-3529.patch
>
>
> HBase has recently released version 0.96, so we should upgrade from the 0.95.3-SNAPSHOT that has been introduced via PIG-3390.



--
This message was sent by Atlassian JIRA
(v6.1#6144)