You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Xavier Stevens <xs...@mozilla.com> on 2010/11/24 01:16:19 UTC
Querying HBase
I'm trying to create an external table to a pre-existing HBase table
using Hive trunk, like so:
CREATE EXTERNAL TABLE hbase_metrics (key string, value map<string,int>)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH
SERDEPROPERTIES ("hbase.columns.mapping" = ":key,counters:")
TBLPROPERTIES ("hbase.table.name" = "metrics");
I'm getting this error:
http://xstevens.pastebin.mozilla.org/863392
The SDS table in MySQL doesn't have a default value for IS_COMPRESSED.
How do I specify a value for this via create table?
Thanks,
-Xavier
Re: Querying HBase
Posted by Xavier Stevens <xs...@mozilla.com>.
Actually I think I have found the issue. I was trying to test this out
before we upgraded. And we were having classpath conflicts which
pointed to the old datanucleus JARs that came with hive 0.5.
-Xavier
On 11/24/10 11:00 AM, Xavier Stevens wrote:
> Hi John,
>
> This definitely looks like the issue you linked. I'm just using the
> default "datanucleus" for that configuration value.
>
> I see <dependency org="org.datanucleus"
> name="datanucleus-connectionpool"
> rev="${datanucleus-connectionpool.version}"> in the metastore ivy.xml.
>
> What version should I have? I see this in my build/dist/lib directory:
>
> -rw-r--r-- 1 xstevens staff 16880 Jun 24 06:34
> datanucleus-connectionpool-2.0.3.jar
> -rw-r--r-- 1 xstevens staff 2052714 Jun 25 00:50
> datanucleus-core-2.1.1.jar
> -rw-r--r-- 1 xstevens staff 188007 Jun 9 05:47
> datanucleus-enhancer-2.1.0-release.jar
> -rw-r--r-- 1 xstevens staff 1240347 Jun 25 00:53
> datanucleus-rdbms-2.1.1.jar
>
> Thanks,
>
>
> -Xavier
>
> On 11/23/10 5:56 PM, John Sichi wrote:
>> It looks a bit like this one where ISCOMPRESSED was used instead of IS_COMPRESSED:
>>
>> https://issues.apache.org/jira/browse/HIVE-1435
>>
>> Maybe your datanucleus.identifierFactory is somehow misconfigured?
>>
>> JVS
>>
>> On Nov 23, 2010, at 4:16 PM, Xavier Stevens wrote:
>>
>>> I'm trying to create an external table to a pre-existing HBase table
>>> using Hive trunk, like so:
>>>
>>> CREATE EXTERNAL TABLE hbase_metrics (key string, value map<string,int>)
>>> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH
>>> SERDEPROPERTIES ("hbase.columns.mapping" = ":key,counters:")
>>> TBLPROPERTIES ("hbase.table.name" = "metrics");
>>>
>>> I'm getting this error:
>>>
>>> http://xstevens.pastebin.mozilla.org/863392
>>>
>>> The SDS table in MySQL doesn't have a default value for IS_COMPRESSED.
>>> How do I specify a value for this via create table?
>>>
>>> Thanks,
>>>
>>>
>>> -Xavier
>>>
Re: Querying HBase
Posted by Xavier Stevens <xs...@mozilla.com>.
Hi John,
This definitely looks like the issue you linked. I'm just using the
default "datanucleus" for that configuration value.
I see <dependency org="org.datanucleus"
name="datanucleus-connectionpool"
rev="${datanucleus-connectionpool.version}"> in the metastore ivy.xml.
What version should I have? I see this in my build/dist/lib directory:
-rw-r--r-- 1 xstevens staff 16880 Jun 24 06:34
datanucleus-connectionpool-2.0.3.jar
-rw-r--r-- 1 xstevens staff 2052714 Jun 25 00:50
datanucleus-core-2.1.1.jar
-rw-r--r-- 1 xstevens staff 188007 Jun 9 05:47
datanucleus-enhancer-2.1.0-release.jar
-rw-r--r-- 1 xstevens staff 1240347 Jun 25 00:53
datanucleus-rdbms-2.1.1.jar
Thanks,
-Xavier
On 11/23/10 5:56 PM, John Sichi wrote:
> It looks a bit like this one where ISCOMPRESSED was used instead of IS_COMPRESSED:
>
> https://issues.apache.org/jira/browse/HIVE-1435
>
> Maybe your datanucleus.identifierFactory is somehow misconfigured?
>
> JVS
>
> On Nov 23, 2010, at 4:16 PM, Xavier Stevens wrote:
>
>> I'm trying to create an external table to a pre-existing HBase table
>> using Hive trunk, like so:
>>
>> CREATE EXTERNAL TABLE hbase_metrics (key string, value map<string,int>)
>> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH
>> SERDEPROPERTIES ("hbase.columns.mapping" = ":key,counters:")
>> TBLPROPERTIES ("hbase.table.name" = "metrics");
>>
>> I'm getting this error:
>>
>> http://xstevens.pastebin.mozilla.org/863392
>>
>> The SDS table in MySQL doesn't have a default value for IS_COMPRESSED.
>> How do I specify a value for this via create table?
>>
>> Thanks,
>>
>>
>> -Xavier
>>
Re: Querying HBase
Posted by John Sichi <js...@fb.com>.
It looks a bit like this one where ISCOMPRESSED was used instead of IS_COMPRESSED:
https://issues.apache.org/jira/browse/HIVE-1435
Maybe your datanucleus.identifierFactory is somehow misconfigured?
JVS
On Nov 23, 2010, at 4:16 PM, Xavier Stevens wrote:
> I'm trying to create an external table to a pre-existing HBase table
> using Hive trunk, like so:
>
> CREATE EXTERNAL TABLE hbase_metrics (key string, value map<string,int>)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH
> SERDEPROPERTIES ("hbase.columns.mapping" = ":key,counters:")
> TBLPROPERTIES ("hbase.table.name" = "metrics");
>
> I'm getting this error:
>
> http://xstevens.pastebin.mozilla.org/863392
>
> The SDS table in MySQL doesn't have a default value for IS_COMPRESSED.
> How do I specify a value for this via create table?
>
> Thanks,
>
>
> -Xavier
>