You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Divya Gehlot <di...@gmail.com> on 2016/02/29 04:21:36 UTC
[Error] : while registering Hbase table with hive
Hi,
I trying to register a hbase table with hive and getting following error :
Error while processing statement: FAILED: Execution Error, return code 1
> from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException:
> MetaException(message:org.apache.hadoop.hive.serde2.SerDeException Error:
> the HBase columns mapping contains a badly formed column family, column
> qualifier specification.)
May I know what could be the possible reason ?
Thanks,
Divya
Re: [Error] : while registering Hbase table with hive
Posted by Swagatika Tripathy <sw...@gmail.com>.
Hi Divya,
Can you paste the Hive table structure as well as HBASE table structure?
Regards,
Swagatika
On Mon, Feb 29, 2016 at 8:51 AM, Divya Gehlot <di...@gmail.com>
wrote:
> Hi,
> I trying to register a hbase table with hive and getting following error :
>
> Error while processing statement: FAILED: Execution Error, return code 1
>> from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException:
>> MetaException(message:org.apache.hadoop.hive.serde2.SerDeException Error:
>> the HBase columns mapping contains a badly formed column family, column
>> qualifier specification.)
>
>
>
> May I know what could be the possible reason ?
>
>
> Thanks,
> Divya
>
Re: [Error] : while registering Hbase table with hive
Posted by Divya Gehlot <di...@gmail.com>.
Oh mymy found the mistake
Its the typo
no cf mapping for COLUMN7
Thanks Ted
On 29 February 2016 at 11:45, Divya Gehlot <di...@gmail.com> wrote:
> Hi Ted,
> I am using
> Hive - 1.2.1.2.3
> Hbase - 1.1.1.2.3
>
> Using Hortonworks HDP 2.3.4 version
>
>
> CREATE EXTERNAL TABLE TABLE_NAME(COLUMN1 STRING,COLUMN2 STRING,COLUMN3
>> STRING,COLUMN4 STRING,COLUMN5 STRING,
>> COLUMN6 STRING,COLUMN7 FLOAT,COLUMN8 FLOAT,COLUMN9 FLOAT,COLUMN10 STRING,
>> COLUMN11 STRING,COLUMN12 FLOAT,COLUMN13 FLOAT,COLUMN14 STRING,
>> START_DATE DATE,COLUMN15 STRING,COLUMN16 STRING,COLUMN17 STRING,RPT_DATE
>> DATE,FREE_FIELD_1 STRING,
>> FREE_FIELD_2 STRING,FREE_FIELD_3 STRING,FREE_FIELD_4 STRING,FREE_FIELD_5
>> STRING,FREE_FIELD_6 STRING,
>> FREE_FIELD_7 STRING,FREE_FIELD_8 STRING,FREE_FIELD_9 STRING,FREE_FIELD_10
>> STRING,COLUMN18 STRING)
>> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
>> WITH SERDEPROPERTIES ("hbase.columns.mapping" =
>> ":key,0:COLUMN2,0:COLUMN3,0:COLUMN4,0:COLUMN5,0:COLUMN6,COLUMN7,
>> 0:COLUMN8,0:COLUMN9,0:COLUMN10,0:COLUMN11,0:COLUMN12,0:COLUMN13,
>>
>> 0:COLUMN14,0:START_DATE,0:COLUMN15,0:COLUMN16,0:COLUMN17,0:RPT_DATE,0:FREE_FIELD_1,0:FREE_FIELD_2,
>>
>> 0:FREE_FIELD_3,0:FREE_FIELD_4,0:FREE_FIELD_5,0:FREE_FIELD_6,0:FREE_FIELD_7,0:FREE_FIELD_8,0:FREE_FIELD_9,
>> 0:FREE_FIELD_10,0:COLUMN18")
>> TBLPROPERTIES ("hbase.table.name" = "TABLE_NAME");
>
>
>
>
> Scan table partial data looks like below
>
> CTR_00001 column=0:RPT_DATE, timestamp=1456716687530,
> value=\x80\x00
> \x01J\xA1\x13<\x00
> CTR_00001 column=0:START_DATE, timestamp=1456716687530,
> value=\x80\x
> 00\x01J\xA1\x13<\x00
> ....................
>
> Test1 column=0:FREE_FIELD_1, timestamp=1456197984637,
> value=1
> Test1 column=0:FREE_FIELD_2, timestamp=1456197984637,
> value=1
> Test1 column=0:FREE_FIELD_3, timestamp=1456197984637,
> value=3
> Test1 column=0:FREE_FIELD_4, timestamp=1456197984637,
> value=3
> Test1 column=0:FREE_FIELD_5, timestamp=1456197984637,
> value=5
> Test1 column=0:FREE_FIELD_6, timestamp=1456197984637,
> value=6
> Test1 column=0:FREE_FIELD_7, timestamp=1456197984637,
> value=7
>
>
>
>
>
> On 29 February 2016 at 11:26, Ted Yu <yu...@gmail.com> wrote:
>
>> Can you give us some more information ?
>>
>> release of hbase
>> release of Hive
>>
>> code snippet for registering hbase table
>>
>> On Sun, Feb 28, 2016 at 7:21 PM, Divya Gehlot <di...@gmail.com>
>> wrote:
>>
>> > Hi,
>> > I trying to register a hbase table with hive and getting following
>> error :
>> >
>> > Error while processing statement: FAILED: Execution Error, return code
>> 1
>> > > from org.apache.hadoop.hive.ql.exec.DDLTask.
>> java.lang.RuntimeException:
>> > > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException
>> Error:
>> > > the HBase columns mapping contains a badly formed column family,
>> column
>> > > qualifier specification.)
>> >
>> >
>> >
>> > May I know what could be the possible reason ?
>> >
>> >
>> > Thanks,
>> > Divya
>> >
>>
>
>
Re: [Error] : while registering Hbase table with hive
Posted by Divya Gehlot <di...@gmail.com>.
Hi Ted,
I am using
Hive - 1.2.1.2.3
Hbase - 1.1.1.2.3
Using Hortonworks HDP 2.3.4 version
CREATE EXTERNAL TABLE TABLE_NAME(COLUMN1 STRING,COLUMN2 STRING,COLUMN3
> STRING,COLUMN4 STRING,COLUMN5 STRING,
> COLUMN6 STRING,COLUMN7 FLOAT,COLUMN8 FLOAT,COLUMN9 FLOAT,COLUMN10 STRING,
> COLUMN11 STRING,COLUMN12 FLOAT,COLUMN13 FLOAT,COLUMN14 STRING,
> START_DATE DATE,COLUMN15 STRING,COLUMN16 STRING,COLUMN17 STRING,RPT_DATE
> DATE,FREE_FIELD_1 STRING,
> FREE_FIELD_2 STRING,FREE_FIELD_3 STRING,FREE_FIELD_4 STRING,FREE_FIELD_5
> STRING,FREE_FIELD_6 STRING,
> FREE_FIELD_7 STRING,FREE_FIELD_8 STRING,FREE_FIELD_9 STRING,FREE_FIELD_10
> STRING,COLUMN18 STRING)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapping" =
> ":key,0:COLUMN2,0:COLUMN3,0:COLUMN4,0:COLUMN5,0:COLUMN6,COLUMN7,
> 0:COLUMN8,0:COLUMN9,0:COLUMN10,0:COLUMN11,0:COLUMN12,0:COLUMN13,
>
> 0:COLUMN14,0:START_DATE,0:COLUMN15,0:COLUMN16,0:COLUMN17,0:RPT_DATE,0:FREE_FIELD_1,0:FREE_FIELD_2,
>
> 0:FREE_FIELD_3,0:FREE_FIELD_4,0:FREE_FIELD_5,0:FREE_FIELD_6,0:FREE_FIELD_7,0:FREE_FIELD_8,0:FREE_FIELD_9,
> 0:FREE_FIELD_10,0:COLUMN18")
> TBLPROPERTIES ("hbase.table.name" = "TABLE_NAME");
Scan table partial data looks like below
CTR_00001 column=0:RPT_DATE, timestamp=1456716687530,
value=\x80\x00
\x01J\xA1\x13<\x00
CTR_00001 column=0:START_DATE, timestamp=1456716687530,
value=\x80\x
00\x01J\xA1\x13<\x00
....................
Test1 column=0:FREE_FIELD_1, timestamp=1456197984637,
value=1
Test1 column=0:FREE_FIELD_2, timestamp=1456197984637,
value=1
Test1 column=0:FREE_FIELD_3, timestamp=1456197984637,
value=3
Test1 column=0:FREE_FIELD_4, timestamp=1456197984637,
value=3
Test1 column=0:FREE_FIELD_5, timestamp=1456197984637,
value=5
Test1 column=0:FREE_FIELD_6, timestamp=1456197984637,
value=6
Test1 column=0:FREE_FIELD_7, timestamp=1456197984637,
value=7
On 29 February 2016 at 11:26, Ted Yu <yu...@gmail.com> wrote:
> Can you give us some more information ?
>
> release of hbase
> release of Hive
>
> code snippet for registering hbase table
>
> On Sun, Feb 28, 2016 at 7:21 PM, Divya Gehlot <di...@gmail.com>
> wrote:
>
> > Hi,
> > I trying to register a hbase table with hive and getting following error
> :
> >
> > Error while processing statement: FAILED: Execution Error, return code 1
> > > from org.apache.hadoop.hive.ql.exec.DDLTask.
> java.lang.RuntimeException:
> > > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException
> Error:
> > > the HBase columns mapping contains a badly formed column family, column
> > > qualifier specification.)
> >
> >
> >
> > May I know what could be the possible reason ?
> >
> >
> > Thanks,
> > Divya
> >
>
Re: [Error] : while registering Hbase table with hive
Posted by Ted Yu <yu...@gmail.com>.
Can you give us some more information ?
release of hbase
release of Hive
code snippet for registering hbase table
On Sun, Feb 28, 2016 at 7:21 PM, Divya Gehlot <di...@gmail.com>
wrote:
> Hi,
> I trying to register a hbase table with hive and getting following error :
>
> Error while processing statement: FAILED: Execution Error, return code 1
> > from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException:
> > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException Error:
> > the HBase columns mapping contains a badly formed column family, column
> > qualifier specification.)
>
>
>
> May I know what could be the possible reason ?
>
>
> Thanks,
> Divya
>