You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by Siva <sb...@gmail.com> on 2015/02/04 22:23:21 UTC

Data loaded from Hbase is not visible in Phoenix

Hi Everyone,



I created a table in Phoenix. I loaded the data through Hbase since I m
facing issues with Phoenix loader. I could see the data from Hbase after
data load when I query it, but when I query the same table in Phoenix  I
don’t see any data, all the columns are being shown as NUL values.



I understand that Hbase stores the data in Byte format, since I created the
table in Phoenix and loaded it through HBase, how does phoenix interprets
the data types. Could someone throw some light on whats happening behind
the scenes?



Thanks,

Siva.

Re: Data loaded from Hbase is not visible in Phoenix

Posted by Siva <sb...@gmail.com>.
Hi Alicia,

Issue is resolved after the changing the column qualifiers to uppercase.
here is the response from one of the user Chandu.

-------------------------------------------

You have to double quotes to get correct mapping from phoenix to hbase
columns.
Try using the upper case letters for all column families & column names in
HBase & try the query again from phoenix.

Also, I faced similar issue when I created a index on phoenix table. It was
showing data till the point of creation of index. After that timestamp,
whatever the rows are inserted into Hbase are not reflected in phoenix table
on HDP2.2, but it was showing up in cloudera 5.2. However, index was not
updated when inserted through hbase in both the cases.

Thanks,
Chandu

-------------------------------------------

Appreciate for your response.

Thanks,
Siva.


On Thu, Feb 5, 2015 at 1:15 PM, Alicia Shu <as...@hortonworks.com> wrote:

> Data types are enforced by Phoenix. Hbase stores raw data. Can you use
> ³Upsert² to insert data into the table and make sure type consistency?
> Then see whether you will see data.
>
> Alicia
>
> On 2/5/15, 12:34 PM, "Siva" <sb...@gmail.com> wrote:
>
> >Hi Alicia, thanks for you response, but Data types in Hbase are always in
> >Byte type.. how can we explicitly specify the type information for column
> >qualifiers in Hbase?
> >
> >On Wed, Feb 4, 2015 at 4:33 PM, Alicia Shu <as...@hortonworks.com> wrote:
> >
> >> Make sure the data types you created in Phoenix table are the same as
> >> those types when you load the data from Hbase.
> >>
> >> Alicia
> >>
> >> On 2/4/15, 1:23 PM, "Siva" <sb...@gmail.com> wrote:
> >>
> >> >e the data from Hbase after
> >> >data load when I query it,
> >>
> >>
>
>

Re: Data loaded from Hbase is not visible in Phoenix

Posted by Alicia Shu <as...@hortonworks.com>.
Data types are enforced by Phoenix. Hbase stores raw data. Can you use
³Upsert² to insert data into the table and make sure type consistency?
Then see whether you will see data.

Alicia

On 2/5/15, 12:34 PM, "Siva" <sb...@gmail.com> wrote:

>Hi Alicia, thanks for you response, but Data types in Hbase are always in
>Byte type.. how can we explicitly specify the type information for column
>qualifiers in Hbase?
>
>On Wed, Feb 4, 2015 at 4:33 PM, Alicia Shu <as...@hortonworks.com> wrote:
>
>> Make sure the data types you created in Phoenix table are the same as
>> those types when you load the data from Hbase.
>>
>> Alicia
>>
>> On 2/4/15, 1:23 PM, "Siva" <sb...@gmail.com> wrote:
>>
>> >e the data from Hbase after
>> >data load when I query it,
>>
>>


Re: Data loaded from Hbase is not visible in Phoenix

Posted by Siva <sb...@gmail.com>.
Hi Alicia, thanks for you response, but Data types in Hbase are always in
Byte type.. how can we explicitly specify the type information for column
qualifiers in Hbase?

On Wed, Feb 4, 2015 at 4:33 PM, Alicia Shu <as...@hortonworks.com> wrote:

> Make sure the data types you created in Phoenix table are the same as
> those types when you load the data from Hbase.
>
> Alicia
>
> On 2/4/15, 1:23 PM, "Siva" <sb...@gmail.com> wrote:
>
> >e the data from Hbase after
> >data load when I query it,
>
>

Re: Data loaded from Hbase is not visible in Phoenix

Posted by Alicia Shu <as...@hortonworks.com>.
Make sure the data types you created in Phoenix table are the same as
those types when you load the data from Hbase.

Alicia

On 2/4/15, 1:23 PM, "Siva" <sb...@gmail.com> wrote:

>e the data from Hbase after
>data load when I query it,


Re: Data loaded from Hbase is not visible in Phoenix

Posted by Siva <sb...@gmail.com>.
Hi Chandu,

Data is showing up after specifying all the qualifiers in uppercase as part
of bulk loading from Hbase. Thanks a lot for your help.

Thanks,
Siva.

On Thu, Feb 5, 2015 at 1:39 AM, Chandu <ch...@gmail.com> wrote:

> You have to double quotes to get correct mapping from phoenix to hbase
> columns.
> Try using the upper case letters for all column families & column names in
> HBase & try the query again from phoenix.
>
> Also, I faced similar issue when I created a index on phoenix table. It
> was showing data till the point of creation of index. After that timestamp,
> whatever the rows are inserted into Hbase are not reflected in phoenix
> table on HDP2.2, but it was showing up in cloudera 5.2. However, index was
> not updated when inserted through hbase in both the cases.
>
> Thanks,
> Chandu.
>
> On 5 February 2015 at 05:20, Siva <sb...@gmail.com> wrote:
>
>> Hi Everyone,
>>
>>
>>
>> I created a table in Phoenix. I loaded the data through Hbase since I m
>> facing issues with Phoenix loader. I could see the data from Hbase after
>> data load when I query it, but when I query the same table in Phoenix  I
>> don’t see any data, all the columns are being shown as NUL values.
>>
>>
>>
>> I understand that Hbase stores the data in Byte format, since I created
>> the table in Phoenix and loaded it through HBase, how does phoenix
>> interprets the data types. Could someone throw some light on whats
>> happening behind the scenes?
>>
>>
>>
>> Thanks,
>>
>> Siva.
>>
>>
>
>
> --
> Cheers,
> Chandu.
>

Re: Data loaded from Hbase is not visible in Phoenix

Posted by Chandu <ch...@gmail.com>.
You have to double quotes to get correct mapping from phoenix to hbase
columns.
Try using the upper case letters for all column families & column names in
HBase & try the query again from phoenix.

Also, I faced similar issue when I created a index on phoenix table. It was
showing data till the point of creation of index. After that timestamp,
whatever the rows are inserted into Hbase are not reflected in phoenix
table on HDP2.2, but it was showing up in cloudera 5.2. However, index was
not updated when inserted through hbase in both the cases.

Thanks,
Chandu.

On 5 February 2015 at 05:20, Siva <sb...@gmail.com> wrote:

> Hi Everyone,
>
>
>
> I created a table in Phoenix. I loaded the data through Hbase since I m
> facing issues with Phoenix loader. I could see the data from Hbase after
> data load when I query it, but when I query the same table in Phoenix  I
> don’t see any data, all the columns are being shown as NUL values.
>
>
>
> I understand that Hbase stores the data in Byte format, since I created
> the table in Phoenix and loaded it through HBase, how does phoenix
> interprets the data types. Could someone throw some light on whats
> happening behind the scenes?
>
>
>
> Thanks,
>
> Siva.
>
>


-- 
Cheers,
Chandu.

Fwd: Data loaded from Hbase is not visible in Phoenix

Posted by Siva <sb...@gmail.com>.
Hi Everyone,



I created a table in Phoenix. I loaded the data through Hbase since I m
facing issues with Phoenix loader. I could see the data from Hbase after
data load when I query it, but when I query the same table in Phoenix  I
don’t see any data, all the columns are being shown as NUL values.



I understand that Hbase stores the data in Byte format, since I created the
table in Phoenix and loaded it through HBase, how does phoenix interprets
the data types. Could someone throw some light on whats happening behind
the scenes?



Thanks,

Siva.