You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Sumanta Gh <su...@tcs.com> on 2016/02/17 14:21:37 UTC
Dynamic column using Pig STORE function
Hi,
I was going through the Phoenix Pig integration [1].
I need to store value in a dynamic column using org.apache.phoenix.pig.PhoenixHBaseStorage.
Is dynamic column allowed in STORE function? Please send me some example.
[1] - https://phoenix.apache.org/pig_integration.html
Regards
Sumanta Ghosh
=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you
Re: Dynamic column using Pig STORE function
Posted by Steve Terrell <st...@oculus360.us>.
And meanwhile, try the streaming function. Seems inefficient, but I
routinely load tens of thousands of records with dynamic fields this way.
Hasn't ever crashed on a single upsert, and it's actually pretty fast, at
least if your Pig job is running on the same cluster as Phoenix.
On Wed, Feb 17, 2016 at 1:38 PM, Ravi Kiran <ma...@gmail.com>
wrote:
> Hi ,
> Unfortunately, we don't support dynamic columns within the phoenix-pig
> module. Currently, the only two options to PhoenixHBaseStorage are
> specifying the table or a set of table columns . We can definitely support
> dynamic columns. Please feel free to create a ticket.
>
> Regards
> Ravi
>
> On Wed, Feb 17, 2016 at 10:56 AM, Steve Terrell <st...@oculus360.us>
> wrote:
>
>> I would be interested in knowing, too. My solution was to write a Pig
>> streaming function that executed the Phoenix upsert command for every row.
>>
>> On Wed, Feb 17, 2016 at 7:21 AM, Sumanta Gh <su...@tcs.com> wrote:
>>
>>> Hi,
>>> I was going through the Phoenix Pig integration [1].
>>> I need to store value in a dynamic column using
>>> org.apache.phoenix.pig.PhoenixHBaseStorage.
>>> Is dynamic column allowed in STORE function? Please send me some example.
>>>
>>> [1] - https://phoenix.apache.org/pig_integration.html
>>>
>>> Regards
>>> Sumanta Ghosh
>>>
>>> =====-----=====-----=====
>>> Notice: The information contained in this e-mail
>>> message and/or attachments to it may contain
>>> confidential or privileged information. If you are
>>> not the intended recipient, any dissemination, use,
>>> review, distribution, printing or copying of the
>>> information contained in this e-mail message
>>> and/or attachments to it are strictly prohibited. If
>>> you have received this communication in error,
>>> please notify us by reply e-mail or telephone and
>>> immediately and permanently delete the message
>>> and any attachments. Thank you
>>>
>>>
>>
>
Re: Dynamic column using Pig STORE function
Posted by Ravi Kiran <ma...@gmail.com>.
Hi ,
Unfortunately, we don't support dynamic columns within the phoenix-pig
module. Currently, the only two options to PhoenixHBaseStorage are
specifying the table or a set of table columns . We can definitely support
dynamic columns. Please feel free to create a ticket.
Regards
Ravi
On Wed, Feb 17, 2016 at 10:56 AM, Steve Terrell <st...@oculus360.us>
wrote:
> I would be interested in knowing, too. My solution was to write a Pig
> streaming function that executed the Phoenix upsert command for every row.
>
> On Wed, Feb 17, 2016 at 7:21 AM, Sumanta Gh <su...@tcs.com> wrote:
>
>> Hi,
>> I was going through the Phoenix Pig integration [1].
>> I need to store value in a dynamic column using
>> org.apache.phoenix.pig.PhoenixHBaseStorage.
>> Is dynamic column allowed in STORE function? Please send me some example.
>>
>> [1] - https://phoenix.apache.org/pig_integration.html
>>
>> Regards
>> Sumanta Ghosh
>>
>> =====-----=====-----=====
>> Notice: The information contained in this e-mail
>> message and/or attachments to it may contain
>> confidential or privileged information. If you are
>> not the intended recipient, any dissemination, use,
>> review, distribution, printing or copying of the
>> information contained in this e-mail message
>> and/or attachments to it are strictly prohibited. If
>> you have received this communication in error,
>> please notify us by reply e-mail or telephone and
>> immediately and permanently delete the message
>> and any attachments. Thank you
>>
>>
>
Re: Dynamic column using Pig STORE function
Posted by Steve Terrell <st...@oculus360.us>.
I would be interested in knowing, too. My solution was to write a Pig
streaming function that executed the Phoenix upsert command for every row.
On Wed, Feb 17, 2016 at 7:21 AM, Sumanta Gh <su...@tcs.com> wrote:
> Hi,
> I was going through the Phoenix Pig integration [1].
> I need to store value in a dynamic column using
> org.apache.phoenix.pig.PhoenixHBaseStorage.
> Is dynamic column allowed in STORE function? Please send me some example.
>
> [1] - https://phoenix.apache.org/pig_integration.html
>
> Regards
> Sumanta Ghosh
>
> =====-----=====-----=====
> Notice: The information contained in this e-mail
> message and/or attachments to it may contain
> confidential or privileged information. If you are
> not the intended recipient, any dissemination, use,
> review, distribution, printing or copying of the
> information contained in this e-mail message
> and/or attachments to it are strictly prohibited. If
> you have received this communication in error,
> please notify us by reply e-mail or telephone and
> immediately and permanently delete the message
> and any attachments. Thank you
>
>