You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Nick Pinckernell (Created) (JIRA)" <ji...@apache.org> on 2012/03/26 04:28:26 UTC
[jira] [Created] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
HBase region observer coprocessor not firing from Pig 'store'
-------------------------------------------------------------
Key: PIG-2615
URL: https://issues.apache.org/jira/browse/PIG-2615
Project: Pig
Issue Type: Bug
Components: data
Affects Versions: 0.9.2
Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
Reporter: Nick Pinckernell
Priority: Minor
When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] [Created] (PIG-2615) HBase region observer coprocessor not firing from Pig 'store'
Posted by Russell Jurney <ru...@gmail.com>.
Ive gotten the latest pig in a new repo - again no differences. Thanks.
Russell Jurney http://datasyndrome.com
On Mar 25, 2012, at 7:28 PM, "Nick Pinckernell (Created) (JIRA)" <ji...@apache.org> wrote:
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Priority: Minor
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
>
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
[jira] [Commented] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Nick Pinckernell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265105#comment-13265105 ]
Nick Pinckernell commented on PIG-2615:
---------------------------------------
I'll get that test case added in the next few days. I did think about that case of custom timestamps and think it would be useful. If there are any feature requests to that effect or I need it for my purposes then I may code up a feature patch.
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Assignee: Nick Pinckernell
> Priority: Minor
> Labels: newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Graham updated PIG-2615:
-----------------------------
Patch Info: (was: Patch Available)
Changing from Patch Available to Open.
Why does providing a ts or not effect the firing of coprocessors?
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Assignee: Nick Pinckernell
> Priority: Minor
> Labels: hbase, newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Nick Pinckernell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464490#comment-13464490 ]
Nick Pinckernell commented on PIG-2615:
---------------------------------------
I've checked pig 0.10.0 and the issue still remains. Also, my above comment may be a little off as I don't recall exactly what HBase did not like about the 'ts' that was being generated by pig. My test was specifically with a RegionObserver prePut coprocessor, I was not testing any of the other hooks.
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Assignee: Nick Pinckernell
> Priority: Minor
> Labels: hbase, newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Nick Pinckernell (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Pinckernell updated PIG-2615:
----------------------------------
Attachment: HBaseStorage_java_coprocessor.patch
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Priority: Minor
> Labels: newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Nick Pinckernell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270173#comment-13270173 ]
Nick Pinckernell commented on PIG-2615:
---------------------------------------
Dmitriy, the latest from SVN seems to suggest that HBaseStorage is still using hbase-0.90.0. I am unable to add any coprocessor unit tests until HBaseStorage officially supports HBase 0.92. After a quick search the only JIRA I found referencing hbase-0.92 was here: https://issues.apache.org/jira/browse/PIG-2347
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Assignee: Nick Pinckernell
> Priority: Minor
> Labels: newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Nick Pinckernell (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Pinckernell updated PIG-2615:
----------------------------------
Attachment: (was: HBaseStorage_java_coprocessor.patch)
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Priority: Minor
> Labels: newbie, patch
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy V. Ryaboy reassigned PIG-2615:
--------------------------------------
Assignee: Nick Pinckernell
Assigning to Nick.
Sorry this went unnoticed. Will review.
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Assignee: Nick Pinckernell
> Priority: Minor
> Labels: newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264615#comment-13264615 ]
Dmitriy V. Ryaboy commented on PIG-2615:
----------------------------------------
Oh wow that was a small patch :).
Nick, can you add a testcase?
What do you think of uses that require users to manually control timestamps? Will doing so completely prevent coprocessors from firing? This isn't possible right now anyway, but I can see wanting to add this in the near future.
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Assignee: Nick Pinckernell
> Priority: Minor
> Labels: newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Nick Pinckernell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464393#comment-13464393 ]
Nick Pinckernell commented on PIG-2615:
---------------------------------------
Here is the conversation that was had at the HBase forum:
http://mail-archives.apache.org/mod_mbox/hbase-user/201203.mbox/%3CCABsY1jQ8+OiLh7SYkXZ8iO=NosY8khz7iYs+6W4u6SxCpJ5s9g@mail.gmail.com%3E
For pig 0.9.2 the issue looked like when pig was invoking the put.add() method in the HBaseStorage class that the ts that was being passed was incorrect and the coprocessor would not fire for those rows with that version of the 'ts' could not be found. I have not checked pig 0.10.0 yet.
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Assignee: Nick Pinckernell
> Priority: Minor
> Labels: hbase, newbie, patch
> Attachments: HBaseStorage_java_coprocessor.patch
>
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2615) HBase region observer coprocessor not
firing from Pig 'store'
Posted by "Nick Pinckernell (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Pinckernell updated PIG-2615:
----------------------------------
Attachment: HBaseStorage_java_coprocessor.patch
Patch
> HBase region observer coprocessor not firing from Pig 'store'
> -------------------------------------------------------------
>
> Key: PIG-2615
> URL: https://issues.apache.org/jira/browse/PIG-2615
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.9.2
> Environment: Pig 0.9.2, HBase 0.92, Hadoop 1.0.0
> Reporter: Nick Pinckernell
> Priority: Minor
> Labels: newbie, patch
>
> When using pig to load data into HBase the region observer coprocessor (specifically prePut() as I have not tested all the other possible region observer combinations) with the 'store' command the coprocessor is not getting invoked.
> I have tracked this down and come up with a simple patch. A record of the investigation is on both the Pig and HBase user forums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira