You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Francis Liu (JIRA)" <ji...@apache.org> on 2012/07/17 20:21:34 UTC
[jira] [Created] (PIG-2821) HBaseStorage does not support
delegation tokens
Francis Liu created PIG-2821:
--------------------------------
Summary: HBaseStorage does not support delegation tokens
Key: PIG-2821
URL: https://issues.apache.org/jira/browse/PIG-2821
Project: Pig
Issue Type: Bug
Affects Versions: 0.10.0
Reporter: Francis Liu
Pi
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2821:
------------------------------------
Status: Patch Available (was: Open)
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2821-branch10.patch, PIG-2821-trunk.patch
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2821:
------------------------------------
Attachment: PIG-2821-1.patch
Removed reverting of PIG-2578. Will deal with
issues from PIG-2578 in PIG-2870 or another jira.
Changed HBaseStorage to store all hbase properties in UDFContext properties. Credentials was getting added to the Job inadvertently when PigOutputFormat.checkOutputSpecs called setStoreLocation. So there is a way adding credentials works even with PIG-2578 though unexpected.
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2821-1.patch, PIG-2821-branch10.patch, PIG-2821-trunk.patch
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2821:
------------------------------------
Status: Open (was: Patch Available)
Will rework patch to add the hbase-site.xml to UDFContext instead of job conf.
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2821-branch10.patch, PIG-2821-trunk.patch
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2821:
------------------------------------
Attachment: PIG-2821-trunk.patch
PIG-2821-branch10.patch
Added code to fetch delegation tokens and put hbase-site.xml as part of jobconf(PIG-2822) if it is in classapth instead of having to specify --conf option.
Reverted PIG-2578 as because of that setting config or credentials in job was not actually being passed to the actual job launched. The testcase in MultiQueryLocal was also not valid as the condition if (job.getConfiguration().get(key)==null) was always true. It was always using the suffix initialized in the constructor and never from the job. If a StoreFunc adds config to Job then it should be its responsibility to handle multiple instances of it. HCATALOG-314 handles it for hcatalog. We should not remove the ability for a StoreFunc to set a config on the job.
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2821-branch10.patch, PIG-2821-trunk.patch
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage does not support
delegation tokens
Posted by "Francis Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Francis Liu updated PIG-2821:
-----------------------------
Description: HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled. (was: Pi)
> HBaseStorage does not support delegation tokens
> -----------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2821:
------------------------------------
Fix Version/s: 0.10.1
0.11
Assignee: Rohini Palaniswamy
Summary: HBaseStorage should work with secure hbase (was: HBaseStorage does not support delegation tokens)
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-2821:
------------------------------------
Status: Patch Available (was: Open)
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2821-1.patch, PIG-2821-branch10.patch, PIG-2821-trunk.patch
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439107#comment-13439107 ]
Daniel Dai commented on PIG-2821:
---------------------------------
+1, will checkin soon.
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2821-1.patch, PIG-2821-branch10.patch, PIG-2821-trunk.patch
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2821) HBaseStorage should work with secure
hbase
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2821:
----------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Patch committed to 0.10/trunk. Thanks Rohini!
> HBaseStorage should work with secure hbase
> ------------------------------------------
>
> Key: PIG-2821
> URL: https://issues.apache.org/jira/browse/PIG-2821
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Francis Liu
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2821-1.patch, PIG-2821-branch10.patch, PIG-2821-trunk.patch
>
>
> HBaseStorage needs to add HBase delegation token to the Job object if hbase security is enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira