You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Gary Helmling (JIRA)" <ji...@apache.org> on 2010/11/04 00:25:22 UTC
[jira] Created: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
HBase should run on both secure and vanilla versions of Hadoop 0.20
-------------------------------------------------------------------
Key: HBASE-3194
URL: https://issues.apache.org/jira/browse/HBASE-3194
Project: HBase
Issue Type: Bug
Reporter: Gary Helmling
There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929958#action_12929958 ]
Todd Lipcon commented on HBASE-3194:
------------------------------------
Yea, need something of this sort to run on CDH3b3 - for the HBase we ship, we applied a less fancy reflectionless version of basically the same thing.
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928072#action_12928072 ]
Andrew Purtell commented on HBASE-3194:
---------------------------------------
It should be possible to wrap UGI and UUGI with something that uses reflection to determine what platform variant is below. Anyone forsee a problem with that approach?
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "HBase Review Board (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928943#action_12928943 ]
HBase Review Board commented on HBASE-3194:
-------------------------------------------
Message from: "Gary Helmling" <gh...@gmail.com>
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/1184/
-----------------------------------------------------------
Review request for hbase.
Summary
-------
Adds a wrapper class, org.apache.hadoop.hbase.security.User, around org.apache.hadoop.security.UserGroupInformation, to accommodate the divergent APIs of both regular Hadoop 0.20, and secure Hadoop 0.20 (which should also mean 0.21 and later, though I haven't specifically tested that).
Common methods in both UserGroupInformation versions are invoked directly. Version specific methods are invoked using reflection. Almost all of the usage is around testing code that spins up local clusters, since those are the only parts that exercise UserGroupInformation currently.
This addresses bug HBASE-3194.
http://issues.apache.org/jira/browse/HBASE-3194
Diffs
-----
src/main/java/org/apache/hadoop/hbase/LocalHBaseCluster.java 9267679
src/main/java/org/apache/hadoop/hbase/ipc/HBaseServer.java e4c356d
src/main/java/org/apache/hadoop/hbase/security/User.java PRE-CREATION
src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java 83ceac9
src/test/java/org/apache/hadoop/hbase/MiniHBaseCluster.java 8f9c88f
src/test/java/org/apache/hadoop/hbase/regionserver/TestStore.java d436e2e
src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALReplay.java b9902f1
src/test/java/org/apache/hadoop/hbase/security/TestUser.java PRE-CREATION
Diff: http://review.cloudera.org/r/1184/diff
Testing
-------
Ran full test suite with these changes against both Hadoop 0.20-append and yahoo-0.20.104-append (security+append). The only failures match what I'm currently seeing in trunk. Will remerge from trunk and test against as soon as it's back to passing.
Though this is only testing compatibility with both versions with a rebuild. I still need to test building against 0.20-append then spinning up HBase using security. Will do that next, just wanted to get some eyes on this to validate the approach.
Thanks,
Gary
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "HBase Review Board (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929948#action_12929948 ]
HBase Review Board commented on HBASE-3194:
-------------------------------------------
Message from: stack@duboce.net
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/1184/#review1857
-----------------------------------------------------------
Ship it!
Meant to say I'm +1 on this.
- stack
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-3194:
-------------------------
Fix Version/s: 0.90.0
We need this to work on CDH3b3 and on Y! secure Hadoop. Bringing it into 0.90.
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
> Fix For: 0.90.0
>
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "HBase Review Board (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929867#action_12929867 ]
HBase Review Board commented on HBASE-3194:
-------------------------------------------
Message from: "Gary Helmling" <gh...@gmail.com>
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/1184/
-----------------------------------------------------------
(Updated 2010-11-08 17:18:26.166428)
Review request for hbase.
Changes
-------
Added some notes on additional testing.
Summary
-------
Adds a wrapper class, org.apache.hadoop.hbase.security.User, around org.apache.hadoop.security.UserGroupInformation, to accommodate the divergent APIs of both regular Hadoop 0.20, and secure Hadoop 0.20 (which should also mean 0.21 and later, though I haven't specifically tested that).
Common methods in both UserGroupInformation versions are invoked directly. Version specific methods are invoked using reflection. Almost all of the usage is around testing code that spins up local clusters, since those are the only parts that exercise UserGroupInformation currently.
This addresses bug HBASE-3194.
http://issues.apache.org/jira/browse/HBASE-3194
Diffs
-----
src/main/java/org/apache/hadoop/hbase/LocalHBaseCluster.java 9267679
src/main/java/org/apache/hadoop/hbase/ipc/HBaseServer.java e4c356d
src/main/java/org/apache/hadoop/hbase/security/User.java PRE-CREATION
src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java 83ceac9
src/test/java/org/apache/hadoop/hbase/MiniHBaseCluster.java 8f9c88f
src/test/java/org/apache/hadoop/hbase/regionserver/TestStore.java d436e2e
src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALReplay.java b9902f1
src/test/java/org/apache/hadoop/hbase/security/TestUser.java PRE-CREATION
Diff: http://review.cloudera.org/r/1184/diff
Testing (updated)
-------
Ran full test suite with these changes against both Hadoop 0.20-append and yahoo-0.20.104-append (security+append). The only failures match what I'm currently seeing in trunk. Will remerge from trunk and test against as soon as it's back to passing.
Though this is only testing compatibility with both versions with a rebuild. I still need to test building against 0.20-append then spinning up HBase using security. Will do that next, just wanted to get some eyes on this to validate the approach.
[Update 11/8/2010]: I did some further testing. Compiled HBase against 0.20-append. Ran YCSB with the compiled HBase against Hadoop 0.20.2 and yahoo-0.20.104-append (updating just the hadoop jar), to verify the patch will work against both without rebuilding. YCSB load and varied workloads completed without any errors.
Thanks,
Gary
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "ryan rawson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928062#action_12928062 ]
ryan rawson commented on HBASE-3194:
------------------------------------
it would also be nice to run on both w/o rebuilding.
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12930187#action_12930187 ]
stack commented on HBASE-3194:
------------------------------
Sorry about that. Just fixed (forgot to add new classes).
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
> Assignee: stack
> Fix For: 0.90.0
>
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-3194.
--------------------------
Resolution: Fixed
Reresolving after I committed tail of the patch.
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
> Assignee: stack
> Fix For: 0.90.0
>
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "Benoit Sigoure (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoit Sigoure reopened HBASE-3194:
-----------------------------------
Assignee: stack (was: Gary Helmling)
#1032848 prevents HBase from compiling. Please fix.
{code}
[INFO] [compiler:compile {execution: default-compile}]
[INFO] Compiling 437 source files to /private/tmp/tt/hbase/target/classes
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Compilation failure
/private/tmp/tt/hbase/src/main/java/org/apache/hadoop/hbase/LocalHBaseCluster.java:[33,39] package org.apache.hadoop.hbase.security does not exist
/private/tmp/tt/hbase/src/main/java/org/apache/hadoop/hbase/LocalHBaseCluster.java:[176,23] cannot find symbol
symbol : class User
location: class org.apache.hadoop.hbase.LocalHBaseCluster
/private/tmp/tt/hbase/src/main/java/org/apache/hadoop/hbase/LocalHBaseCluster.java:[203,23] cannot find symbol
symbol : class User
location: class org.apache.hadoop.hbase.LocalHBaseCluster
{code}
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
> Assignee: stack
> Fix For: 0.90.0
>
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "HBase Review Board (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929952#action_12929952 ]
HBase Review Board commented on HBASE-3194:
-------------------------------------------
Message from: stack@duboce.net
bq. On 2010-11-08 20:48:32, stack wrote:
bq. > Meant to say I'm +1 on this.
Also, also meant to say that you are getting good at using this Reflection stuff Gary.
- stack
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/1184/#review1857
-----------------------------------------------------------
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "Gary Helmling (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929965#action_12929965 ]
Gary Helmling commented on HBASE-3194:
--------------------------------------
Thanks for the review, Stack.
Yeah, what Todd says. We'll need something like this to work on either CDH3b3 or Y! secure Hadoop 0.20. This issue came up from two different people simultaneously on IRC last week, so we should definitely get something into 0.90.
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-3194.
--------------------------
Resolution: Fixed
Assignee: Gary Helmling
Hadoop Flags: [Reviewed]
Committed. Thanks for the patch Gary.
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
> Assignee: Gary Helmling
> Fix For: 0.90.0
>
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "Gary Helmling (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928074#action_12928074 ]
Gary Helmling commented on HBASE-3194:
--------------------------------------
Using reflection for isolation should work fine and should allow running against both versions without rebuilding. I'm working it out now.
The easy part is getting the current UGI. The harder part is "setting" the current UGI (only needed by MiniHBaseCluster and test code at the moment), since secure Hadoop changed this to UGI.doAs() with a PrivilegedAction instance wrapping the actual execution. I'll sort out an initial attempt at isolating that and we can discuss the general approach.
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3194) HBase should run on both secure and
vanilla versions of Hadoop 0.20
Posted by "HBase Review Board (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929950#action_12929950 ]
HBase Review Board commented on HBASE-3194:
-------------------------------------------
Message from: stack@duboce.net
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/1184/#review1856
-----------------------------------------------------------
Gary. Quality stuff as usual. Patch looks great. Is it true we need this to be able to run on CDH3b3? If so, we need to pull this into 0.90.0.
- stack
> HBase should run on both secure and vanilla versions of Hadoop 0.20
> -------------------------------------------------------------------
>
> Key: HBASE-3194
> URL: https://issues.apache.org/jira/browse/HBASE-3194
> Project: HBase
> Issue Type: Bug
> Reporter: Gary Helmling
>
> There have been a couple cases recently of folks trying to run HBase trunk (or 0.89 DRs) on CDH3b3 or secure Hadoop. While HBase security is in the works, it currently only runs on secure Hadoop versions. Meanwhile HBase trunk won't compile on secure Hadoop due to backward incompatible changes in org.apache.hadoop.security.UserGroupInformation.
> This issue is to work out the minimal set of changes necessary to allow HBase to build and run on both secure and non-secure versions of Hadoop. Though, with secure Hadoop, I don't even think it's important to target running with HDFS security enabled (and krb authentication). Just allow HBase to build and run in both versions.
> I think mainly this amounts to abstracting usage of UserGroupInformation and UnixUserGroupInformation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.