You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Robert Levas (JIRA)" <ji...@apache.org> on 2015/02/25 21:36:04 UTC

[jira] [Created] (AMBARI-9802) Phoenix is failing on ambari-installed secure clusters

Robert Levas created AMBARI-9802:
------------------------------------

             Summary: Phoenix is failing on ambari-installed secure clusters
                 Key: AMBARI-9802
                 URL: https://issues.apache.org/jira/browse/AMBARI-9802
             Project: Ambari
          Issue Type: Bug
          Components: ambari-server
    Affects Versions: 2.0.0
            Reporter: Robert Levas
            Assignee: Robert Levas
            Priority: Blocker
             Fix For: 2.0.0


When we use Ambari for installing Phoenix on a secure cluster, all tests are getting blocked by the the accessibility error message:

{noformat}
2015-02-23 09:36:34,019|beaver.machine|INFO|5907|140147204200192|MainThread|15/02/23 09:36:34 WARN ipc.RpcClient: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
2015-02-23 09:36:34,022|beaver.machine|INFO|5907|140147204200192|MainThread|15/02/23 09:36:34 FATAL ipc.RpcClient: SASL authentication failed. The most likely cause is missing or invalid credentials. Consider 'kinit'.
2015-02-23 09:36:34,022|beaver.machine|INFO|5907|140147204200192|MainThread|javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
2015-02-23 09:36:34,023|beaver.machine|INFO|5907|140147204200192|MainThread|at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:212)
2015-02-23 09:36:34,023|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.security.HBaseSaslRpcClient.saslConnect(HBaseSaslRpcClient.java:177)
2015-02-23 09:36:34,024|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupSaslConnection(RpcClient.java:815)
2015-02-23 09:36:34,024|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$Connection.access$800(RpcClient.java:349)
2015-02-23 09:36:34,025|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$Connection$2.run(RpcClient.java:943)
2015-02-23 09:36:34,025|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$Connection$2.run(RpcClient.java:940)
2015-02-23 09:36:34,025|beaver.machine|INFO|5907|140147204200192|MainThread|at java.security.AccessController.doPrivileged(Native Method)
2015-02-23 09:36:34,026|beaver.machine|INFO|5907|140147204200192|MainThread|at javax.security.auth.Subject.doAs(Subject.java:415)
2015-02-23 09:36:34,026|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
2015-02-23 09:36:34,026|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:940)
2015-02-23 09:36:34,027|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$Connection.writeRequest(RpcClient.java:1094)
2015-02-23 09:36:34,027|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$Connection.tracedWriteRequest(RpcClient.java:1061)
2015-02-23 09:36:34,028|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1516)
2015-02-23 09:36:34,028|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1724)
2015-02-23 09:36:34,028|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1777)
2015-02-23 09:36:34,029|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$BlockingStub.isMasterRunning(MasterProtos.java:42561)
2015-02-23 09:36:34,029|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.isMasterRunning(ConnectionManager.java:1698)
2015-02-23 09:36:34,030|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionManager.java:1607)
2015-02-23 09:36:34,030|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1633)
2015-02-23 09:36:34,031|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionManager.java:1687)
2015-02-23 09:36:34,031|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveMasterService(ConnectionManager.java:1904)
2015-02-23 09:36:34,032|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.HBaseAdmin$MasterCallable.prepare(HBaseAdmin.java:3363)
2015-02-23 09:36:34,032|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:125)
2015-02-23 09:36:34,033|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3390)
2015-02-23 09:36:34,033|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.client.HBaseAdmin.getClusterStatus(HBaseAdmin.java:2205)
2015-02-23 09:36:34,033|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.DistributedHBaseCluster.getClusterStatus(DistributedHBaseCluster.java:74)
2015-02-23 09:36:34,034|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.DistributedHBaseCluster.<init>(DistributedHBaseCluster.java:57)
2015-02-23 09:36:34,034|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.IntegrationTestingUtility.createDistributedHBaseCluster(IntegrationTestingUtility.java:140)
2015-02-23 09:36:34,035|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.IntegrationTestingUtility.initializeCluster(IntegrationTestingUtility.java:75)
2015-02-23 09:36:34,035|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.phoenix.query.BaseTest.initClusterDistributedMode(BaseTest.java:586)
2015-02-23 09:36:34,036|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.phoenix.query.BaseTest.setUpTestCluster(BaseTest.java:488)
2015-02-23 09:36:34,036|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.phoenix.query.BaseTest.checkClusterInitialized(BaseTest.java:472)
2015-02-23 09:36:34,036|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:527)
2015-02-23 09:36:34,037|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.phoenix.end2end.BaseHBaseManagedTimeIT.doSetup(BaseHBaseManagedTimeIT.java:72)
2015-02-23 09:36:34,037|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2015-02-23 09:36:34,038|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
2015-02-23 09:36:34,038|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2015-02-23 09:36:34,038|beaver.machine|INFO|5907|140147204200192|MainThread|at java.lang.reflect.Method.invoke(Method.java:606)
2015-02-23 09:36:34,039|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
2015-02-23 09:36:34,039|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2015-02-23 09:36:34,039|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
2015-02-23 09:36:34,040|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
2015-02-23 09:36:34,040|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2015-02-23 09:36:34,041|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
2015-02-23 09:36:34,041|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.Suite.runChild(Suite.java:127)
2015-02-23 09:36:34,041|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.Suite.runChild(Suite.java:26)
2015-02-23 09:36:34,042|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
2015-02-23 09:36:34,042|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
2015-02-23 09:36:34,042|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
2015-02-23 09:36:34,043|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
2015-02-23 09:36:34,043|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
2015-02-23 09:36:34,043|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
2015-02-23 09:36:34,044|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
2015-02-23 09:36:34,044|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runner.JUnitCore.run(JUnitCore.java:138)
2015-02-23 09:36:34,045|beaver.machine|INFO|5907|140147204200192|MainThread|at org.junit.runner.JUnitCore.run(JUnitCore.java:117)
2015-02-23 09:36:34,045|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.phoenix.end2end.End2EndTestDriver.doWork(End2EndTestDriver.java:203)
2015-02-23 09:36:34,045|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:112)
2015-02-23 09:36:34,046|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
2015-02-23 09:36:34,046|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
2015-02-23 09:36:34,046|beaver.machine|INFO|5907|140147204200192|MainThread|at org.apache.phoenix.end2end.End2EndTestDriver.main(End2EndTestDriver.java:58)
2015-02-23 09:36:34,047|beaver.machine|INFO|5907|140147204200192|MainThread|Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)
2015-02-23 09:36:34,047|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147)
2015-02-23 09:36:34,048|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:121)
2015-02-23 09:36:34,048|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187)
2015-02-23 09:36:34,048|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:223)
2015-02-23 09:36:34,049|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212)
2015-02-23 09:36:34,049|beaver.machine|INFO|5907|140147204200192|MainThread|at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179)
2015-02-23 09:36:34,050|beaver.machine|INFO|5907|140147204200192|MainThread|at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:193)
2015-02-23 09:36:34,050|beaver.machine|INFO|5907|140147204200192|MainThread|... 59 more
{noformat}

I can provide debugging EC2 machines on request for debugging purposes. [~jzhong], can you take a look see what might be blocking access for phoenix? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)