You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ranger.apache.org by Margus Roo <ma...@roo.ee> on 2016/08/10 09:32:09 UTC

hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter Exception encountered while connecting to the server GSS initiate failed No valid credentials provided

Hi

I am using Hortonworks HDP-2.3.4.0 and Ranger 0.5.0.2.3.

I configured Ranger to write Hive audit log to HDFS.

After restarting Hive it writes audit log to HDFS about two days and 
after it gives following error in Hive log:
2016-08-10 09:31:34,438 INFO 
[hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
provider.BaseAuditHandler (BaseAuditHandler.java:logStatus(312)) - Audit 
Status Log: name=hiveServer2.async.summary.batch.hdfs, 
interval=01:00.066 minutes, events=1, deferredCount=1, totalEvents=6657, 
totalSuccessCount=5203, totalDeferredCount=1454
2016-08-10 09:31:34,443 INFO 
[hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
destination.HDFSAuditDestination 
(HDFSAuditDestination.java:createConfiguration(263)) - Returning HDFS 
Filesystem Config: Configuration: core-default.xml, core-site.xml, 
mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, 
hdfs-default.xml, hdfs-site.xml
2016-08-10 09:31:34,457 INFO 
[hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
destination.HDFSAuditDestination 
(HDFSAuditDestination.java:getLogFileStream(224)) - Checking whether log 
file exists. 
hdfPath=hdfs://mycluster/datasource/ranger/audit/hiveServer2//2016/08/10/hiveServer2_ranger_audit_hadoopnn1.estpak.ee.log, 
UGI=hive/hadoopnn1.estpak.ee@TESTHADOOP.COM (auth:KERBEROS)
2016-08-10 09:31:34,459 WARN 
[hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
ipc.Client (Client.java:run(680)) - Exception encountered while 
connecting to the server :
javax.security.sasl.SaslException: GSS initiate failed [Caused by 
GSSException: No valid credentials provided (Mechanism level: Failed to 
find any Kerberos tgt)]


Hive is still working correctly after it. After restarting Hive it 
writes again audit log to HDFS about two days.

Any hints?

-- 
Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780

Re: hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter Exception encountered while connecting to the server GSS initiate failed No valid credentials provided

Posted by Ramesh Mani <rm...@hortonworks.com>.
Margus

This has to ported to Ranger 0.5, no work around for it now.

Thanks,
Ramesh


From: Margus Roo <ma...@roo.ee>>
Reply-To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Date: Wednesday, August 10, 2016 at 9:21 AM
To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Subject: Re: hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter Exception encountered while connecting to the server GSS initiate failed No valid credentials provided


Is there temporary fix? In HDP-2.3.4.0 threre is Ranger 0.5 available. And I do not know when 0.7 will be in HDP.

Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780

On 10/08/16 18:54, Ramesh Mani wrote:
Margus,

This is was fixed in this apache jira https://issues.apache.org/jira/browse/RANGER-1136

Thanks,
Ramesh

From: Margus Roo <ma...@roo.ee>>
Reply-To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Date: Wednesday, August 10, 2016 at 2:32 AM
To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Subject: hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter Exception encountered while connecting to the server GSS initiate failed No valid credentials provided

Hi

I am using Hortonworks HDP-2.3.4.0 and Ranger 0.5.0.2.3.

I configured Ranger to write Hive audit log to HDFS.

After restarting Hive it writes audit log to HDFS about two days and after it gives following error in Hive log:
2016-08-10 09:31:34,438 INFO  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: provider.BaseAuditHandler (BaseAuditHandler.java:logStatus(312)) - Audit Status Log: name=hiveServer2.async.summary.batch.hdfs, interval=01:00.066 minutes, events=1, deferredCount=1, totalEvents=6657, totalSuccessCount=5203, totalDeferredCount=1454
2016-08-10 09:31:34,443 INFO  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: destination.HDFSAuditDestination (HDFSAuditDestination.java:createConfiguration(263)) - Returning HDFS Filesystem Config: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml
2016-08-10 09:31:34,457 INFO  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: destination.HDFSAuditDestination (HDFSAuditDestination.java:getLogFileStream(224)) - Checking whether log file exists. hdfPath=hdfs://mycluster/datasource/ranger/audit/hiveServer2//2016/08/10/hiveServer2_ranger_audit_hadoopnn1.estpak.ee.log, UGI=hive/hadoopnn1.estpak.ee@TESTHADOOP.COM<ma...@TESTHADOOP.COM> (auth:KERBEROS)
2016-08-10 09:31:34,459 WARN  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: ipc.Client (Client.java:run(680)) - Exception encountered while connecting to the server :
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]


Hive is still working correctly after it. After restarting Hive it writes again audit log to HDFS about two days.

Any hints?

--
Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780

Re: hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter Exception encountered while connecting to the server GSS initiate failed No valid credentials provided

Posted by Margus Roo <ma...@roo.ee>.
Is there temporary fix? In HDP-2.3.4.0 threre is Ranger 0.5 available. And I do not know when 0.7 will be in HDP.

Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780

On 10/08/16 18:54, Ramesh Mani wrote:
> Margus,
>
> This is was fixed in this apache jira 
> https://issues.apache.org/jira/browse/RANGER-1136
>
> Thanks,
> Ramesh
>
> From: Margus Roo <margus@roo.ee <ma...@roo.ee>>
> Reply-To: "user@ranger.incubator.apache.org 
> <ma...@ranger.incubator.apache.org>" 
> <user@ranger.incubator.apache.org 
> <ma...@ranger.incubator.apache.org>>
> Date: Wednesday, August 10, 2016 at 2:32 AM
> To: "user@ranger.incubator.apache.org 
> <ma...@ranger.incubator.apache.org>" 
> <user@ranger.incubator.apache.org 
> <ma...@ranger.incubator.apache.org>>
> Subject: 
> hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter 
> Exception encountered while connecting to the server GSS initiate 
> failed No valid credentials provided
>
> Hi
>
> I am using Hortonworks HDP-2.3.4.0 and Ranger 0.5.0.2.3.
>
> I configured Ranger to write Hive audit log to HDFS.
>
> After restarting Hive it writes audit log to HDFS about two days and 
> after it gives following error in Hive log:
> 2016-08-10 09:31:34,438 INFO 
> [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
> provider.BaseAuditHandler (BaseAuditHandler.java:logStatus(312)) - 
> Audit Status Log: name=hiveServer2.async.summary.batch.hdfs, 
> interval=01:00.066 minutes, events=1, deferredCount=1, 
> totalEvents=6657, totalSuccessCount=5203, totalDeferredCount=1454
> 2016-08-10 09:31:34,443 INFO 
> [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
> destination.HDFSAuditDestination 
> (HDFSAuditDestination.java:createConfiguration(263)) - Returning HDFS 
> Filesystem Config: Configuration: core-default.xml, core-site.xml, 
> mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, 
> hdfs-default.xml, hdfs-site.xml
> 2016-08-10 09:31:34,457 INFO 
> [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
> destination.HDFSAuditDestination 
> (HDFSAuditDestination.java:getLogFileStream(224)) - Checking whether 
> log file exists. 
> hdfPath=hdfs://mycluster/datasource/ranger/audit/hiveServer2//2016/08/10/hiveServer2_ranger_audit_hadoopnn1.estpak.ee.log,UGI=hive/hadoopnn1.estpak.ee@TESTHADOOP.COM 
> (auth:KERBEROS)
> 2016-08-10 09:31:34,459 WARN 
> [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: 
> ipc.Client (Client.java:run(680)) - Exception encountered while 
> connecting to the server :
> javax.security.sasl.SaslException: GSS initiate failed [Caused by 
> GSSException: No valid credentials provided (Mechanism level: Failed 
> to find any Kerberos tgt)]
>
>
> Hive is still working correctly after it. After restarting Hive it 
> writes again audit log to HDFS about two days.
>
> Any hints?
> -- 
> Margus (margusja) Roo
> http://margus.roo.ee
> skype: margusja
> +372 51 48 780

Re: hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter Exception encountered while connecting to the server GSS initiate failed No valid credentials provided

Posted by Ramesh Mani <rm...@hortonworks.com>.
Margus,

This is was fixed in this apache jira https://issues.apache.org/jira/browse/RANGER-1136

Thanks,
Ramesh
<https://issues.apache.org/jira/browse/RANGER-1136>

From: Margus Roo <ma...@roo.ee>>
Reply-To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Date: Wednesday, August 10, 2016 at 2:32 AM
To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Subject: hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter Exception encountered while connecting to the server GSS initiate failed No valid credentials provided

Hi

I am using Hortonworks HDP-2.3.4.0 and Ranger 0.5.0.2.3.

I configured Ranger to write Hive audit log to HDFS.

After restarting Hive it writes audit log to HDFS about two days and after it gives following error in Hive log:
2016-08-10 09:31:34,438 INFO  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: provider.BaseAuditHandler (BaseAuditHandler.java:logStatus(312)) - Audit Status Log: name=hiveServer2.async.summary.batch.hdfs, interval=01:00.066 minutes, events=1, deferredCount=1, totalEvents=6657, totalSuccessCount=5203, totalDeferredCount=1454
2016-08-10 09:31:34,443 INFO  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: destination.HDFSAuditDestination (HDFSAuditDestination.java:createConfiguration(263)) - Returning HDFS Filesystem Config: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml
2016-08-10 09:31:34,457 INFO  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: destination.HDFSAuditDestination (HDFSAuditDestination.java:getLogFileStream(224)) - Checking whether log file exists. hdfPath=hdfs://mycluster/datasource/ranger/audit/hiveServer2//2016/08/10/hiveServer2_ranger_audit_hadoopnn1.estpak.ee.log, UGI=hive/hadoopnn1.estpak.ee@TESTHADOOP.COM<ma...@TESTHADOOP.COM> (auth:KERBEROS)
2016-08-10 09:31:34,459 WARN  [hiveServer2.async.summary.batch_hiveServer2.async.summary.batch.hdfs_destWriter]: ipc.Client (Client.java:run(680)) - Exception encountered while connecting to the server :
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]


Hive is still working correctly after it. After restarting Hive it writes again audit log to HDFS about two days.

Any hints?

--
Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780