You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "stanley shi (JIRA)" <ji...@apache.org> on 2015/11/26 10:36:10 UTC
[jira] [Created] (FLUME-2845)
FLumeAuthenticator.startCredentialRefresher is not called in HDFS sink
source
stanley shi created FLUME-2845:
----------------------------------
Summary: FLumeAuthenticator.startCredentialRefresher is not called in HDFS sink source
Key: FLUME-2845
URL: https://issues.apache.org/jira/browse/FLUME-2845
Project: Flume
Issue Type: Bug
Components: Sinks+Sources
Affects Versions: v1.6.0
Reporter: stanley shi
I have a long running service which uses HDFS sink to push data to a Kerberos-enabled HDFS cluster.
However, the HDFS sink always fail after 10 hours running saying something like:
16 Nov 2015 10:32:54,400 WARN (org.apache.hadoop.security.UserGroupInformation.hasSufficientTimeElapsed:1168) - Not attempting to re-login since the last re-login was attempted less than 600 seconds before.
And then later followed by some " GSS initiate failed".
I checked the FlumeAuthenticator and found that there's a method "startCredentialRefresher" which will spawn a new thread to do relogin.
I believe this method should be called in the HDFSEventSink.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)