You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by "Raja.Aravapalli" <Ra...@target.com> on 2017/08/16 23:48:49 UTC
hadoop
Hi,
I triggered an flink yarn-session on a running Hadoop cluster… and triggering streaming application on that.
But, I see after few days of running without any issues, the flink application which is writing data to hdfs failing with below exception.
Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token xxxxxx for xxxxxx) can't be found in cache
Can someone please help me how I can fix this. Thanks a lot.
Regards,
Raja.
Re: hadoop
Posted by Will Du <wi...@gmail.com>.
Is the kerberos token expired without renewing?
> On Aug 16, 2017, at 7:48 PM, Raja.Aravapalli <Ra...@target.com> wrote:
>
>
> Hi,
>
> I triggered an flink yarn-session on a running Hadoop cluster… and triggering streaming application on that.
>
> But, I see after few days of running without any issues, the flink application which is writing data to hdfs failing with below exception.
>
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token xxxxxx for xxxxxx) can't be found in cache
>
>
> Can someone please help me how I can fix this. Thanks a lot.
>
>
>
> Regards,
> Raja.
Re: hadoop
Posted by Ted Yu <yu...@gmail.com>.
Can you check the following config in yarn-site.xml ?
yarn.resourcemanager.proxy-user-privileges.enabled (true)
Cheers
On Wed, Aug 16, 2017 at 4:48 PM, Raja.Aravapalli <Raja.Aravapalli@target.com
> wrote:
>
>
> Hi,
>
>
>
> I triggered an flink yarn-session on a running Hadoop cluster… and
> triggering streaming application on that.
>
>
>
> But, I see after few days of running without any issues, the flink
> application which is writing data to hdfs failing with below exception.
>
>
>
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.
> hadoop.security.token.SecretManager$InvalidToken): token
> (HDFS_DELEGATION_TOKEN token xxxxxx for xxxxxx) can't be found in cache
>
>
>
>
>
> Can someone please help me how I can fix this. Thanks a lot.
>
>
>
>
>
>
>
> Regards,
>
> Raja.
>