You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by "Raja.Aravapalli" <Ra...@target.com> on 2016/07/22 05:14:46 UTC

delegation token not found in cache

Hi,

Can someone please help me why my DAG is failing with below exception after 8 days running succesfully!!



Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 000000 for <USER>) can't be found in cache
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)




Thanks a lot.

Regards,
Raja.

Re: delegation token not found in cache

Posted by Ashwin Chandra Putta <as...@gmail.com>.
Raja,

Not sure if this is an Apex issue. Seems like there was a fix for this
issue in hdfs version 2.3. See
https://issues.apache.org/jira/browse/HDFS-5322

Which version of hadoop are you on?

Regards,
Ashwin.

On Thu, Jul 21, 2016 at 10:14 PM, Raja.Aravapalli <
Raja.Aravapalli@target.com> wrote:

>
> Hi,
>
> Can someone please help me why my DAG is failing with below exception
> after 8 days running succesfully!!
>
>
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 000000 for <USER>) can't be found in cache
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1427)
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1358)
>
>
>
>
> Thanks a lot.
>
> Regards,
> Raja.
>
>


-- 

Regards,
Ashwin.

Re: delegation token not found in cache

Posted by Vlad Rozov <v....@datatorrent.com>.
Please open JIRA against Apex Core and attach relevant logs.

Thank you,

Vlad

On 7/21/16 22:14, Raja.Aravapalli wrote:
>
> Hi,
>
> Can someone please help me why my DAG is failing with below exception 
> after 8 days running succesfully!!
>
>
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 000000 for <USER>) can't be found in cache
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1427)
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1358)
> Thanks a lot.
> Regards,
> Raja.


Re: delegation token not found in cache

Posted by "Pradeep A. Dalvi" <pr...@apache.org>.
Could you run following commands?

klist

klist -kt <keytab file path>

--prad

On Thu, Jul 21, 2016 at 10:14 PM, Raja.Aravapalli <
Raja.Aravapalli@target.com> wrote:

>
> Hi,
>
> Can someone please help me why my DAG is failing with below exception
> after 8 days running succesfully!!
>
>
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 000000 for <USER>) can't be found in cache
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1427)
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1358)
>
>
>
>
> Thanks a lot.
>
> Regards,
> Raja.
>
>