You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by zheyi rong <zh...@gmail.com> on 2013/05/21 12:31:39 UTC
Keep Kerberos credentials valid after logging out
Hi all,
I would like to run my hadoop job in a bash file for several times, e.g.
#!/usr/bin/env bash
for i in {1..10}
do
my-hadoop-job
done
Since I don't want to keep my laptop on for hours, I run this bash script
on a server
via a SSH session.
However, the bash script always terminated after my logging out of that
server by
'ctrl-z, bg, disown, exit'.
Using GNU 'screen' detaching and reattaching, I can see the following
exceptions:
Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided
(Mechanism level: Failed to find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
at
org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
at org.apache.hadoop.ipc.Client.call(Client.java:1121)
... 30 more
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
by GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
at
org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
... 33 more
Caused by: GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)
at
sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
at
sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
at
sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
at
sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
at
sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
at
sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
... 42 more
The cluster is deployed with cdh3.
so how can I keep my script running after logging out ?
Thank you in advance.
Regards,
Zheyi Rong
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
could you please give me a bit more details?
I am really not good at kerberoes.
Thanks.
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:34 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> I think you can have a keytab file for the user and use that for
> authentication. It would renew the credentials when it expires.
>
>
>
> On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
>
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
could you please give me a bit more details?
I am really not good at kerberoes.
Thanks.
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:34 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> I think you can have a keytab file for the user and use that for
> authentication. It would renew the credentials when it expires.
>
>
>
> On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
>
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
could you please give me a bit more details?
I am really not good at kerberoes.
Thanks.
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:34 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> I think you can have a keytab file for the user and use that for
> authentication. It would renew the credentials when it expires.
>
>
>
> On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
>
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
could you please give me a bit more details?
I am really not good at kerberoes.
Thanks.
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:34 PM, Rahul Bhattacharjee <
rahul.rec.dgp@gmail.com> wrote:
> I think you can have a keytab file for the user and use that for
> authentication. It would renew the credentials when it expires.
>
>
>
> On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
>
Re: Keep Kerberos credentials valid after logging out
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
I think you can have a keytab file for the user and use that for
authentication. It would renew the credentials when it expires.
On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>
Re: Keep Kerberos credentials valid after logging out
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
I think you can have a keytab file for the user and use that for
authentication. It would renew the credentials when it expires.
On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
Thanks for answering.
but the same exceptions appeared:
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
13/05/21 19:07:01 WARN ipc.Client: Exception encountered while connecting
to the server : javax.security.sasl.SaslException: GSS initiate failed
[Caused by GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)]
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate
failed [Caused by GSSException: No valid credentials provided (Mechanism
level: Failed to find any Kerberos tgt)]
java.io.IOException: Call to
p-head03.alley.sara.nl/145.100.41.4:8020failed on local exception:
java.io.IOException:
javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1187)
at org.apache.hadoop.ipc.Client.call(Client.java:1155)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
at $Proxy5.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:132)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:259)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:220)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1603)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:69)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1637)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1619)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:255)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:124)
at edu.tue.cs.capa.dps.freq.FreqDriver.run(FreqDriver.java:58)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at edu.tue.cs.capa.dps.freq.FreqDriver.main(FreqDriver.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at edu.tue.cs.capa.dps.driver.SamplingDriver.main(SamplingDriver.java:21)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided
(Mechanism level: Failed to find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
at org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
at org.apache.hadoop.ipc.Client.call(Client.java:1121)
... 30 more
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
by GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
at org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
... 33 more
Caused by: GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)
at
sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
at
sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
at
sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
at
sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
... 42 more
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:22 PM, Azuryy Yu <az...@gmail.com> wrote:
> nohup ./your_bash 1>temp.log 2>&1 &
>
> --Send from my Sony mobile.
> On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
Thanks for answering.
but the same exceptions appeared:
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
13/05/21 19:07:01 WARN ipc.Client: Exception encountered while connecting
to the server : javax.security.sasl.SaslException: GSS initiate failed
[Caused by GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)]
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate
failed [Caused by GSSException: No valid credentials provided (Mechanism
level: Failed to find any Kerberos tgt)]
java.io.IOException: Call to
p-head03.alley.sara.nl/145.100.41.4:8020failed on local exception:
java.io.IOException:
javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1187)
at org.apache.hadoop.ipc.Client.call(Client.java:1155)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
at $Proxy5.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:132)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:259)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:220)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1603)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:69)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1637)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1619)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:255)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:124)
at edu.tue.cs.capa.dps.freq.FreqDriver.run(FreqDriver.java:58)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at edu.tue.cs.capa.dps.freq.FreqDriver.main(FreqDriver.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at edu.tue.cs.capa.dps.driver.SamplingDriver.main(SamplingDriver.java:21)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided
(Mechanism level: Failed to find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
at org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
at org.apache.hadoop.ipc.Client.call(Client.java:1121)
... 30 more
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
by GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
at org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
... 33 more
Caused by: GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)
at
sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
at
sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
at
sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
at
sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
... 42 more
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:22 PM, Azuryy Yu <az...@gmail.com> wrote:
> nohup ./your_bash 1>temp.log 2>&1 &
>
> --Send from my Sony mobile.
> On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
Thanks for answering.
but the same exceptions appeared:
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
13/05/21 19:07:01 WARN ipc.Client: Exception encountered while connecting
to the server : javax.security.sasl.SaslException: GSS initiate failed
[Caused by GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)]
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate
failed [Caused by GSSException: No valid credentials provided (Mechanism
level: Failed to find any Kerberos tgt)]
java.io.IOException: Call to
p-head03.alley.sara.nl/145.100.41.4:8020failed on local exception:
java.io.IOException:
javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1187)
at org.apache.hadoop.ipc.Client.call(Client.java:1155)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
at $Proxy5.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:132)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:259)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:220)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1603)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:69)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1637)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1619)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:255)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:124)
at edu.tue.cs.capa.dps.freq.FreqDriver.run(FreqDriver.java:58)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at edu.tue.cs.capa.dps.freq.FreqDriver.main(FreqDriver.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at edu.tue.cs.capa.dps.driver.SamplingDriver.main(SamplingDriver.java:21)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided
(Mechanism level: Failed to find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
at org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
at org.apache.hadoop.ipc.Client.call(Client.java:1121)
... 30 more
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
by GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
at org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
... 33 more
Caused by: GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)
at
sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
at
sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
at
sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
at
sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
... 42 more
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:22 PM, Azuryy Yu <az...@gmail.com> wrote:
> nohup ./your_bash 1>temp.log 2>&1 &
>
> --Send from my Sony mobile.
> On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
Re: Keep Kerberos credentials valid after logging out
Posted by zheyi rong <zh...@gmail.com>.
Thanks for answering.
but the same exceptions appeared:
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
13/05/21 19:07:01 WARN ipc.Client: Exception encountered while connecting
to the server : javax.security.sasl.SaslException: GSS initiate failed
[Caused by GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)]
13/05/21 19:07:01 ERROR security.UserGroupInformation:
PriviledgedActionException as:s117449 (auth:KERBEROS)
cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate
failed [Caused by GSSException: No valid credentials provided (Mechanism
level: Failed to find any Kerberos tgt)]
java.io.IOException: Call to
p-head03.alley.sara.nl/145.100.41.4:8020failed on local exception:
java.io.IOException:
javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1187)
at org.apache.hadoop.ipc.Client.call(Client.java:1155)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
at $Proxy5.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:132)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:259)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:220)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1603)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:69)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1637)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1619)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:255)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:124)
at edu.tue.cs.capa.dps.freq.FreqDriver.run(FreqDriver.java:58)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at edu.tue.cs.capa.dps.freq.FreqDriver.main(FreqDriver.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at edu.tue.cs.capa.dps.driver.SamplingDriver.main(SamplingDriver.java:21)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided
(Mechanism level: Failed to find any Kerberos tgt)]
at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
at org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
at org.apache.hadoop.ipc.Client.call(Client.java:1121)
... 30 more
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
by GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
at org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
... 33 more
Caused by: GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)
at
sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
at
sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
at
sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
at
sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
... 42 more
Regards,
Zheyi Rong
On Tue, May 21, 2013 at 3:22 PM, Azuryy Yu <az...@gmail.com> wrote:
> nohup ./your_bash 1>temp.log 2>&1 &
>
> --Send from my Sony mobile.
> On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
>
>> Hi all,
>>
>> I would like to run my hadoop job in a bash file for several times, e.g.
>> #!/usr/bin/env bash
>> for i in {1..10}
>> do
>> my-hadoop-job
>> done
>>
>> Since I don't want to keep my laptop on for hours, I run this bash script
>> on a server
>> via a SSH session.
>>
>> However, the bash script always terminated after my logging out of that
>> server by
>> 'ctrl-z, bg, disown, exit'.
>>
>> Using GNU 'screen' detaching and reattaching, I can see the following
>> exceptions:
>>
>> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
>> initiate failed [Caused by GSSException: No valid credentials provided
>> (Mechanism level: Failed to find any Kerberos tgt)]
>> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
>> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
>> ... 30 more
>> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
>> by GSSException: No valid credentials provided (Mechanism level: Failed to
>> find any Kerberos tgt)]
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
>> at
>> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
>> at
>> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
>> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
>> at
>> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
>> ... 33 more
>> Caused by: GSSException: No valid credentials provided (Mechanism level:
>> Failed to find any Kerberos tgt)
>> at
>> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
>> at
>> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
>> at
>> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
>> at
>> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
>> at
>> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
>> ... 42 more
>>
>> The cluster is deployed with cdh3.
>>
>> so how can I keep my script running after logging out ?
>>
>> Thank you in advance.
>>
>> Regards,
>> Zheyi Rong
>>
>
Re: Keep Kerberos credentials valid after logging out
Posted by Azuryy Yu <az...@gmail.com>.
nohup ./your_bash 1>temp.log 2>&1 &
--Send from my Sony mobile.
On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>
Re: Keep Kerberos credentials valid after logging out
Posted by Azuryy Yu <az...@gmail.com>.
nohup ./your_bash 1>temp.log 2>&1 &
--Send from my Sony mobile.
On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>
Re: Keep Kerberos credentials valid after logging out
Posted by Azuryy Yu <az...@gmail.com>.
nohup ./your_bash 1>temp.log 2>&1 &
--Send from my Sony mobile.
On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>
Re: Keep Kerberos credentials valid after logging out
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
I think you can have a keytab file for the user and use that for
authentication. It would renew the credentials when it expires.
On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>
Re: Keep Kerberos credentials valid after logging out
Posted by Azuryy Yu <az...@gmail.com>.
nohup ./your_bash 1>temp.log 2>&1 &
--Send from my Sony mobile.
On May 21, 2013 6:32 PM, "zheyi rong" <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>
Re: Keep Kerberos credentials valid after logging out
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
I think you can have a keytab file for the user and use that for
authentication. It would renew the credentials when it expires.
On Tue, May 21, 2013 at 4:01 PM, zheyi rong <zh...@gmail.com> wrote:
> Hi all,
>
> I would like to run my hadoop job in a bash file for several times, e.g.
> #!/usr/bin/env bash
> for i in {1..10}
> do
> my-hadoop-job
> done
>
> Since I don't want to keep my laptop on for hours, I run this bash script
> on a server
> via a SSH session.
>
> However, the bash script always terminated after my logging out of that
> server by
> 'ctrl-z, bg, disown, exit'.
>
> Using GNU 'screen' detaching and reattaching, I can see the following
> exceptions:
>
> Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
> initiate failed [Caused by GSSException: No valid credentials provided
> (Mechanism level: Failed to find any Kerberos tgt)]
> at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:554)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:499)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:601)
> at
> org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:212)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1292)
> at org.apache.hadoop.ipc.Client.call(Client.java:1121)
> ... 30 more
> Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:194)
> at
> org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:134)
> at
> org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:415)
> at
> org.apache.hadoop.ipc.Client$Connection.access$1100(Client.java:212)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:594)
> at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:591)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:590)
> ... 33 more
> Caused by: GSSException: No valid credentials provided (Mechanism level:
> Failed to find any Kerberos tgt)
> at
> sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:130)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106)
> at
> sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172)
> at
> sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195)
> at
> sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
> at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:175)
> ... 42 more
>
> The cluster is deployed with cdh3.
>
> so how can I keep my script running after logging out ?
>
> Thank you in advance.
>
> Regards,
> Zheyi Rong
>