You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2014/09/16 08:38:59 UTC

issue about let a common user run application on YARN (with kerberose)

hi,maillist:

       i use kerberos to do auth for my hadoop cluster, i have a 3-node
cluster(HDFS

& YARN)

z1.example.com (NN,RM)
z2.example.com (NM,DN)
z3.example.com (NM,DN,proxyserver,historyserver)

i create principal for NN&DN
hdfs/z1.example.com@EXAMPLE.COM
hdfs/z2.example.com@EXAMPLE.COM
hdfs/z3.example.com@EXAMPLE.COM

and for RM&NM

yarn/z1.example.com@EXAMPLE.COM
yarn/z2.example.com@EXAMPLE.COM
yarn/z3.example.com@EXAMPLE.COM

for mapreduce history server

mapred/z1.example.com@EXAMPLE.COM
mapred/z2.example.com@EXAMPLE.COM
mapred/z3.example.com@EXAMPLE.COM

for http principals in SPNEGO (instead of kerberos SSL for HTTP
transactions)

HTTP/z1.example.com@EXAMPLE.COM
HTTP/z2.example.com@EXAMPLE.COM
HTTP/z3.example.com@EXAMPLE.COM

and i can start cluster (HDFS & YARN) successfully

but i do not know how to let a common user to run application on yarn ,(i
am not know kerberos),any one can help?

RE: issue about let a common user run application on YARN (with kerberose)

Posted by "Liu, Yi A" <yi...@intel.com>.

You need to do authentication using “kinit” (in linux) for the user you want to use. Then you can run your application.

For more information, please refer to:
http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-common/SecureMode.html


Regards,
Yi Liu

From: ch huang [mailto:justlooks@gmail.com]
Sent: Tuesday, September 16, 2014 2:39 PM
To: user@hadoop.apache.org
Subject: issue about let a common user run application on YARN (with kerberose)

hi,maillist:

       i use kerberos to do auth for my hadoop cluster, i have a 3-node cluster(HDFS

& YARN)

z1.example.com<http://z1.example.com> (NN,RM)
z2.example.com<http://z2.example.com> (NM,DN)
z3.example.com<http://z3.example.com> (NM,DN,proxyserver,historyserver)

i create principal for NN&DN
hdfs/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and for RM&NM

yarn/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for mapreduce history server

mapred/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for http principals in SPNEGO (instead of kerberos SSL for HTTP transactions)

HTTP/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and i can start cluster (HDFS & YARN) successfully

but i do not know how to let a common user to run application on yarn ,(i am not know kerberos),any one can help?

RE: issue about let a common user run application on YARN (with kerberose)

Posted by "Liu, Yi A" <yi...@intel.com>.

You need to do authentication using “kinit” (in linux) for the user you want to use. Then you can run your application.

For more information, please refer to:
http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-common/SecureMode.html


Regards,
Yi Liu

From: ch huang [mailto:justlooks@gmail.com]
Sent: Tuesday, September 16, 2014 2:39 PM
To: user@hadoop.apache.org
Subject: issue about let a common user run application on YARN (with kerberose)

hi,maillist:

       i use kerberos to do auth for my hadoop cluster, i have a 3-node cluster(HDFS

& YARN)

z1.example.com<http://z1.example.com> (NN,RM)
z2.example.com<http://z2.example.com> (NM,DN)
z3.example.com<http://z3.example.com> (NM,DN,proxyserver,historyserver)

i create principal for NN&DN
hdfs/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and for RM&NM

yarn/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for mapreduce history server

mapred/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for http principals in SPNEGO (instead of kerberos SSL for HTTP transactions)

HTTP/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and i can start cluster (HDFS & YARN) successfully

but i do not know how to let a common user to run application on yarn ,(i am not know kerberos),any one can help?

RE: issue about let a common user run application on YARN (with kerberose)

Posted by "Liu, Yi A" <yi...@intel.com>.

You need to do authentication using “kinit” (in linux) for the user you want to use. Then you can run your application.

For more information, please refer to:
http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-common/SecureMode.html


Regards,
Yi Liu

From: ch huang [mailto:justlooks@gmail.com]
Sent: Tuesday, September 16, 2014 2:39 PM
To: user@hadoop.apache.org
Subject: issue about let a common user run application on YARN (with kerberose)

hi,maillist:

       i use kerberos to do auth for my hadoop cluster, i have a 3-node cluster(HDFS

& YARN)

z1.example.com<http://z1.example.com> (NN,RM)
z2.example.com<http://z2.example.com> (NM,DN)
z3.example.com<http://z3.example.com> (NM,DN,proxyserver,historyserver)

i create principal for NN&DN
hdfs/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and for RM&NM

yarn/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for mapreduce history server

mapred/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for http principals in SPNEGO (instead of kerberos SSL for HTTP transactions)

HTTP/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and i can start cluster (HDFS & YARN) successfully

but i do not know how to let a common user to run application on yarn ,(i am not know kerberos),any one can help?

RE: issue about let a common user run application on YARN (with kerberose)

Posted by "Liu, Yi A" <yi...@intel.com>.

You need to do authentication using “kinit” (in linux) for the user you want to use. Then you can run your application.

For more information, please refer to:
http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-common/SecureMode.html


Regards,
Yi Liu

From: ch huang [mailto:justlooks@gmail.com]
Sent: Tuesday, September 16, 2014 2:39 PM
To: user@hadoop.apache.org
Subject: issue about let a common user run application on YARN (with kerberose)

hi,maillist:

       i use kerberos to do auth for my hadoop cluster, i have a 3-node cluster(HDFS

& YARN)

z1.example.com<http://z1.example.com> (NN,RM)
z2.example.com<http://z2.example.com> (NM,DN)
z3.example.com<http://z3.example.com> (NM,DN,proxyserver,historyserver)

i create principal for NN&DN
hdfs/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
hdfs/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and for RM&NM

yarn/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
yarn/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for mapreduce history server

mapred/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
mapred/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

for http principals in SPNEGO (instead of kerberos SSL for HTTP transactions)

HTTP/z1.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z2.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>
HTTP/z3.example.com@EXAMPLE.COM<ma...@EXAMPLE.COM>

and i can start cluster (HDFS & YARN) successfully

but i do not know how to let a common user to run application on yarn ,(i am not know kerberos),any one can help?