You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2015/12/22 11:07:22 UTC

Review Request 41639: Enable kerberos security after express upgrade has failed at Start service step because of slider client xml permission.

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41639/
-----------------------------------------------------------

Review request for Ambari, Dmitro Lisnichenko and Vitalyi Brodetskyi.


Bugs: AMBARI-14460
    https://issues.apache.org/jira/browse/AMBARI-14460


Repository: ambari


Description
-------

Upgrade is successful.
Issue appearing while enabling security after upgrade is over in start services step.
Service check for slider is also failed when executed on the cluster with permission related issue.
Here is error log

resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab ambari-qa@EXAMPLE.COM; /usr/hdp/current/slider-client/bin/slider list' returned 56. ######## Hortonworks #############
This is MOTD message, added for testing in qe infra
2015-12-18 07:16:17,826 [main] FATAL conf.Configuration - error parsing conf slider-client.xml
java.io.FileNotFoundException: /etc/slider/2.3.4.0-3485/0/slider-client.xml (Permission denied)
	at java.io.FileInputStream.open0(Native Method)
	at java.io.FileInputStream.open(FileInputStream.java:195)
	at java.io.FileInputStream.<init>(FileInputStream.java:138)
	at java.io.FileInputStream.<init>(FileInputStream.java:93)
	at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
	at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
	at java.net.URL.openStream(URL.java:1038)
	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502)
    
When I checked the permission of the file on upgrade cluster. It does not have read permission for file slider-client.xml for "others". causing service check for slider fail.

root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.4.0-3485/0/
total 12
-rw-r--r-- 1 root root 2375 Dec 18 02:05 log4j.properties
-rw-r----- 1 root root   41 Dec 18 02:05 slider-client.xml
-rwxr-xr-x 1 root root  509 Dec 18 02:34 slider-env.sh
root@os-d7-dkezlu-ambari-eu-7-5:~#

Before upgrade permission was more open

root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.2.0-2950/0/
total 20
-rw-r--r-- 1 root root 2375 Dec 18 00:38 log4j.properties
-rw-r--r-- 1 root root 3025 Sep 30 21:11 log4j-server.properties
-rw-r--r-- 1 root root   41 Dec 18 00:38 slider-client.xml
-rwxr-xr-x 1 root root  509 Dec 18 03:06 slider-env.sh
-rw-r--r-- 1 root root 2286 Sep 30 21:11 slider-server.xml
root@os-d7-dkezlu-ambari-eu-7-5:~#


Diffs
-----

  ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/slider.py 3799c5b 
  ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 01787a1 

Diff: https://reviews.apache.org/r/41639/diff/


Testing
-------

Unit tests passed


Thanks,

Dmytro Sen


Re: Review Request 41639: Enable kerberos security after express upgrade has failed at Start service step because of slider client xml permission.

Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41639/#review111603
-----------------------------------------------------------

Ship it!


Ship It!

- Vitalyi Brodetskyi


On Гру. 22, 2015, 10:07 до полудня, Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41639/
> -----------------------------------------------------------
> 
> (Updated Гру. 22, 2015, 10:07 до полудня)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-14460
>     https://issues.apache.org/jira/browse/AMBARI-14460
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Upgrade is successful.
> Issue appearing while enabling security after upgrade is over in start services step.
> Service check for slider is also failed when executed on the cluster with permission related issue.
> Here is error log
> 
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab ambari-qa@EXAMPLE.COM; /usr/hdp/current/slider-client/bin/slider list' returned 56. ######## Hortonworks #############
> This is MOTD message, added for testing in qe infra
> 2015-12-18 07:16:17,826 [main] FATAL conf.Configuration - error parsing conf slider-client.xml
> java.io.FileNotFoundException: /etc/slider/2.3.4.0-3485/0/slider-client.xml (Permission denied)
> 	at java.io.FileInputStream.open0(Native Method)
> 	at java.io.FileInputStream.open(FileInputStream.java:195)
> 	at java.io.FileInputStream.<init>(FileInputStream.java:138)
> 	at java.io.FileInputStream.<init>(FileInputStream.java:93)
> 	at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
> 	at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
> 	at java.net.URL.openStream(URL.java:1038)
> 	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
> 	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
> 	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502)
>     
> When I checked the permission of the file on upgrade cluster. It does not have read permission for file slider-client.xml for "others". causing service check for slider fail.
> 
> root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.4.0-3485/0/
> total 12
> -rw-r--r-- 1 root root 2375 Dec 18 02:05 log4j.properties
> -rw-r----- 1 root root   41 Dec 18 02:05 slider-client.xml
> -rwxr-xr-x 1 root root  509 Dec 18 02:34 slider-env.sh
> root@os-d7-dkezlu-ambari-eu-7-5:~#
> 
> Before upgrade permission was more open
> 
> root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.2.0-2950/0/
> total 20
> -rw-r--r-- 1 root root 2375 Dec 18 00:38 log4j.properties
> -rw-r--r-- 1 root root 3025 Sep 30 21:11 log4j-server.properties
> -rw-r--r-- 1 root root   41 Dec 18 00:38 slider-client.xml
> -rwxr-xr-x 1 root root  509 Dec 18 03:06 slider-env.sh
> -rw-r--r-- 1 root root 2286 Sep 30 21:11 slider-server.xml
> root@os-d7-dkezlu-ambari-eu-7-5:~#
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/slider.py 3799c5b 
>   ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 01787a1 
> 
> Diff: https://reviews.apache.org/r/41639/diff/
> 
> 
> Testing
> -------
> 
> Unit tests passed
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Re: Review Request 41639: Enable kerberos security after express upgrade has failed at Start service step because of slider client xml permission.

Posted by Matt <mi...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41639/#review111593
-----------------------------------------------------------

Ship it!


Ship It!

- Matt


On Dec. 22, 2015, 2:07 a.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41639/
> -----------------------------------------------------------
> 
> (Updated Dec. 22, 2015, 2:07 a.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-14460
>     https://issues.apache.org/jira/browse/AMBARI-14460
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Upgrade is successful.
> Issue appearing while enabling security after upgrade is over in start services step.
> Service check for slider is also failed when executed on the cluster with permission related issue.
> Here is error log
> 
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab ambari-qa@EXAMPLE.COM; /usr/hdp/current/slider-client/bin/slider list' returned 56. ######## Hortonworks #############
> This is MOTD message, added for testing in qe infra
> 2015-12-18 07:16:17,826 [main] FATAL conf.Configuration - error parsing conf slider-client.xml
> java.io.FileNotFoundException: /etc/slider/2.3.4.0-3485/0/slider-client.xml (Permission denied)
> 	at java.io.FileInputStream.open0(Native Method)
> 	at java.io.FileInputStream.open(FileInputStream.java:195)
> 	at java.io.FileInputStream.<init>(FileInputStream.java:138)
> 	at java.io.FileInputStream.<init>(FileInputStream.java:93)
> 	at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
> 	at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
> 	at java.net.URL.openStream(URL.java:1038)
> 	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
> 	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
> 	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502)
>     
> When I checked the permission of the file on upgrade cluster. It does not have read permission for file slider-client.xml for "others". causing service check for slider fail.
> 
> root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.4.0-3485/0/
> total 12
> -rw-r--r-- 1 root root 2375 Dec 18 02:05 log4j.properties
> -rw-r----- 1 root root   41 Dec 18 02:05 slider-client.xml
> -rwxr-xr-x 1 root root  509 Dec 18 02:34 slider-env.sh
> root@os-d7-dkezlu-ambari-eu-7-5:~#
> 
> Before upgrade permission was more open
> 
> root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.2.0-2950/0/
> total 20
> -rw-r--r-- 1 root root 2375 Dec 18 00:38 log4j.properties
> -rw-r--r-- 1 root root 3025 Sep 30 21:11 log4j-server.properties
> -rw-r--r-- 1 root root   41 Dec 18 00:38 slider-client.xml
> -rwxr-xr-x 1 root root  509 Dec 18 03:06 slider-env.sh
> -rw-r--r-- 1 root root 2286 Sep 30 21:11 slider-server.xml
> root@os-d7-dkezlu-ambari-eu-7-5:~#
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/slider.py 3799c5b 
>   ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 01787a1 
> 
> Diff: https://reviews.apache.org/r/41639/diff/
> 
> 
> Testing
> -------
> 
> Unit tests passed
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Re: Review Request 41639: Enable kerberos security after express upgrade has failed at Start service step because of slider client xml permission.

Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41639/#review111602
-----------------------------------------------------------

Ship it!


Ship It!

- Dmitro Lisnichenko


On Dec. 22, 2015, 12:07 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41639/
> -----------------------------------------------------------
> 
> (Updated Dec. 22, 2015, 12:07 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-14460
>     https://issues.apache.org/jira/browse/AMBARI-14460
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Upgrade is successful.
> Issue appearing while enabling security after upgrade is over in start services step.
> Service check for slider is also failed when executed on the cluster with permission related issue.
> Here is error log
> 
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab ambari-qa@EXAMPLE.COM; /usr/hdp/current/slider-client/bin/slider list' returned 56. ######## Hortonworks #############
> This is MOTD message, added for testing in qe infra
> 2015-12-18 07:16:17,826 [main] FATAL conf.Configuration - error parsing conf slider-client.xml
> java.io.FileNotFoundException: /etc/slider/2.3.4.0-3485/0/slider-client.xml (Permission denied)
> 	at java.io.FileInputStream.open0(Native Method)
> 	at java.io.FileInputStream.open(FileInputStream.java:195)
> 	at java.io.FileInputStream.<init>(FileInputStream.java:138)
> 	at java.io.FileInputStream.<init>(FileInputStream.java:93)
> 	at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
> 	at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
> 	at java.net.URL.openStream(URL.java:1038)
> 	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
> 	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
> 	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502)
>     
> When I checked the permission of the file on upgrade cluster. It does not have read permission for file slider-client.xml for "others". causing service check for slider fail.
> 
> root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.4.0-3485/0/
> total 12
> -rw-r--r-- 1 root root 2375 Dec 18 02:05 log4j.properties
> -rw-r----- 1 root root   41 Dec 18 02:05 slider-client.xml
> -rwxr-xr-x 1 root root  509 Dec 18 02:34 slider-env.sh
> root@os-d7-dkezlu-ambari-eu-7-5:~#
> 
> Before upgrade permission was more open
> 
> root@os-d7-dkezlu-ambari-eu-7-5:~# ls -l /etc/slider/2.3.2.0-2950/0/
> total 20
> -rw-r--r-- 1 root root 2375 Dec 18 00:38 log4j.properties
> -rw-r--r-- 1 root root 3025 Sep 30 21:11 log4j-server.properties
> -rw-r--r-- 1 root root   41 Dec 18 00:38 slider-client.xml
> -rwxr-xr-x 1 root root  509 Dec 18 03:06 slider-env.sh
> -rw-r--r-- 1 root root 2286 Sep 30 21:11 slider-server.xml
> root@os-d7-dkezlu-ambari-eu-7-5:~#
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/slider.py 3799c5b 
>   ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 01787a1 
> 
> Diff: https://reviews.apache.org/r/41639/diff/
> 
> 
> Testing
> -------
> 
> Unit tests passed
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>