You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2015/04/14 10:00:42 UTC
Review Request 33163: Spark History Server does not start with
non-root agent
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33163/
-----------------------------------------------------------
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-10461
https://issues.apache.org/jira/browse/AMBARI-10461
Repository: ambari
Description
-------
When using a non-root agent, the Spark History Server fails to start even
though Ambari thinks the component Started. It appears that there is a failure
to create the: /etc/spark/conf/spark-defaults.conf file. No logs are produced
in /var/log/spark:
[ambari@revo5 spark]$ pwd
/var/log/spark
[ambari@revo5 spark]$ find .
.
[ambari@revo5 spark]$
This is with Ambari 2.0.0-148 with Stack: 2.2.3.0-2611.
There are no traces of spark-default.conf in /var/log/secure. So it seems like
it's trying to create the directory and file without using sudo, which in this
case will fail as Ambari Agent is running as a non-root 'ambari' user.
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/__init__.py 6b3d572
ambari-common/src/main/python/resource_management/libraries/providers/properties_file.py 8b2eba7
ambari-common/src/main/python/resource_management/libraries/resources/properties_file.py 0e5afb4
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py ff04b58
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py 7b8ba38
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py 6935b08
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py 970dc6d
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_service.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 469f68e
ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_service_check.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/configs/default.json 0a9a132
ambari-server/src/test/python/stacks/2.2/configs/secured.json b2afe06
Diff: https://reviews.apache.org/r/33163/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 33163: Spark History Server does not start with
non-root agent
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33163/
-----------------------------------------------------------
(Updated April 14, 2015, 8:07 a.m.)
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-10461
https://issues.apache.org/jira/browse/AMBARI-10461
Repository: ambari
Description
-------
When using a non-root agent, the Spark History Server fails to start even
though Ambari thinks the component Started. It appears that there is a failure
to create the: /etc/spark/conf/spark-defaults.conf file. No logs are produced
in /var/log/spark:
[ambari@revo5 spark]$ pwd
/var/log/spark
[ambari@revo5 spark]$ find .
.
[ambari@revo5 spark]$
This is with Ambari 2.0.0-148 with Stack: 2.2.3.0-2611.
There are no traces of spark-default.conf in /var/log/secure. So it seems like
it's trying to create the directory and file without using sudo, which in this
case will fail as Ambari Agent is running as a non-root 'ambari' user.
Diffs (updated)
-----
ambari-common/src/main/python/resource_management/libraries/functions/__init__.py 6b3d572
ambari-common/src/main/python/resource_management/libraries/providers/properties_file.py 8b2eba7
ambari-common/src/main/python/resource_management/libraries/resources/properties_file.py 0e5afb4
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py ff04b58
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py 7b8ba38
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py 6935b08
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py 970dc6d
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_service.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/KNOX/test_knox_gateway.py c5ebbc0
ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 9ad4b02
ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 469f68e
ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_service_check.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/configs/default.json 0a9a132
ambari-server/src/test/python/stacks/2.2/configs/secured.json b2afe06
Diff: https://reviews.apache.org/r/33163/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 33163: Spark History Server does not start with
non-root agent
Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33163/#review80001
-----------------------------------------------------------
Ship it!
Ship It!
- Vitalyi Brodetskyi
On Квітень 14, 2015, 8 до полудня, Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33163/
> -----------------------------------------------------------
>
> (Updated Квітень 14, 2015, 8 до полудня)
>
>
> Review request for Ambari and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-10461
> https://issues.apache.org/jira/browse/AMBARI-10461
>
>
> Repository: ambari
>
>
> Description
> -------
>
> When using a non-root agent, the Spark History Server fails to start even
> though Ambari thinks the component Started. It appears that there is a failure
> to create the: /etc/spark/conf/spark-defaults.conf file. No logs are produced
> in /var/log/spark:
>
>
>
> [ambari@revo5 spark]$ pwd
> /var/log/spark
> [ambari@revo5 spark]$ find .
> .
> [ambari@revo5 spark]$
>
>
> This is with Ambari 2.0.0-148 with Stack: 2.2.3.0-2611.
>
> There are no traces of spark-default.conf in /var/log/secure. So it seems like
> it's trying to create the directory and file without using sudo, which in this
> case will fail as Ambari Agent is running as a non-root 'ambari' user.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/__init__.py 6b3d572
> ambari-common/src/main/python/resource_management/libraries/providers/properties_file.py 8b2eba7
> ambari-common/src/main/python/resource_management/libraries/resources/properties_file.py 0e5afb4
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py ff04b58
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py 7b8ba38
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py 6935b08
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py 970dc6d
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_service.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 469f68e
> ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_service_check.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/configs/default.json 0a9a132
> ambari-server/src/test/python/stacks/2.2/configs/secured.json b2afe06
>
> Diff: https://reviews.apache.org/r/33163/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>