You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Jonathan Hurley <jh...@hortonworks.com> on 2015/05/02 06:10:21 UTC
Review Request 33777: Agent Changes For Supporting HDP 2.3
Configuration Directories
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33777/
-----------------------------------------------------------
Review request for Ambari, Alejandro Fernandez, Nate Cole, and Tom Beerbower.
Bugs: AMBARI-10894
https://issues.apache.org/jira/browse/AMBARI-10894
Repository: ambari
Description
-------
Changes are required to support parallel configurations when performing an upgrade. By the time a command is serialized to JSON and packaged to the agent, the target config values with stack are already resolved.
The scope of work is the following:
- The agent must always pass the configuration directory to hadoop components when executing a command. For HDP 2.3, this means using a new, hard-coded schema of choosing the configuration directory from within the {{/usr/hdp/current/component/conf}} symlink
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/script/script.py a4ddc7c
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py 340f247
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py a7a6408
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py 7e516b8
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py 62fb1dd
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py cb13741
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py c5478e5
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py 2bc2ff1
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params_linux.py b5bf203
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py 8ce244a
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py bd0a7b1
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 4ec91a4
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py c492f60
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 3e4cfe4
ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py e9f8f56
ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/status_params.py fcb0816
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 3c3db5b
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py 701bcd4
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py 52e9c59
ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py b37a3a8
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py 4be8a50
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py e318c77
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py af3e18f
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py e2b8ba8
ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/params.py 409610a
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py aa60087
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py 4ed93e5
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py bda4a76
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py 733edc1
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py beed137
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py 131946a
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py fbfe623
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py a5fe494
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py f7985c7
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/tez.py ceafa56
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py 96e6e30
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 61402a0
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py cf555fa
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 7cd99b6
ambari-server/src/test/python/stacks/2.0.6/FLUME/test_flume.py 2317cf7
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_master.py 2a89a40
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 99e6033
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_service_check.py f08a31a
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_phoenix_queryserver.py 0427fe9
ambari-server/src/test/python/stacks/2.0.6/HDFS/test_datanode.py 8a90ec8
ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_client.py ec1a783
ambari-server/src/test/python/stacks/2.0.6/PIG/test_pig_client.py cfa5569
ambari-server/src/test/python/stacks/2.0.6/ZOOKEEPER/test_zookeeper_service_check.py a936b1d
ambari-server/src/test/python/stacks/2.1/configs/secured-storm-start.json a7834c2
ambari-server/src/test/python/stacks/2.2/KAFKA/test_kafka_broker.py 151335c
ambari-server/src/test/python/stacks/2.2/KNOX/test_knox_gateway.py 82bee2a
ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py f930780
ambari-server/src/test/python/stacks/2.2/RANGER/test_ranger_admin.py 6ac0b63
ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 2a03cde
ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 6461964
ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py 30235f0
ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_client.py 628ca96
ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_service_check.py 5e09ad2
Diff: https://reviews.apache.org/r/33777/diff/
Testing
-------
mvn clean test
Thanks,
Jonathan Hurley
Re: Review Request 33777: Agent Changes For Supporting HDP 2.3
Configuration Directories
Posted by Tom Beerbower <tb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33777/#review82366
-----------------------------------------------------------
Ship it!
Ship It!
- Tom Beerbower
On May 3, 2015, 9:32 p.m., Jonathan Hurley wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33777/
> -----------------------------------------------------------
>
> (Updated May 3, 2015, 9:32 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Nate Cole, and Tom Beerbower.
>
>
> Bugs: AMBARI-10894
> https://issues.apache.org/jira/browse/AMBARI-10894
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Changes are required to support parallel configurations when performing an upgrade. By the time a command is serialized to JSON and packaged to the agent, the target config values with stack are already resolved.
>
> The scope of work is the following:
> - The agent must always pass the configuration directory to hadoop components when executing a command. For HDP 2.3, this means using a new, hard-coded schema of choosing the configuration directory from within the {{/usr/hdp/current/component/conf}} symlink
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/script/script.py a4ddc7c
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py 340f247
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py a7a6408
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py 62fb1dd
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py cb13741
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py c5478e5
> ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py 2bc2ff1
> ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params_linux.py b5bf203
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py 8ce244a
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py bd0a7b1
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 4ec91a4
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py c492f60
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 3e4cfe4
> ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py e9f8f56
> ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/status_params.py fcb0816
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 3c3db5b
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py 701bcd4
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py 52e9c59
> ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py b37a3a8
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py 4be8a50
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py e318c77
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py af3e18f
> ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py e2b8ba8
> ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/params.py 409610a
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py aa60087
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py 4ed93e5
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py bda4a76
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py 733edc1
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py beed137
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py 131946a
> ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py fbfe623
> ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py a5fe494
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py f7985c7
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/tez.py ceafa56
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py 96e6e30
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 61402a0
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py cf555fa
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 7cd99b6
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 16f78b2
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py 2262a20
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py d4242f8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py e89fd63
> ambari-server/src/test/python/stacks/2.0.6/FLUME/test_flume.py 2317cf7
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_master.py 2a89a40
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 99e6033
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_service_check.py f08a31a
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_phoenix_queryserver.py 0427fe9
> ambari-server/src/test/python/stacks/2.0.6/HDFS/test_datanode.py 8a90ec8
> ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_client.py ec1a783
> ambari-server/src/test/python/stacks/2.0.6/PIG/test_pig_client.py cfa5569
> ambari-server/src/test/python/stacks/2.0.6/ZOOKEEPER/test_zookeeper_service_check.py a936b1d
> ambari-server/src/test/python/stacks/2.1/STORM/test_storm_base.py f7b634c
> ambari-server/src/test/python/stacks/2.1/STORM/test_storm_jaas_configuration.py 047bfaf
> ambari-server/src/test/python/stacks/2.1/configs/secured-storm-start.json a7834c2
> ambari-server/src/test/python/stacks/2.2/KAFKA/test_kafka_broker.py 151335c
> ambari-server/src/test/python/stacks/2.2/KNOX/test_knox_gateway.py 82bee2a
> ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py f930780
> ambari-server/src/test/python/stacks/2.2/RANGER/test_ranger_admin.py 6ac0b63
> ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 2a03cde
> ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 6461964
> ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py 30235f0
> ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_client.py 628ca96
> ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_service_check.py 5e09ad2
>
> Diff: https://reviews.apache.org/r/33777/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
> Installed full stack HDP 2.3 cluster and examine the output statement to ensure that /usr/hdp/current/ was being used for configurations
>
>
> Thanks,
>
> Jonathan Hurley
>
>
Re: Review Request 33777: Agent Changes For Supporting HDP 2.3
Configuration Directories
Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33777/#review82374
-----------------------------------------------------------
Ship it!
Ship It!
- Nate Cole
On May 3, 2015, 5:32 p.m., Jonathan Hurley wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33777/
> -----------------------------------------------------------
>
> (Updated May 3, 2015, 5:32 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Nate Cole, and Tom Beerbower.
>
>
> Bugs: AMBARI-10894
> https://issues.apache.org/jira/browse/AMBARI-10894
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Changes are required to support parallel configurations when performing an upgrade. By the time a command is serialized to JSON and packaged to the agent, the target config values with stack are already resolved.
>
> The scope of work is the following:
> - The agent must always pass the configuration directory to hadoop components when executing a command. For HDP 2.3, this means using a new, hard-coded schema of choosing the configuration directory from within the {{/usr/hdp/current/component/conf}} symlink
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/script/script.py a4ddc7c
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py 340f247
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py a7a6408
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py 62fb1dd
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py cb13741
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py c5478e5
> ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py 2bc2ff1
> ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params_linux.py b5bf203
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py 8ce244a
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py bd0a7b1
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 4ec91a4
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py c492f60
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 3e4cfe4
> ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py e9f8f56
> ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/status_params.py fcb0816
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 3c3db5b
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py 701bcd4
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py 52e9c59
> ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py b37a3a8
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py 4be8a50
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py e318c77
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py af3e18f
> ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py e2b8ba8
> ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/params.py 409610a
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py aa60087
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py 4ed93e5
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py bda4a76
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py 733edc1
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py beed137
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py 131946a
> ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py fbfe623
> ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py a5fe494
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py f7985c7
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/tez.py ceafa56
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py 96e6e30
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 61402a0
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py cf555fa
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 7cd99b6
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 16f78b2
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py 2262a20
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py d4242f8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py e89fd63
> ambari-server/src/test/python/stacks/2.0.6/FLUME/test_flume.py 2317cf7
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_master.py 2a89a40
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 99e6033
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_service_check.py f08a31a
> ambari-server/src/test/python/stacks/2.0.6/HBASE/test_phoenix_queryserver.py 0427fe9
> ambari-server/src/test/python/stacks/2.0.6/HDFS/test_datanode.py 8a90ec8
> ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_client.py ec1a783
> ambari-server/src/test/python/stacks/2.0.6/PIG/test_pig_client.py cfa5569
> ambari-server/src/test/python/stacks/2.0.6/ZOOKEEPER/test_zookeeper_service_check.py a936b1d
> ambari-server/src/test/python/stacks/2.1/STORM/test_storm_base.py f7b634c
> ambari-server/src/test/python/stacks/2.1/STORM/test_storm_jaas_configuration.py 047bfaf
> ambari-server/src/test/python/stacks/2.1/configs/secured-storm-start.json a7834c2
> ambari-server/src/test/python/stacks/2.2/KAFKA/test_kafka_broker.py 151335c
> ambari-server/src/test/python/stacks/2.2/KNOX/test_knox_gateway.py 82bee2a
> ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py f930780
> ambari-server/src/test/python/stacks/2.2/RANGER/test_ranger_admin.py 6ac0b63
> ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 2a03cde
> ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 6461964
> ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py 30235f0
> ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_client.py 628ca96
> ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_service_check.py 5e09ad2
>
> Diff: https://reviews.apache.org/r/33777/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
> Installed full stack HDP 2.3 cluster and examine the output statement to ensure that /usr/hdp/current/ was being used for configurations
>
>
> Thanks,
>
> Jonathan Hurley
>
>
Re: Review Request 33777: Agent Changes For Supporting HDP 2.3
Configuration Directories
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33777/
-----------------------------------------------------------
(Updated May 3, 2015, 5:32 p.m.)
Review request for Ambari, Alejandro Fernandez, Nate Cole, and Tom Beerbower.
Changes
-------
Found an issue with Tez on HDP 2.3
Bugs: AMBARI-10894
https://issues.apache.org/jira/browse/AMBARI-10894
Repository: ambari
Description
-------
Changes are required to support parallel configurations when performing an upgrade. By the time a command is serialized to JSON and packaged to the agent, the target config values with stack are already resolved.
The scope of work is the following:
- The agent must always pass the configuration directory to hadoop components when executing a command. For HDP 2.3, this means using a new, hard-coded schema of choosing the configuration directory from within the {{/usr/hdp/current/component/conf}} symlink
Diffs (updated)
-----
ambari-common/src/main/python/resource_management/libraries/script/script.py a4ddc7c
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py 340f247
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py a7a6408
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py 62fb1dd
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py cb13741
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py c5478e5
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py 2bc2ff1
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params_linux.py b5bf203
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py 8ce244a
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py bd0a7b1
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 4ec91a4
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py c492f60
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 3e4cfe4
ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py e9f8f56
ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/status_params.py fcb0816
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 3c3db5b
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py 701bcd4
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py 52e9c59
ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py b37a3a8
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py 4be8a50
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py e318c77
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py af3e18f
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py e2b8ba8
ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/params.py 409610a
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py aa60087
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py 4ed93e5
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py bda4a76
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py 733edc1
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py beed137
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py 131946a
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py fbfe623
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py a5fe494
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py f7985c7
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/tez.py ceafa56
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py 96e6e30
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 61402a0
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py cf555fa
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 7cd99b6
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 16f78b2
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py 2262a20
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py d4242f8
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py e89fd63
ambari-server/src/test/python/stacks/2.0.6/FLUME/test_flume.py 2317cf7
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_master.py 2a89a40
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 99e6033
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_service_check.py f08a31a
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_phoenix_queryserver.py 0427fe9
ambari-server/src/test/python/stacks/2.0.6/HDFS/test_datanode.py 8a90ec8
ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_client.py ec1a783
ambari-server/src/test/python/stacks/2.0.6/PIG/test_pig_client.py cfa5569
ambari-server/src/test/python/stacks/2.0.6/ZOOKEEPER/test_zookeeper_service_check.py a936b1d
ambari-server/src/test/python/stacks/2.1/STORM/test_storm_base.py f7b634c
ambari-server/src/test/python/stacks/2.1/STORM/test_storm_jaas_configuration.py 047bfaf
ambari-server/src/test/python/stacks/2.1/configs/secured-storm-start.json a7834c2
ambari-server/src/test/python/stacks/2.2/KAFKA/test_kafka_broker.py 151335c
ambari-server/src/test/python/stacks/2.2/KNOX/test_knox_gateway.py 82bee2a
ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py f930780
ambari-server/src/test/python/stacks/2.2/RANGER/test_ranger_admin.py 6ac0b63
ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 2a03cde
ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 6461964
ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py 30235f0
ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_client.py 628ca96
ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_service_check.py 5e09ad2
Diff: https://reviews.apache.org/r/33777/diff/
Testing
-------
mvn clean test
Installed full stack HDP 2.3 cluster and examine the output statement to ensure that /usr/hdp/current/ was being used for configurations
Thanks,
Jonathan Hurley
Re: Review Request 33777: Agent Changes For Supporting HDP 2.3
Configuration Directories
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33777/
-----------------------------------------------------------
(Updated May 2, 2015, 12:37 a.m.)
Review request for Ambari, Alejandro Fernandez, Nate Cole, and Tom Beerbower.
Changes
-------
Testing found that the hooks, which write out core-site.xml, etc, also needed to be updated.
Bugs: AMBARI-10894
https://issues.apache.org/jira/browse/AMBARI-10894
Repository: ambari
Description
-------
Changes are required to support parallel configurations when performing an upgrade. By the time a command is serialized to JSON and packaged to the agent, the target config values with stack are already resolved.
The scope of work is the following:
- The agent must always pass the configuration directory to hadoop components when executing a command. For HDP 2.3, this means using a new, hard-coded schema of choosing the configuration directory from within the {{/usr/hdp/current/component/conf}} symlink
Diffs (updated)
-----
ambari-common/src/main/python/resource_management/libraries/script/script.py a4ddc7c
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py 340f247
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py a7a6408
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py 62fb1dd
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py cb13741
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py c5478e5
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py 2bc2ff1
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params_linux.py b5bf203
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py 8ce244a
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py bd0a7b1
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 4ec91a4
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py c492f60
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 3e4cfe4
ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py e9f8f56
ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/status_params.py fcb0816
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 3c3db5b
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py 701bcd4
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py 52e9c59
ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py b37a3a8
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py 4be8a50
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py e318c77
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py af3e18f
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py e2b8ba8
ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/params.py 409610a
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py aa60087
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py 4ed93e5
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py bda4a76
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py 733edc1
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py beed137
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py 131946a
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py fbfe623
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py a5fe494
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py f7985c7
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/tez.py ceafa56
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py 96e6e30
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 61402a0
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py cf555fa
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 7cd99b6
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/params.py 16f78b2
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py 2262a20
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py e89fd63
ambari-server/src/test/python/stacks/2.0.6/FLUME/test_flume.py 2317cf7
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_master.py 2a89a40
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 99e6033
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_service_check.py f08a31a
ambari-server/src/test/python/stacks/2.0.6/HBASE/test_phoenix_queryserver.py 0427fe9
ambari-server/src/test/python/stacks/2.0.6/HDFS/test_datanode.py 8a90ec8
ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_client.py ec1a783
ambari-server/src/test/python/stacks/2.0.6/PIG/test_pig_client.py cfa5569
ambari-server/src/test/python/stacks/2.0.6/ZOOKEEPER/test_zookeeper_service_check.py a936b1d
ambari-server/src/test/python/stacks/2.1/configs/secured-storm-start.json a7834c2
ambari-server/src/test/python/stacks/2.2/KAFKA/test_kafka_broker.py 151335c
ambari-server/src/test/python/stacks/2.2/KNOX/test_knox_gateway.py 82bee2a
ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py f930780
ambari-server/src/test/python/stacks/2.2/RANGER/test_ranger_admin.py 6ac0b63
ambari-server/src/test/python/stacks/2.2/SLIDER/test_slider_client.py 2a03cde
ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py 6461964
ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py 30235f0
ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_client.py 628ca96
ambari-server/src/test/python/stacks/2.3/MAHOUT/test_mahout_service_check.py 5e09ad2
Diff: https://reviews.apache.org/r/33777/diff/
Testing (updated)
-------
mvn clean test
Installed full stack HDP 2.3 cluster and examine the output statement to ensure that /usr/hdp/current/ was being used for configurations
Thanks,
Jonathan Hurley