You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Alejandro Fernandez <af...@hortonworks.com> on 2017/04/20 02:28:05 UTC

Review Request 58551: Miscellaneous fixes to support HDP 3.0 Tech Preview

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58551/
-----------------------------------------------------------

Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, Sumit Mohanty, Swapan Shridhar, Sid Wagle, and Vitalyi Brodetskyi.


Bugs: AMBARI-20790
    https://issues.apache.org/jira/browse/AMBARI-20790


Repository: ambari


Description
-------

Miscellaneous fixes to support HDP 3.0 Tech Preview

* Temporarily rename Spark 2.x RPMs to "spark2" and "livy2"
* ResourceManager failed to start because /var/log/hadoop-yarn needs to be created first
* mapreduce tarball was not uploaded to HDFS because HDFS Client needs to be present on the host with HistoryServer


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/script/script.py 2c441ad 
  ambari-server/src/main/resources/common-services/SPARK/2.2.0/metainfo.xml 25a6855 
  ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/job_history_server.py 16a2224 
  ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_server.py b09d9a9 
  ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/params.py ab58cb6 
  ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_client.py a2e53cd 
  ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_service.py c6619e4 
  ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_thrift_server.py de82c16 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/yarn.py 52338df 
  ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/metainfo.xml 18186bd 
  ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/package/scripts/yarn.py d601f8f 
  ambari-server/src/main/resources/stacks/HDP/3.0/services/HDFS/configuration/hadoop-env.xml fbda35a 
  ambari-server/src/main/resources/stacks/HDP/3.0/services/YARN/configuration-mapred/mapred-env.xml deb4ef7 
  ambari-server/src/main/resources/stacks/HDP/3.0/services/YARN/configuration-mapred/mapred-site.xml cbeb08b 
  ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py 7a0514a 
  ambari-server/src/test/python/stacks/2.0.6/YARN/test_nodemanager.py ab5e2cd 
  ambari-server/src/test/python/stacks/2.0.6/YARN/test_resourcemanager.py b7f90c8 
  ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py 40db813 
  ambari-server/src/test/python/stacks/2.3/YARN/test_ats_1_5.py b523412 


Diff: https://reviews.apache.org/r/58551/diff/1/


Testing
-------

mvn clean test

Verified on a live cluster (except Spark which is still not ready from the RPM perspective)


Thanks,

Alejandro Fernandez


Re: Review Request 58551: Miscellaneous fixes to support HDP 3.0 Tech Preview

Posted by Sumit Mohanty <sm...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58551/#review172451
-----------------------------------------------------------


Ship it!




Ship It!

- Sumit Mohanty


On April 20, 2017, 2:28 a.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58551/
> -----------------------------------------------------------
> 
> (Updated April 20, 2017, 2:28 a.m.)
> 
> 
> Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, Sumit Mohanty, Swapan Shridhar, Sid Wagle, and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-20790
>     https://issues.apache.org/jira/browse/AMBARI-20790
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Miscellaneous fixes to support HDP 3.0 Tech Preview
> 
> * Temporarily rename Spark 2.x RPMs to "spark2" and "livy2"
> * ResourceManager failed to start because /var/log/hadoop-yarn needs to be created first
> * mapreduce tarball was not uploaded to HDFS because HDFS Client needs to be present on the host with HistoryServer
> 
> 
> Diffs
> -----
> 
>   ambari-common/src/main/python/resource_management/libraries/script/script.py 2c441ad 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/metainfo.xml 25a6855 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/job_history_server.py 16a2224 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_server.py b09d9a9 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/params.py ab58cb6 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_client.py a2e53cd 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_service.py c6619e4 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_thrift_server.py de82c16 
>   ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/yarn.py 52338df 
>   ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/metainfo.xml 18186bd 
>   ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/package/scripts/yarn.py d601f8f 
>   ambari-server/src/main/resources/stacks/HDP/3.0/services/HDFS/configuration/hadoop-env.xml fbda35a 
>   ambari-server/src/main/resources/stacks/HDP/3.0/services/YARN/configuration-mapred/mapred-env.xml deb4ef7 
>   ambari-server/src/main/resources/stacks/HDP/3.0/services/YARN/configuration-mapred/mapred-site.xml cbeb08b 
>   ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py 7a0514a 
>   ambari-server/src/test/python/stacks/2.0.6/YARN/test_nodemanager.py ab5e2cd 
>   ambari-server/src/test/python/stacks/2.0.6/YARN/test_resourcemanager.py b7f90c8 
>   ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py 40db813 
>   ambari-server/src/test/python/stacks/2.3/YARN/test_ats_1_5.py b523412 
> 
> 
> Diff: https://reviews.apache.org/r/58551/diff/1/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> Verified on a live cluster (except Spark which is still not ready from the RPM perspective)
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>


Re: Review Request 58551: Miscellaneous fixes to support HDP 3.0 Tech Preview

Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58551/#review172457
-----------------------------------------------------------


Ship it!




Ship It!

- Dmitro Lisnichenko


On April 20, 2017, 5:28 a.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58551/
> -----------------------------------------------------------
> 
> (Updated April 20, 2017, 5:28 a.m.)
> 
> 
> Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, Sumit Mohanty, Swapan Shridhar, Sid Wagle, and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-20790
>     https://issues.apache.org/jira/browse/AMBARI-20790
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Miscellaneous fixes to support HDP 3.0 Tech Preview
> 
> * Temporarily rename Spark 2.x RPMs to "spark2" and "livy2"
> * ResourceManager failed to start because /var/log/hadoop-yarn needs to be created first
> * mapreduce tarball was not uploaded to HDFS because HDFS Client needs to be present on the host with HistoryServer
> 
> 
> Diffs
> -----
> 
>   ambari-common/src/main/python/resource_management/libraries/script/script.py 2c441ad 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/metainfo.xml 25a6855 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/job_history_server.py 16a2224 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_server.py b09d9a9 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/params.py ab58cb6 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_client.py a2e53cd 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_service.py c6619e4 
>   ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_thrift_server.py de82c16 
>   ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/yarn.py 52338df 
>   ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/metainfo.xml 18186bd 
>   ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/package/scripts/yarn.py d601f8f 
>   ambari-server/src/main/resources/stacks/HDP/3.0/services/HDFS/configuration/hadoop-env.xml fbda35a 
>   ambari-server/src/main/resources/stacks/HDP/3.0/services/YARN/configuration-mapred/mapred-env.xml deb4ef7 
>   ambari-server/src/main/resources/stacks/HDP/3.0/services/YARN/configuration-mapred/mapred-site.xml cbeb08b 
>   ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py 7a0514a 
>   ambari-server/src/test/python/stacks/2.0.6/YARN/test_nodemanager.py ab5e2cd 
>   ambari-server/src/test/python/stacks/2.0.6/YARN/test_resourcemanager.py b7f90c8 
>   ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py 40db813 
>   ambari-server/src/test/python/stacks/2.3/YARN/test_ats_1_5.py b523412 
> 
> 
> Diff: https://reviews.apache.org/r/58551/diff/1/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> Verified on a live cluster (except Spark which is still not ready from the RPM perspective)
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>