You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Alejandro Fernandez <af...@hortonworks.com> on 2015/05/09 21:59:39 UTC
Review Request 34019: Storm service check fails with multiple nimbus
hosts, remove messages from Storm RU now that it is rolling,
allow nimbus.seeds to be edited
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34019/
-----------------------------------------------------------
Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Jonathan Hurley, and Nate Cole.
Bugs: AMBARI-11009
https://issues.apache.org/jira/browse/AMBARI-11009
Repository: ambari
Description
-------
1. In HDP 2.3, when installing multiple nimbus servers, the service check fails. To resolve this, modify the cmd as follows,
storm jar /tmp/wordCount.jar storm.starter.WordCountTopology WordCount{unique}
if nimbus.seeds is supported and in the storm configs.
2. In RU from HDP 2.2 -> 2.3.0.0, Storm will not be rolling, so the upgrade pack still needs instructions to deactivate and kill running topologies before upgrading Storm, and to rebuild the topologies after.
In 2.3.0.0, Storm's defaults.yaml will have the property storm.meta.serialization.delegate set to backtype.storm.serialization.GzipThriftSerializationDelegate, so as long as Ambari doesn't override the property, the RU from 2.3.0.0 to 2.3+ will be rolling. So the upgrade pack from Dal to Dal will not need these manual confirmations.
To test this out, deploy HDP 2.3.0.0, then perform and RU to HDP 2.3+, and verify the topologies are still running
3. Currently, the nimbus.seeds property is marked as final and cannot be edited in the UI, so this needs to change to enable Nimbus HA
Diffs
-----
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py 6c96d73
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/service_check.py 483c144
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/yaml_utils.py aeda3b3
ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/STORM/package/scripts/yaml_config.py 39261be
ambari-server/src/main/resources/stacks/HDP/2.3/services/STORM/configuration/storm-site.xml 3ecc014
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.3.xml 65549dd
ambari-server/src/test/python/stacks/2.3/STORM/test_service_check.py PRE-CREATION
ambari-server/src/test/python/stacks/2.3/STORM/test_storm_base.py PRE-CREATION
ambari-server/src/test/python/stacks/2.3/configs/storm_default.json PRE-CREATION
ambari-web/app/data/HDP2/site_properties.js 2c50819
Diff: https://reviews.apache.org/r/34019/diff/
Testing
-------
Created 3 CentOS 6 VMs, installed Ambari Server 2.1.0 at build 1457
Installed HDP 2.3.0.0-1889 with Storm and ZK, and my patch
Storm service check passed
The nimbus.seeds property is not final
Attempted a Rolling Upgrade to HDP 2.3.0.0-1891 and the confirmation message for Storm did not appear, as expected.
Unit tests passed.
-----------------------------------------------------------------------
Total run:734
Total errors:0
Total failures:0
OK
Thanks,
Alejandro Fernandez