You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmitro Lisnichenko <dl...@hortonworks.com> on 2016/01/06 18:53:38 UTC
Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/
-----------------------------------------------------------
Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
Bugs: AMBARI-14570
https://issues.apache.org/jira/browse/AMBARI-14570
Repository: ambari
Description
-------
*Steps*
# Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
# Perform EU to Dal M21 (HDP-2.4.0.0-42)
EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
{code}
The following components were found to have version mismatches. Finalize will not complete successfully:
host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
{code}
>From DB found below:
{code}
select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
select * from stack where stack_id in (3,5)
3.00 HDP 2.4
5.00 HDP 2.3
{code}
EU reports failure at Finalize Upgrade pre-check with below error:
{code}
The following components were found to have version mismatches. Finalize will not complete successfully:
host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
{code}
>From DB found below:
{code}
select * from hostcomponentstate where component_name = 'MAHOUT'
id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
select * from stack where stack_id in (1,2)
stack_id stack_name stack_version
1 HDP 2.4
2 HDP 2.3
{code}
Diffs
-----
ambari-agent/src/main/python/ambari_agent/HostCleanup.py 1655fbd
ambari-agent/src/main/python/ambari_agent/HostInfo.py 9892b0c
ambari-agent/src/test/python/ambari_agent/TestActionQueue.py 35d048a
ambari-agent/src/test/python/ambari_agent/TestHostCleanup.py 165c5f0
ambari-common/src/main/python/resource_management/libraries/functions/hdp_select.py 7cae627
ambari-server/src/main/java/org/apache/ambari/server/alerts/StaleAlertRunnable.java 83abc8e
ambari-server/src/main/resources/common-services/HAWQ/2.0.0/package/scripts/master_helper.py 95c4eba
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py c004654
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py 73412e0
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py 1b7b57a
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py a4c602e
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
ambari-server/src/main/resources/stacks/HDP/2.4/services/SPARK/metainfo.xml adcf59e
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
ambari-server/src/test/python/stacks/2.0.6/hooks/after-INSTALL/test_after_install.py be35a99
ambari-web/app/controllers/main/admin/highAvailability/nameNode/rollback_controller.js 4aa2d73
ambari-web/app/controllers/main/admin/highAvailability/nameNode/step9_controller.js 7745c6b
ambari-web/app/controllers/main/admin/stack_and_upgrade_controller.js 29b996f
ambari-web/app/controllers/wizard/step8_controller.js a843f65
ambari-web/app/messages.js 214b214
ambari-web/app/templates/wizard/step8/step8_log_popup.hbs 6d3e5c2
ambari-web/app/views/common/chart/linear_time.js 4fbbef9
Diff: https://reviews.apache.org/r/41987/diff/
Testing
-------
For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
Thanks,
Dmitro Lisnichenko
Re: Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
> On Jan. 7, 2016, 5:14 p.m., Nate Cole wrote:
> > Ship It!
Still can not verify patch on live cluster due to open RE blocker
- Dmitro
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113261
-----------------------------------------------------------
On Jan. 6, 2016, 7:54 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 6, 2016, 7:54 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> *Steps*
> # Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
> # Perform EU to Dal M21 (HDP-2.4.0.0-42)
>
> EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
>
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
> 53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
> 54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
> 55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
> 56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
> 57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
>
>
> select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
>
> select * from stack where stack_id in (3,5)
> 3.00 HDP 2.4
> 5.00 HDP 2.3
>
> {code}
>
>
> EU reports failure at Finalize Upgrade pre-check with below error:
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'MAHOUT'
>
> id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
> 116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
> 117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
> 118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
> 119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
> 120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
>
> select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
>
> cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
> 2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
>
> select * from stack where stack_id in (1,2)
> stack_id stack_name stack_version
> 1 HDP 2.4
> 2 HDP 2.3
>
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113261
-----------------------------------------------------------
Ship it!
Ship It!
- Nate Cole
On Jan. 6, 2016, 12:54 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 6, 2016, 12:54 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> *Steps*
> # Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
> # Perform EU to Dal M21 (HDP-2.4.0.0-42)
>
> EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
>
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
> 53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
> 54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
> 55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
> 56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
> 57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
>
>
> select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
>
> select * from stack where stack_id in (3,5)
> 3.00 HDP 2.4
> 5.00 HDP 2.3
>
> {code}
>
>
> EU reports failure at Finalize Upgrade pre-check with below error:
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'MAHOUT'
>
> id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
> 116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
> 117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
> 118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
> 119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
> 120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
>
> select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
>
> cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
> 2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
>
> select * from stack where stack_id in (1,2)
> stack_id stack_name stack_version
> 1 HDP 2.4
> 2 HDP 2.3
>
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113128
-----------------------------------------------------------
Ship it!
Ship It!
- Jonathan Hurley
On Jan. 6, 2016, 12:54 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 6, 2016, 12:54 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> *Steps*
> # Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
> # Perform EU to Dal M21 (HDP-2.4.0.0-42)
>
> EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
>
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
> 53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
> 54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
> 55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
> 56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
> 57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
>
>
> select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
>
> select * from stack where stack_id in (3,5)
> 3.00 HDP 2.4
> 5.00 HDP 2.3
>
> {code}
>
>
> EU reports failure at Finalize Upgrade pre-check with below error:
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'MAHOUT'
>
> id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
> 116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
> 117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
> 118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
> 119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
> 120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
>
> select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
>
> cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
> 2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
>
> select * from stack where stack_id in (1,2)
> stack_id stack_name stack_version
> 1 HDP 2.4
> 2 HDP 2.3
>
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113103
-----------------------------------------------------------
Ship it!
Ship It!
- Alejandro Fernandez
On Jan. 6, 2016, 5:54 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 6, 2016, 5:54 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> *Steps*
> # Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
> # Perform EU to Dal M21 (HDP-2.4.0.0-42)
>
> EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
>
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
> 53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
> 54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
> 55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
> 56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
> 57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
>
>
> select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
>
> select * from stack where stack_id in (3,5)
> 3.00 HDP 2.4
> 5.00 HDP 2.3
>
> {code}
>
>
> EU reports failure at Finalize Upgrade pre-check with below error:
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'MAHOUT'
>
> id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
> 116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
> 117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
> 118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
> 119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
> 120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
>
> select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
>
> cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
> 2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
>
> select * from stack where stack_id in (1,2)
> stack_id stack_name stack_version
> 1 HDP 2.4
> 2 HDP 2.3
>
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
Posted by Jayush Luniya <jl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113524
-----------------------------------------------------------
Ship it!
Ship It!
- Jayush Luniya
On Jan. 6, 2016, 5:54 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 6, 2016, 5:54 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> *Steps*
> # Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
> # Perform EU to Dal M21 (HDP-2.4.0.0-42)
>
> EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
>
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
> 53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
> 54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
> 55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
> 56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
> 57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
>
>
> select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
>
> select * from stack where stack_id in (3,5)
> 3.00 HDP 2.4
> 5.00 HDP 2.3
>
> {code}
>
>
> EU reports failure at Finalize Upgrade pre-check with below error:
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'MAHOUT'
>
> id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
> 116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
> 117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
> 118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
> 119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
> 120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
>
> select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
>
> cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
> 2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
>
> select * from stack where stack_id in (1,2)
> stack_id stack_name stack_version
> 1 HDP 2.4
> 2 HDP 2.3
>
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113525
-----------------------------------------------------------
Ship it!
Ship It!
- Alejandro Fernandez
On Jan. 6, 2016, 5:54 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 6, 2016, 5:54 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> *Steps*
> # Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
> # Perform EU to Dal M21 (HDP-2.4.0.0-42)
>
> EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
>
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
> 53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
> 54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
> 55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
> 56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
> 57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
>
>
> select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
> 1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
>
> select * from stack where stack_id in (3,5)
> 3.00 HDP 2.4
> 5.00 HDP 2.3
>
> {code}
>
>
> EU reports failure at Finalize Upgrade pre-check with below error:
> {code}
> The following components were found to have version mismatches. Finalize will not complete successfully:
> host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
> {code}
>
> From DB found below:
>
> {code}
> select * from hostcomponentstate where component_name = 'MAHOUT'
>
> id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
> 116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
> 117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
> 118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
> 119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
> 120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
>
> select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
>
> cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
> 2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
> 2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
>
> select * from stack where stack_id in (1,2)
> stack_id stack_name stack_version
> 1 HDP 2.4
> 2 HDP 2.3
>
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: Add 2.2->2.4 EU pack, fix Mahout/STS upgrade,
other fixes
Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113800
-----------------------------------------------------------
Ship it!
Ship It!
- Nate Cole
On Jan. 11, 2016, 11:41 a.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 11, 2016, 11:41 a.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Add 2.2->2.4 EU pack, fix Mahout/STS upgrade, other fixes
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.3.xml 9980f02
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.3.xml 0d408a9
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> Performed EU 2.2->2.4 with core services, 2.3->2.4 and 2.4->2.4 EU with HDFS+YARN+ZK
>
> Since STS upgrade verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver) for almost a week, retargeted STS-related jira to verify STS upgrade once it's unblocked
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: Add 2.2->2.4 EU pack, fix Mahout/STS upgrade,
other fixes
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/
-----------------------------------------------------------
(Updated Jan. 11, 2016, 6:41 p.m.)
Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
Changes
-------
Fixed message
Bugs: AMBARI-14570
https://issues.apache.org/jira/browse/AMBARI-14570
Repository: ambari
Description
-------
Add 2.2->2.4 EU pack, fix Mahout/STS upgrade, other fixes
Diffs (updated)
-----
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.3.xml 9980f02
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.3.xml 0d408a9
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
Diff: https://reviews.apache.org/r/41987/diff/
Testing
-------
Performed EU 2.2->2.4 with core services, 2.3->2.4 and 2.4->2.4 EU with HDFS+YARN+ZK
Since STS upgrade verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver) for almost a week, retargeted STS-related jira to verify STS upgrade once it's unblocked
Thanks,
Dmitro Lisnichenko
Re: Review Request 41987: Add 2.2->2.4 EU pack, fix Mahout/STS upgrade,
other fixes
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/#review113780
-----------------------------------------------------------
Ship it!
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml (line 179)
<https://reviews.apache.org/r/41987/#comment174593>
Should we include which host to backup on using {{hosts.all}} ?
- Jonathan Hurley
On Jan. 11, 2016, 9:55 a.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41987/
> -----------------------------------------------------------
>
> (Updated Jan. 11, 2016, 9:55 a.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
>
>
> Bugs: AMBARI-14570
> https://issues.apache.org/jira/browse/AMBARI-14570
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Add 2.2->2.4 EU pack, fix Mahout/STS upgrade, other fixes
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
>
> Diff: https://reviews.apache.org/r/41987/diff/
>
>
> Testing
> -------
>
> Performed EU 2.2->2.4 with core services, 2.3->2.4 and 2.4->2.4 EU with HDFS+YARN+ZK
>
> Since STS upgrade verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver) for almost a week, retargeted STS-related jira to verify STS upgrade once it's unblocked
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 41987: Add 2.2->2.4 EU pack, fix Mahout/STS upgrade,
other fixes
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/
-----------------------------------------------------------
(Updated Jan. 11, 2016, 4:55 p.m.)
Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
Changes
-------
Add 2.2->2.4 EU pack, fix Mahout/STS upgrade, other fixes
Summary (updated)
-----------------
Add 2.2->2.4 EU pack, fix Mahout/STS upgrade, other fixes
Bugs: AMBARI-14570
https://issues.apache.org/jira/browse/AMBARI-14570
Repository: ambari
Description (updated)
-------
Add 2.2->2.4 EU pack, fix Mahout/STS upgrade, other fixes
Diffs (updated)
-----
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
Diff: https://reviews.apache.org/r/41987/diff/
Testing (updated)
-------
Performed EU 2.2->2.4 with core services, 2.3->2.4 and 2.4->2.4 EU with HDFS+YARN+ZK
Since STS upgrade verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver) for almost a week, retargeted STS-related jira to verify STS upgrade once it's unblocked
Thanks,
Dmitro Lisnichenko
Re: Review Request 41987: [preview] Express Upgrade failed at Finalize
Upgrade pre-check due to STS and Mahout version mismatch
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/
-----------------------------------------------------------
(Updated Jan. 6, 2016, 7:54 p.m.)
Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, Jayush Luniya, and Nate Cole.
Changes
-------
Uploaded correct patch
Bugs: AMBARI-14570
https://issues.apache.org/jira/browse/AMBARI-14570
Repository: ambari
Description
-------
*Steps*
# Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark service)
# Perform EU to Dal M21 (HDP-2.4.0.0-42)
EU reports failure at Finalize Upgrade pre-check with below error for SPARK_THRIFTSERVER :
{code}
The following components were found to have version mismatches. Finalize will not complete successfully:
host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
{code}
>From DB found below:
{code}
select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00 SPARK NONE UNKNOWN
54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00 SPARK NONE UNKNOWN
55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00 SPARK NONE UNKNOWN
56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00 SPARK NONE UNKNOWN
57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00 SPARK NONE UNKNOWN
select * from hostcomponentdesiredstate where component_name = 'SPARK_THRIFTSERVER'
1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE OFF UNSECURED 0.00
select * from stack where stack_id in (3,5)
3.00 HDP 2.4
5.00 HDP 2.3
{code}
EU reports failure at Finalize Upgrade pre-check with below error:
{code}
The following components were found to have version mismatches. Finalize will not complete successfully:
host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
{code}
>From DB found below:
{code}
select * from hostcomponentstate where component_name = 'MAHOUT'
id cluster_id component_name version current_stack_id current_state host_id service_name upgrade_state security_state
116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT NONE UNKNOWN
117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT NONE UNKNOWN
118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT NONE UNKNOWN
119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT NONE UNKNOWN
120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT NONE UNKNOWN
select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
cluster_id component_name desired_stack_id desired_state host_id service_name admin_state maintenance_state security_state restart_required
2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF UNSECURED 0
2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF UNSECURED 0
select * from stack where stack_id in (1,2)
stack_id stack_name stack_version
1 HDP 2.4
2 HDP 2.3
{code}
Diffs (updated)
-----
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml ab91379
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml 57be7b2
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml c534257
Diff: https://reviews.apache.org/r/41987/diff/
Testing
-------
For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6 has no support for spark-thriftserver)
Thanks,
Dmitro Lisnichenko