You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Anandha L Ranganathan <an...@gmail.com> on 2017/08/24 20:39:13 UTC
HDP upgrade - stuck at 98% during finalize upgrade.
I am upgrading to HDP 2.6.1.0 and it stuck at 98%. We had installed
Teradata presto services using Ambari and is not part of HDP packages. The
HDP upgrade is unable to proceed because of presto services.
Here is the screenshot of error messages.
Upgrade did not succeed on 3 hosts <http://localhost:8080/#>
Your options:
- *Pause Upgrade*, delete the unhealthy hosts and return to the Upgrade
Wizard to Proceed.
- Perform a *Downgrade*, which will revert all hosts to the previous
stack version.
[image: Inline image 1]
I can not downgrade and remove the presto services. Is there a way to
ignore the presto service upgrade and continue and complete the upgrade. I
am looking for something to run SQL script and update the ambari database.
Thanks
Anand
Re: HDP upgrade - stuck at 98% during finalize upgrade.
Posted by Anandha L Ranganathan <an...@gmail.com>.
Here are the query results from ambari database for presto service.
1. SELECT service_name, component_name, version, host_name FROM
hostcomponentstate hcs
2. JOIN hosts h ON hcs.host_id = h.host_id WHERE service_name NOT IN (
'AMBARI_METRICS', 'KERBEROS')
3. and component_name NOT IN ('ZKFC') ORDER BY version, service_name,
component_name, host_name;
4.
5.
6. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpgw01.glassdoor.
local
7. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpgw02.glassdoor.
local
8. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpgw03.glassdoor.
local
9. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpmn01.glassdoor.
local
10. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpzo04.glassdoor.
local
11. ZOOKEEPER | ZOOKEEPER_SERVER | 2.6.1.0-129 | usw2dxdpzo02.glassdoor.
local
12. ZOOKEEPER | ZOOKEEPER_SERVER | 2.6.1.0-129 | usw2dxdpzo03.glassdoor.
local
13. ZOOKEEPER | ZOOKEEPER_SERVER | 2.6.1.0-129 | usw2dxdpzo04.glassdoor.
local
14. PRESTO | PRESTO_CLI | UNKNOWN | usw2dxdpgw01.glassdoor.local
15. PRESTO | PRESTO_COORDINATOR | UNKNOWN | usw2dxdpmn03.glassdoor.local
16. PRESTO | PRESTO_WORKER | UNKNOWN | usw2dxdppr01.glassdoor.local
17.
18. ambari=> select * from hostcomponentstate WHERE service_name IN (
'PRESTO');
19. cluster_id | component_name | version | current_stack_id |
current_state | host_id | service_name | upgrade_state | security_state |
id
20.
------------+--------------------+---------+------------------+---------------+---------+--------------+---------------+----------------+-----
21. 2 | PRESTO_CLI | UNKNOWN | 51 | INSTALLED | 3 | PRESTO | IN_PROGRESS
| UNKNOWN | 528
22. 2 | PRESTO_COORDINATOR | UNKNOWN | 51 | STARTED | 301 | PRESTO |
IN_PROGRESS | UNKNOWN | 534
23. 2 | PRESTO_WORKER | UNKNOWN | 51 | STARTED | 251 | PRESTO |
IN_PROGRESS | UNKNOWN | 535
24. (3 rows)
25.
26.
27. ambari=> SELECT * FROM hostcomponentdesiredstate WHERE service_name
IN ('PRESTO');
28. cluster_id | component_name | desired_stack_id | desired_state |
host_id | service_name | admin_state | maintenance_state |
security_state | restart_required | id
29.
------------+--------------------+------------------+---------------+---------+--------------+-------------+-------------------+----------------+------------------+----
30. 2 | PRESTO_WORKER | 101 | STARTED | 251 | PRESTO | INSERVICE | OFF |
UNSECURED | 0 | 20
31. 2 | PRESTO_CLI | 101 | INSTALLED | 3 | PRESTO | | OFF | UNSECURED | 0
| 23
32. 2 | PRESTO_COORDINATOR | 101 | STARTED | 301 | PRESTO | | OFF |
UNSECURED | 0 | 96
33. (3 rows)
34.
35.
36. ambari=> SELECT * FROM servicecomponentdesiredstate WHERE
service_name IN ('PRESTO');
37. component_name | cluster_id | desired_stack_id | desired_state |
service_name | recovery_enabled | desired_version | id
38.
--------------------+------------+------------------+---------------+--------------+------------------+-----------------+----
39. PRESTO_CLI | 2 | 101 | INSTALLED | PRESTO | 0 | 2.6.1.0-129 | 11
40. PRESTO_COORDINATOR | 2 | 101 | STARTED | PRESTO | 0 | 2.6.1.0-129 |
12
41. PRESTO_WORKER | 2 | 101 | STARTED | PRESTO | 0 | 2.6.1.0-129 | 13
42. (3 rows)
43.
44.
45. ambari=> SELECT * FROM servicedesiredstate WHERE service_name IN (
'PRESTO');
46. cluster_id | desired_host_role_mapping | desired_stack_id |
desired_state | service_name | maintenance_state | security_state |
credential_store_enabled
47.
------------+---------------------------+------------------+---------------+--------------+-------------------+----------------+--------------------------
48. 2 | 0 | 101 | STARTED | PRESTO | OFF | UNSECURED | 0
49. (1 row)
50.
51.
52. ambari=> SELECT * FROM clusterservices WHERE service_name IN (
'PRESTO');
53. service_name | cluster_id | service_enabled
54. --------------+------------+-----------------
55. PRESTO | 2 | 0
56. (1 row)
57.
58.
On Thu, Aug 24, 2017 at 1:39 PM, Anandha L Ranganathan <
analog.sony@gmail.com> wrote:
> I am upgrading to HDP 2.6.1.0 and it stuck at 98%. We had installed
> Teradata presto services using Ambari and is not part of HDP packages. The
> HDP upgrade is unable to proceed because of presto services.
>
> Here is the screenshot of error messages.
>
>
> Upgrade did not succeed on 3 hosts <http://localhost:8080/#>
>
> Your options:
>
> - *Pause Upgrade*, delete the unhealthy hosts and return to the
> Upgrade Wizard to Proceed.
> - Perform a *Downgrade*, which will revert all hosts to the previous
> stack version.
>
>
>
>
>
> [image: Inline image 1]
>
>
> I can not downgrade and remove the presto services. Is there a way to
> ignore the presto service upgrade and continue and complete the upgrade. I
> am looking for something to run SQL script and update the ambari database.
>
> Thanks
> Anand
>
>
Re: HDP upgrade - stuck at 98% during finalize upgrade.
Posted by Anandha L Ranganathan <an...@gmail.com>.
Here are the query results from ambari database for presto service.
1. SELECT service_name, component_name, version, host_name FROM
hostcomponentstate hcs
2. JOIN hosts h ON hcs.host_id = h.host_id WHERE service_name NOT IN (
'AMBARI_METRICS', 'KERBEROS')
3. and component_name NOT IN ('ZKFC') ORDER BY version, service_name,
component_name, host_name;
4.
5.
6. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpgw01.glassdoor.
local
7. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpgw02.glassdoor.
local
8. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpgw03.glassdoor.
local
9. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpmn01.glassdoor.
local
10. ZOOKEEPER | ZOOKEEPER_CLIENT | 2.6.1.0-129 | usw2dxdpzo04.glassdoor.
local
11. ZOOKEEPER | ZOOKEEPER_SERVER | 2.6.1.0-129 | usw2dxdpzo02.glassdoor.
local
12. ZOOKEEPER | ZOOKEEPER_SERVER | 2.6.1.0-129 | usw2dxdpzo03.glassdoor.
local
13. ZOOKEEPER | ZOOKEEPER_SERVER | 2.6.1.0-129 | usw2dxdpzo04.glassdoor.
local
14. PRESTO | PRESTO_CLI | UNKNOWN | usw2dxdpgw01.glassdoor.local
15. PRESTO | PRESTO_COORDINATOR | UNKNOWN | usw2dxdpmn03.glassdoor.local
16. PRESTO | PRESTO_WORKER | UNKNOWN | usw2dxdppr01.glassdoor.local
17.
18. ambari=> select * from hostcomponentstate WHERE service_name IN (
'PRESTO');
19. cluster_id | component_name | version | current_stack_id |
current_state | host_id | service_name | upgrade_state | security_state |
id
20.
------------+--------------------+---------+------------------+---------------+---------+--------------+---------------+----------------+-----
21. 2 | PRESTO_CLI | UNKNOWN | 51 | INSTALLED | 3 | PRESTO | IN_PROGRESS
| UNKNOWN | 528
22. 2 | PRESTO_COORDINATOR | UNKNOWN | 51 | STARTED | 301 | PRESTO |
IN_PROGRESS | UNKNOWN | 534
23. 2 | PRESTO_WORKER | UNKNOWN | 51 | STARTED | 251 | PRESTO |
IN_PROGRESS | UNKNOWN | 535
24. (3 rows)
25.
26.
27. ambari=> SELECT * FROM hostcomponentdesiredstate WHERE service_name
IN ('PRESTO');
28. cluster_id | component_name | desired_stack_id | desired_state |
host_id | service_name | admin_state | maintenance_state |
security_state | restart_required | id
29.
------------+--------------------+------------------+---------------+---------+--------------+-------------+-------------------+----------------+------------------+----
30. 2 | PRESTO_WORKER | 101 | STARTED | 251 | PRESTO | INSERVICE | OFF |
UNSECURED | 0 | 20
31. 2 | PRESTO_CLI | 101 | INSTALLED | 3 | PRESTO | | OFF | UNSECURED | 0
| 23
32. 2 | PRESTO_COORDINATOR | 101 | STARTED | 301 | PRESTO | | OFF |
UNSECURED | 0 | 96
33. (3 rows)
34.
35.
36. ambari=> SELECT * FROM servicecomponentdesiredstate WHERE
service_name IN ('PRESTO');
37. component_name | cluster_id | desired_stack_id | desired_state |
service_name | recovery_enabled | desired_version | id
38.
--------------------+------------+------------------+---------------+--------------+------------------+-----------------+----
39. PRESTO_CLI | 2 | 101 | INSTALLED | PRESTO | 0 | 2.6.1.0-129 | 11
40. PRESTO_COORDINATOR | 2 | 101 | STARTED | PRESTO | 0 | 2.6.1.0-129 |
12
41. PRESTO_WORKER | 2 | 101 | STARTED | PRESTO | 0 | 2.6.1.0-129 | 13
42. (3 rows)
43.
44.
45. ambari=> SELECT * FROM servicedesiredstate WHERE service_name IN (
'PRESTO');
46. cluster_id | desired_host_role_mapping | desired_stack_id |
desired_state | service_name | maintenance_state | security_state |
credential_store_enabled
47.
------------+---------------------------+------------------+---------------+--------------+-------------------+----------------+--------------------------
48. 2 | 0 | 101 | STARTED | PRESTO | OFF | UNSECURED | 0
49. (1 row)
50.
51.
52. ambari=> SELECT * FROM clusterservices WHERE service_name IN (
'PRESTO');
53. service_name | cluster_id | service_enabled
54. --------------+------------+-----------------
55. PRESTO | 2 | 0
56. (1 row)
57.
58.
On Thu, Aug 24, 2017 at 1:39 PM, Anandha L Ranganathan <
analog.sony@gmail.com> wrote:
> I am upgrading to HDP 2.6.1.0 and it stuck at 98%. We had installed
> Teradata presto services using Ambari and is not part of HDP packages. The
> HDP upgrade is unable to proceed because of presto services.
>
> Here is the screenshot of error messages.
>
>
> Upgrade did not succeed on 3 hosts <http://localhost:8080/#>
>
> Your options:
>
> - *Pause Upgrade*, delete the unhealthy hosts and return to the
> Upgrade Wizard to Proceed.
> - Perform a *Downgrade*, which will revert all hosts to the previous
> stack version.
>
>
>
>
>
> [image: Inline image 1]
>
>
> I can not downgrade and remove the presto services. Is there a way to
> ignore the presto service upgrade and continue and complete the upgrade. I
> am looking for something to run SQL script and update the ambari database.
>
> Thanks
> Anand
>
>