You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Jonathan Hurley <jh...@hortonworks.com> on 2015/05/29 21:31:31 UTC
Review Request 34825: Hive Metastore Upgrade Fails During Upgrade
Schema
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34825/
-----------------------------------------------------------
Review request for Ambari and Nate Cole.
Bugs: AMBARI-11545
https://issues.apache.org/jira/browse/AMBARI-11545
Repository: ambari
Description
-------
When upgrading Hive from HDP 2.2 to 2.3, metastore upgrade fails.
```
2015-05-29 13:37:54,062 - Executing Metastore Rolling Upgrade pre-restart
2015-05-29 13:37:54,064 - Upgrading Hive Metastore
2015-05-29 13:37:54,065 - Execute['/usr/hdp/2.3.0.0-2162/hive/bin/schematool -dbType mysql -upgradeSchema'] {'logoutput': True, 'environment': {'HIVE_CONF_DIR': '/usr/hdp/current/hive-metastore/conf/conf.server'}, 'tries': 1, 'user': 'hive'}
WARNING: Use "yarn jar" to launch YARN applications.
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
*** schemaTool failed ***
```
lt appears as though conf-select is not yet called and therefore the configuration directory doesn't exist:
```
[root@jhurley-hdp22-ru-4 conf.server]# ll /usr/hdp/current/hive-metastore/conf/conf.server
ls: cannot access /usr/hdp/current/hive-metastore/conf/conf.server: No such file or directory
[root@jhurley-hdp22-ru-4 conf.server]# ll /usr/hdp/current/hive-metastore/conf
lrwxrwxrwx. 1 root root 14 May 29 03:31 /usr/hdp/current/hive-metastore/conf -> /etc/hive/conf
[root@jhurley-hdp22-ru-4 conf.server]# ll /usr/hdp/current | grep hive
lrwxrwxrwx. 1 root root 26 May 29 03:59 hive-client -> /usr/hdp/2.2.7.0-2808/hive
lrwxrwxrwx. 1 root root 26 May 29 03:31 hive-metastore -> /usr/hdp/2.2.7.0-2808/hive
lrwxrwxrwx. 1 root root 26 May 29 03:31 hive-server2 -> /usr/hdp/2.2.7.0-2808/hive
lrwxrwxrwx. 1 root root 35 May 29 03:31 hive-webhcat -> /usr/hdp/2.2.7.0-2808/hive-hcatalog
[root@jhurley-hdp22-ru-4 conf.server]# ll /etc/hive
drwxr-xr-x. 2 hive hadoop 4096 May 29 03:35 conf
drwxr-xr-x. 2 hive hadoop 4096 May 29 03:37 conf.server
```
Diffs
-----
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py 3c7900d
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py b98cd91
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/configuration/storm-env.xml 5129d87
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py fa31f04
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/setup_ranger_storm.py 3c69b6b
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/storm_upgrade.py 909c5d6
Diff: https://reviews.apache.org/r/34825/diff/
Testing
-------
Upgraded hive
----------------------------------------------------------------------
Total run:744
Total errors:0
Total failures:0
OK
Thanks,
Jonathan Hurley
Re: Review Request 34825: Hive Metastore Upgrade Fails During Upgrade
Schema
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34825/
-----------------------------------------------------------
(Updated May 29, 2015, 3:33 p.m.)
Review request for Ambari and Nate Cole.
Bugs: AMBARI-11545
https://issues.apache.org/jira/browse/AMBARI-11545
Repository: ambari
Description
-------
When upgrading Hive from HDP 2.2 to 2.3, metastore upgrade fails.
```
2015-05-29 13:37:54,062 - Executing Metastore Rolling Upgrade pre-restart
2015-05-29 13:37:54,064 - Upgrading Hive Metastore
2015-05-29 13:37:54,065 - Execute['/usr/hdp/2.3.0.0-2162/hive/bin/schematool -dbType mysql -upgradeSchema'] {'logoutput': True, 'environment': {'HIVE_CONF_DIR': '/usr/hdp/current/hive-metastore/conf/conf.server'}, 'tries': 1, 'user': 'hive'}
WARNING: Use "yarn jar" to launch YARN applications.
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
*** schemaTool failed ***
```
lt appears as though conf-select is not yet called and therefore the configuration directory doesn't exist:
```
[root@jhurley-hdp22-ru-4 conf.server]# ll /usr/hdp/current/hive-metastore/conf/conf.server
ls: cannot access /usr/hdp/current/hive-metastore/conf/conf.server: No such file or directory
[root@jhurley-hdp22-ru-4 conf.server]# ll /usr/hdp/current/hive-metastore/conf
lrwxrwxrwx. 1 root root 14 May 29 03:31 /usr/hdp/current/hive-metastore/conf -> /etc/hive/conf
[root@jhurley-hdp22-ru-4 conf.server]# ll /usr/hdp/current | grep hive
lrwxrwxrwx. 1 root root 26 May 29 03:59 hive-client -> /usr/hdp/2.2.7.0-2808/hive
lrwxrwxrwx. 1 root root 26 May 29 03:31 hive-metastore -> /usr/hdp/2.2.7.0-2808/hive
lrwxrwxrwx. 1 root root 26 May 29 03:31 hive-server2 -> /usr/hdp/2.2.7.0-2808/hive
lrwxrwxrwx. 1 root root 35 May 29 03:31 hive-webhcat -> /usr/hdp/2.2.7.0-2808/hive-hcatalog
[root@jhurley-hdp22-ru-4 conf.server]# ll /etc/hive
drwxr-xr-x. 2 hive hadoop 4096 May 29 03:35 conf
drwxr-xr-x. 2 hive hadoop 4096 May 29 03:37 conf.server
```
Diffs (updated)
-----
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py 3c7900d
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py b98cd91
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/configuration/storm-env.xml 5129d87
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py fa31f04
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/setup_ranger_storm.py 3c69b6b
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/storm_upgrade.py 909c5d6
Diff: https://reviews.apache.org/r/34825/diff/
Testing
-------
Upgraded hive
----------------------------------------------------------------------
Total run:744
Total errors:0
Total failures:0
OK
Thanks,
Jonathan Hurley