You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2015/09/22 17:05:23 UTC
Review Request 38629: Ambari QE Deploy Test - Configuration parameter
'javax.jdo.option.ConnectionPassword' was not found in configurations
dictionary
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38629/
-----------------------------------------------------------
Review request for Ambari and Dmitro Lisnichenko.
Bugs: AMBARI-13188
https://issues.apache.org/jira/browse/AMBARI-13188
Repository: ambari
Description
-------
Impact: Prevents cluster from installing Hive service
Artifacts: [artifacts ](http://linux-jenkins.qe.hortonworks.com/home/jenkins
/qe-artifacts/os-d7-vhnzys-devdeploy)
Environment: [env_description.txt ](http://linux-
jenkins.qe.hortonworks.com/home/jenkins/qe-artifacts/os-d7-vhnzys-devdeploy/ar
tifacts/screenshots/com.hw.ambari.ui.tests.installer.InstallHadoop/install/_22
_14_20_34_Page_with_URL__http_os_d7_vhnzys_devdeploy_5_novalocal8080_installer
_step10__has_not_be/env_description.txt)
Screenshot: [screenshot ](http://linux-jenkins.qe.hortonworks.com/home/jenkins
/qe-artifacts/os-d7-vhnzys-devdeploy/artifacts/screenshots/com.hw.ambari.ui.te
sts.installer.InstallHadoop/install/_22_14_20_34_Page_with_URL__http_os_d7_vhn
zys_devdeploy_5_novalocal8080_installer_step10__has_not_be/screenshot.png)
StackTrace [stackTrace.txt ](http://linux-
jenkins.qe.hortonworks.com/home/jenkins/qe-artifacts/os-d7-vhnzys-devdeploy/ar
tifacts/screenshots/com.hw.ambari.ui.tests.installer.InstallHadoop/install/_22
_14_20_34_Page_with_URL__http_os_d7_vhnzys_devdeploy_5_novalocal8080_installer
_step10__has_not_be/stackTrace.txt)
Log:
**stderr**
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_client.py", line 63, in <module>
HiveClient().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_client.py", line 30, in install
import params
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/params.py", line 26, in <module>
from params_linux import *
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py", line 167, in <module>
hive_metastore_user_passwd = unicode(config['configurations']['hive-site']['javax.jdo.option.ConnectionPassword'])
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py", line 81, in __getattr__
raise Fail("Configuration parameter '" + self.name + "' was not found in configurations dictionary!")
resource_management.core.exceptions.Fail: Configuration parameter 'javax.jdo.option.ConnectionPassword' was not found in configurations dictionary!
**stdout**
2015-09-22 14:23:27,540 - Group['hadoop'] {}
2015-09-22 14:23:27,541 - Group['users'] {}
2015-09-22 14:23:27,541 - Group['knox'] {}
2015-09-22 14:23:27,542 - Group['spark'] {}
2015-09-22 14:23:27,542 - User['hive'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,543 - User['oozie'] {'gid': 'hadoop', 'groups': [u'users']}
2015-09-22 14:23:27,544 - User['ambari-qa'] {'gid': 'hadoop', 'groups': [u'users']}
2015-09-22 14:23:27,545 - User['flume'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,546 - User['hdfs'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,547 - User['knox'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,548 - User['spark'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,548 - User['mapred'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,549 - User['accumulo'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,550 - User['hbase'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,551 - User['tez'] {'gid': 'hadoop', 'groups': [u'users']}
2015-09-22 14:23:27,552 - User['zookeeper'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,552 - User['mahout'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,553 - User['kafka'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,554 - User['sqoop'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,555 - User['yarn'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,556 - User['hcat'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,557 - User['ams'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,557 - User['atlas'] {'gid': 'hadoop', 'groups': [u'hadoop']}
2015-09-22 14:23:27,558 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-09-22 14:23:27,561 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2015-09-22 14:23:27,573 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2015-09-22 14:23:27,573 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'recursive': True, 'mode': 0775, 'cd_access': 'a'}
2015-09-22 14:23:27,574 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-09-22 14:23:27,576 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2015-09-22 14:23:27,586 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2015-09-22 14:23:27,587 - Group['hdfs'] {'ignore_failures': False}
2015-09-22 14:23:27,587 - User['hdfs'] {'ignore_failures': False, 'groups': [u'hadoop', u'hdfs']}
2015-09-22 14:23:27,588 - Directory['/etc/hadoop'] {'mode': 0755}
2015-09-22 14:23:27,610 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2015-09-22 14:23:27,611 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 0777}
2015-09-22 14:23:27,628 - Repository['HDP-2.3'] {'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos7/2.x/BUILDS/2.3.2.0-2897', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP', 'mirror_list': None}
2015-09-22 14:23:27,639 - File['/etc/yum.repos.d/HDP.repo'] {'content': InlineTemplate(...)}
2015-09-22 14:23:27,640 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2015-09-22 14:23:27,644 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': InlineTemplate(...)}
2015-09-22 14:23:27,645 - Package['unzip'] {}
2015-09-22 14:23:27,735 - Skipping installation of existing package unzip
2015-09-22 14:23:27,735 - Package['curl'] {}
2015-09-22 14:23:27,748 - Skipping installation of existing package curl
2015-09-22 14:23:27,748 - Package['hdp-select'] {}
2015-09-22 14:23:27,763 - Skipping installation of existing package hdp-select
Diffs
-----
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py 52225a6
Diff: https://reviews.apache.org/r/38629/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 38629: Ambari QE Deploy Test - Configuration
parameter
'javax.jdo.option.ConnectionPassword' was not found in configurations
dictionary
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38629/#review99993
-----------------------------------------------------------
Ship it!
Ship It!
- Dmitro Lisnichenko
On Sept. 22, 2015, 3:05 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38629/
> -----------------------------------------------------------
>
> (Updated Sept. 22, 2015, 3:05 p.m.)
>
>
> Review request for Ambari and Dmitro Lisnichenko.
>
>
> Bugs: AMBARI-13188
> https://issues.apache.org/jira/browse/AMBARI-13188
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Impact: Prevents cluster from installing Hive service
>
> Artifacts: [artifacts ](http://linux-jenkins.qe.hortonworks.com/home/jenkins
> /qe-artifacts/os-d7-vhnzys-devdeploy)
>
> Environment: [env_description.txt ](http://linux-
> jenkins.qe.hortonworks.com/home/jenkins/qe-artifacts/os-d7-vhnzys-devdeploy/ar
> tifacts/screenshots/com.hw.ambari.ui.tests.installer.InstallHadoop/install/_22
> _14_20_34_Page_with_URL__http_os_d7_vhnzys_devdeploy_5_novalocal8080_installer
> _step10__has_not_be/env_description.txt)
>
> Screenshot: [screenshot ](http://linux-jenkins.qe.hortonworks.com/home/jenkins
> /qe-artifacts/os-d7-vhnzys-devdeploy/artifacts/screenshots/com.hw.ambari.ui.te
> sts.installer.InstallHadoop/install/_22_14_20_34_Page_with_URL__http_os_d7_vhn
> zys_devdeploy_5_novalocal8080_installer_step10__has_not_be/screenshot.png)
>
> StackTrace [stackTrace.txt ](http://linux-
> jenkins.qe.hortonworks.com/home/jenkins/qe-artifacts/os-d7-vhnzys-devdeploy/ar
> tifacts/screenshots/com.hw.ambari.ui.tests.installer.InstallHadoop/install/_22
> _14_20_34_Page_with_URL__http_os_d7_vhnzys_devdeploy_5_novalocal8080_installer
> _step10__has_not_be/stackTrace.txt)
>
> Log:
>
> **stderr**
>
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_client.py", line 63, in <module>
> HiveClient().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_client.py", line 30, in install
> import params
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/params.py", line 26, in <module>
> from params_linux import *
> File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py", line 167, in <module>
> hive_metastore_user_passwd = unicode(config['configurations']['hive-site']['javax.jdo.option.ConnectionPassword'])
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py", line 81, in __getattr__
> raise Fail("Configuration parameter '" + self.name + "' was not found in configurations dictionary!")
> resource_management.core.exceptions.Fail: Configuration parameter 'javax.jdo.option.ConnectionPassword' was not found in configurations dictionary!
>
>
> **stdout**
>
>
> 2015-09-22 14:23:27,540 - Group['hadoop'] {}
> 2015-09-22 14:23:27,541 - Group['users'] {}
> 2015-09-22 14:23:27,541 - Group['knox'] {}
> 2015-09-22 14:23:27,542 - Group['spark'] {}
> 2015-09-22 14:23:27,542 - User['hive'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,543 - User['oozie'] {'gid': 'hadoop', 'groups': [u'users']}
> 2015-09-22 14:23:27,544 - User['ambari-qa'] {'gid': 'hadoop', 'groups': [u'users']}
> 2015-09-22 14:23:27,545 - User['flume'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,546 - User['hdfs'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,547 - User['knox'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,548 - User['spark'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,548 - User['mapred'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,549 - User['accumulo'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,550 - User['hbase'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,551 - User['tez'] {'gid': 'hadoop', 'groups': [u'users']}
> 2015-09-22 14:23:27,552 - User['zookeeper'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,552 - User['mahout'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,553 - User['kafka'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,554 - User['sqoop'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,555 - User['yarn'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,556 - User['hcat'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,557 - User['ams'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,557 - User['atlas'] {'gid': 'hadoop', 'groups': [u'hadoop']}
> 2015-09-22 14:23:27,558 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
> 2015-09-22 14:23:27,561 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
> 2015-09-22 14:23:27,573 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
> 2015-09-22 14:23:27,573 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'recursive': True, 'mode': 0775, 'cd_access': 'a'}
> 2015-09-22 14:23:27,574 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
> 2015-09-22 14:23:27,576 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
> 2015-09-22 14:23:27,586 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
> 2015-09-22 14:23:27,587 - Group['hdfs'] {'ignore_failures': False}
> 2015-09-22 14:23:27,587 - User['hdfs'] {'ignore_failures': False, 'groups': [u'hadoop', u'hdfs']}
> 2015-09-22 14:23:27,588 - Directory['/etc/hadoop'] {'mode': 0755}
> 2015-09-22 14:23:27,610 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
> 2015-09-22 14:23:27,611 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 0777}
> 2015-09-22 14:23:27,628 - Repository['HDP-2.3'] {'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos7/2.x/BUILDS/2.3.2.0-2897', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP', 'mirror_list': None}
> 2015-09-22 14:23:27,639 - File['/etc/yum.repos.d/HDP.repo'] {'content': InlineTemplate(...)}
> 2015-09-22 14:23:27,640 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
> 2015-09-22 14:23:27,644 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': InlineTemplate(...)}
> 2015-09-22 14:23:27,645 - Package['unzip'] {}
> 2015-09-22 14:23:27,735 - Skipping installation of existing package unzip
> 2015-09-22 14:23:27,735 - Package['curl'] {}
> 2015-09-22 14:23:27,748 - Skipping installation of existing package curl
> 2015-09-22 14:23:27,748 - Package['hdp-select'] {}
> 2015-09-22 14:23:27,763 - Skipping installation of existing package hdp-select
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py 52225a6
>
> Diff: https://reviews.apache.org/r/38629/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>