You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Jonathan Hurley (JIRA)" <ji...@apache.org> on 2017/10/09 16:26:00 UTC
[jira] [Reopened] (AMBARI-22160) hadooplzo package installation
failed on devdeploys
[ https://issues.apache.org/jira/browse/AMBARI-22160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hurley reopened AMBARI-22160:
--------------------------------------
Reverted since HDFS Service Checks are failing after applying this patch. STR:
- Install HDP 2.6.0.0 with HDFS and ZK using a VDF
- Run service check after install
{code}
2017-10-09 16:15:18,577 - Unable to load available packages
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 760, in load_available_packages
self.available_packages_in_repos = pkg_provider.get_available_packages_in_repos(CommandRepository(config['repositoryFile']))
NameError: global name 'config' is not defined
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/service_check.py", line 137, in <module>
HdfsServiceCheck().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 367, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/service_check.py", line 33, in service_check
import params
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/params.py", line 25, in <module>
from params_linux import *
File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py", line 391, in <module>
lzo_packages = get_lzo_packages(stack_version_unformatted)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/get_lzo_packages.py", line 45, in get_lzo_packages
lzo_packages += [script_instance.format_package_name("hadooplzo_${stack_version}"),
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 537, in format_package_name
raise Fail("Cannot match package for regexp name {0}. Available packages: {1}".format(name, self.available_packages_in_repos))
resource_management.core.exceptions.Fail: Cannot match package for regexp name hadooplzo_${stack_version}. Available packages: []
{code}
> hadooplzo package installation failed on devdeploys
> ---------------------------------------------------
>
> Key: AMBARI-22160
> URL: https://issues.apache.org/jira/browse/AMBARI-22160
> Project: Ambari
> Issue Type: Bug
> Reporter: Andrew Onischuk
> Assignee: Andrew Onischuk
> Fix For: 2.6.0
>
> Attachments: AMBARI-22160.patch, AMBARI-22160.patch, AMBARI-22160.patch, AMBARI-22160.patch
>
>
> Installation log:
>
>
>
> 2017-10-04 14:21:45,371 - Package['hadooplzo-2-6-3-0-159'] {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:45,395 - Skipping installation of existing package hadooplzo-2-6-3-0-159
> 2017-10-04 14:21:45,396 - Package['libhdfs0-2-6-3-0-159'] {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:45,420 - Skipping installation of existing package libhdfs0-2-6-3-0-159
> 2017-10-04 14:21:45,424 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
> 2017-10-04 14:21:45,431 - File['/etc/security/limits.d/hdfs.conf'] {'content': Template('hdfs.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
> 2017-10-04 14:21:45,432 - Writing File['/etc/security/limits.d/hdfs.conf'] because it doesn't exist
> 2017-10-04 14:21:45,432 - Changing permission for /etc/security/limits.d/hdfs.conf from 640 to 644
> 2017-10-04 14:21:45,432 - XmlConfig['hadoop-policy.xml'] {'owner': 'cstm-hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {}, 'configurations': ...}
> 2017-10-04 14:21:45,444 - Generating config: /usr/hdp/current/hadoop-client/conf/hadoop-policy.xml
> 2017-10-04 14:21:45,444 - File['/usr/hdp/current/hadoop-client/conf/hadoop-policy.xml'] {'owner': 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,453 - Writing File['/usr/hdp/current/hadoop-client/conf/hadoop-policy.xml'] because contents don't match
> 2017-10-04 14:21:45,454 - Changing owner for /usr/hdp/current/hadoop-client/conf/hadoop-policy.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,454 - XmlConfig['ssl-client.xml'] {'owner': 'cstm-hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {}, 'configurations': ...}
> 2017-10-04 14:21:45,463 - Generating config: /usr/hdp/current/hadoop-client/conf/ssl-client.xml
> 2017-10-04 14:21:45,464 - File['/usr/hdp/current/hadoop-client/conf/ssl-client.xml'] {'owner': 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,470 - Writing File['/usr/hdp/current/hadoop-client/conf/ssl-client.xml'] because it doesn't exist
> 2017-10-04 14:21:45,470 - Changing owner for /usr/hdp/current/hadoop-client/conf/ssl-client.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,470 - Changing group for /usr/hdp/current/hadoop-client/conf/ssl-client.xml from 0 to hadoop
> 2017-10-04 14:21:45,471 - Directory['/usr/hdp/current/hadoop-client/conf/secure'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'}
> 2017-10-04 14:21:45,471 - Creating directory Directory['/usr/hdp/current/hadoop-client/conf/secure'] since it doesn't exist.
> 2017-10-04 14:21:45,471 - Changing group for /usr/hdp/current/hadoop-client/conf/secure from 0 to hadoop
> 2017-10-04 14:21:45,472 - XmlConfig['ssl-client.xml'] {'owner': 'cstm-hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hadoop-client/conf/secure', 'configuration_attributes': {}, 'configurations': ...}
> 2017-10-04 14:21:45,482 - Generating config: /usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml
> 2017-10-04 14:21:45,482 - File['/usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml'] {'owner': 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,489 - Writing File['/usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml'] because it doesn't exist
> 2017-10-04 14:21:45,489 - Changing owner for /usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,489 - Changing group for /usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml from 0 to hadoop
> 2017-10-04 14:21:45,490 - XmlConfig['ssl-server.xml'] {'owner': 'cstm-hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {}, 'configurations': ...}
> 2017-10-04 14:21:45,499 - Generating config: /usr/hdp/current/hadoop-client/conf/ssl-server.xml
> 2017-10-04 14:21:45,499 - File['/usr/hdp/current/hadoop-client/conf/ssl-server.xml'] {'owner': 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,506 - Writing File['/usr/hdp/current/hadoop-client/conf/ssl-server.xml'] because it doesn't exist
> 2017-10-04 14:21:45,506 - Changing owner for /usr/hdp/current/hadoop-client/conf/ssl-server.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,507 - Changing group for /usr/hdp/current/hadoop-client/conf/ssl-server.xml from 0 to hadoop
> 2017-10-04 14:21:45,507 - XmlConfig['hdfs-site.xml'] {'owner': 'cstm-hdfs', 'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {u'final': {u'dfs.support.append': u'true', u'dfs.datanode.data.dir': u'true', u'dfs.namenode.http-address': u'true', u'dfs.namenode.name.dir': u'true', u'dfs.webhdfs.enabled': u'true', u'dfs.datanode.failed.volumes.tolerated': u'true'}}, 'configurations': ...}
> 2017-10-04 14:21:45,516 - Generating config: /usr/hdp/current/hadoop-client/conf/hdfs-site.xml
> 2017-10-04 14:21:45,517 - File['/usr/hdp/current/hadoop-client/conf/hdfs-site.xml'] {'owner': 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,564 - Writing File['/usr/hdp/current/hadoop-client/conf/hdfs-site.xml'] because contents don't match
> 2017-10-04 14:21:45,564 - Changing owner for /usr/hdp/current/hadoop-client/conf/hdfs-site.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,565 - XmlConfig['core-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'mode': 0644, 'configuration_attributes': {u'final': {u'fs.defaultFS': u'true'}}, 'owner': 'cstm-hdfs', 'configurations': ...}
> 2017-10-04 14:21:45,574 - Generating config: /usr/hdp/current/hadoop-client/conf/core-site.xml
> 2017-10-04 14:21:45,575 - File['/usr/hdp/current/hadoop-client/conf/core-site.xml'] {'owner': 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,604 - File['/usr/hdp/current/hadoop-client/conf/slaves'] {'content': Template('slaves.j2'), 'owner': 'cstm-hdfs'}
> 2017-10-04 14:21:45,605 - Writing File['/usr/hdp/current/hadoop-client/conf/slaves'] because contents don't match
> 2017-10-04 14:21:45,605 - Changing owner for /usr/hdp/current/hadoop-client/conf/slaves from 0 to cstm-hdfs
> 2017-10-04 14:21:45,606 - Package['liblzo2-2'] {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:45,630 - Installing package liblzo2-2 ('/usr/bin/apt-get -q -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install liblzo2-2')
> 2017-10-04 14:21:48,997 - Package['hadooplzo-2-6-3-0'] {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:49,021 - Installing package hadooplzo-2-6-3-0 ('/usr/bin/apt-get -q -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadooplzo-2-6-3-0')
> 2017-10-04 14:21:50,632 - Execution of '/usr/bin/apt-get -q -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadooplzo-2-6-3-0' returned 100. Reading package lists...
> Building dependency tree...
> Reading state information...
> W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/ambari-hdp-1.list:1 and /etc/apt/sources.list.d/hdp.list:2
> W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/ambari-hdp-1.list:1 and /etc/apt/sources.list.d/hdp.list:2
> W: Target Packages (main/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/ambari-hdp-1.list:2 and /etc/apt/sources.list.d/hdp.list:3
> W: Target Packages (main/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/ambari-hdp-1.list:2 and /etc/apt/sources.list.d/hdp.list:3
> E: Unable to locate package hadooplzo-2-6-3-0
> 2017-10-04 14:21:50,632 - Failed to install package hadooplzo-2-6-3-0. Executing '/usr/bin/apt-get update -qq'
> 2017-10-04 14:21:52,716 - Retrying to install package hadooplzo-2-6-3-0 after 30 seconds
>
> Why we trying to install package several times using different package
> version?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)