[jira] [Commented] (AMBARI-21624) HDFS restart failed post Ambari upgrade when lzo compression was enabled

["Hadoop QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AMBARI-21624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110725#comment-16110725 ] 

Hadoop QA commented on AMBARI-21624:
------------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12879998/AMBARI-21624.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:red}-1 tests included{color}.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

    {color:red}-1 javac{color}.  The patch appears to cause the [build to fail|https://builds.apache.org/job/Ambari-trunk-test-patch/11914//artifact/patch-work/patchJavacWarnings.txt].

Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/11914//console

This message is automatically generated.

> HDFS restart failed post Ambari upgrade when lzo compression was enabled
> ------------------------------------------------------------------------
>
>                 Key: AMBARI-21624
>                 URL: https://issues.apache.org/jira/browse/AMBARI-21624
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.5.2
>            Reporter: Di Li
>            Assignee: Doroszlai, Attila
>             Fix For: 2.5.2
>
>         Attachments: AMBARI-21624.patch
>
>
> This is specifically for the IOP to HDP migration. We started with an IOP 4.2.5 cluster where HDFS had "com.hadoop.compression.lzo" as part of the core-site/io.compression.codecs property value.  After Ambari upgrade (build 2.5.2-155), we couldn't restart HDFS, where it failed with the following error (bold/italic for the error line)
> IOP 4.2.5 lzo package is hadoop-lzo-0.5.1-2.x86_64.rpm, which doesn't fit the naming convention Ambari 2.5.2 uses (seems to be coming from HDP 2.3 stack via inheritance). It's also puzzling why the inheritance as this was right after Ambari upgrade where the stack was still IOP 4.2.5 stack that extends common services directly.
> {code}
> 2017-07-31 09:00:59,827 - Package['lzo'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
> 2017-07-31 09:01:00,355 - Skipping installation of existing package lzo
> 2017-07-31 09:01:00,355 - Package['hadoop-lzo-native'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
> 2017-07-31 09:01:00,381 - Skipping installation of existing package hadoop-lzo-native
> 2017-07-31 09:01:00,381 - Package['hadooplzo_4_2_5_IBM_1_1'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
> *_2017-07-31 09:01:00,407 - Installing package hadooplzo_4_2_5_IBM_1_1 ('/usr/bin/yum -d 0 -e 0 -y install hadooplzo_4_2_5_IBM_1_1')
> 2017-07-31 09:01:01,212 - Execution of '/usr/bin/yum -d 0 -e 0 -y install hadooplzo_4_2_5_IBM_1_1' returned 1. Error: Nothing to do_*
> 2017-07-31 09:01:01,212 - Failed to install package hadooplzo_4_2_5_IBM_1_1. Executing '/usr/bin/yum clean metadata'
> 2017-07-31 09:01:01,553 - Retrying to install package hadooplzo_4_2_5_IBM_1_1 after 30 seconds
> Command failed after 1 tries
> core-site has io.compression.codecs = org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.SnappyCodec,com.hadoop.compression.lzo.LzoCodec
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)