You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Alejandro Fernandez (JIRA)" <ji...@apache.org> on 2017/03/28 19:01:41 UTC

[jira] [Comment Edited] (AMBARI-20400) Yarn should not copy Tez and Slider tar ball if Tez and Sliders are not installed on the cluster

    [ https://issues.apache.org/jira/browse/AMBARI-20400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15945733#comment-15945733 ] 

Alejandro Fernandez edited comment on AMBARI-20400 at 3/28/17 7:00 PM:
-----------------------------------------------------------------------

[~dili], this is breaking since YARN History Server cannot copy mapreduce.tar.gz, which does ship with that package.
Can you take a look at it,

STR:
* Installed Ambari 3.0.0.0-537 on 3 hosts
* Installed HDP 3.0.0.0-163 with ZK, HDFS, YARN, MR
Host 1: ZK, NN, RM
Host 2: ZK, Standby NN, History Server
Host 3: ZK, ATS
* MapReduce Service Check fails because tarball wasn't copied. HADOOP_CLIENT is indeed present on all hosts.

On the host with History Server,
{code}
[root@c6404 3.0.0.0-163]# ls /usr/hdp/current/hadoop-client/mapreduce.tar.gz
/usr/hdp/current/hadoop-client/mapreduce.tar.gz
{code}

History Server Start command shows:
{noformat}
2017-03-28 18:34:42,309 - Called copy_to_hdfs tarball: mapreduce
2017-03-28 18:34:42,309 - Default version is 3.0.0.0-163
2017-03-28 18:34:42,309 - HADOOP_CLIENT is not installed on the host. Skip copying /usr/hdp/3.0.0.0-163/hadoop/mapreduce.tar.gz
2017-03-28 18:34:42,309 - Called copy_to_hdfs tarball: tez
2017-03-28 18:34:42,310 - Default version is 3.0.0.0-163
2017-03-28 18:34:42,310 - TEZ_CLIENT is not installed on the host. Skip copying /usr/hdp/3.0.0.0-163/tez/lib/tez.tar.gz
2017-03-28 18:34:42,310 - Called copy_to_hdfs tarball: slider
2017-03-28 18:34:42,310 - Default version is 3.0.0.0-163
2017-03-28 18:34:42,310 - SLIDER is not installed on the host. Skip copying /usr/hdp/3.0.0.0-163/slider/lib/slider.tar.gz
{noformat}


was (Author: afernandez):
[~dili], this is breaking since YARN History Server cannot copy mapreduce.tar.gz, which does ship with that package.

> Yarn should not copy Tez and Slider tar ball if Tez and Sliders are not installed on the cluster
> ------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-20400
>                 URL: https://issues.apache.org/jira/browse/AMBARI-20400
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: trunk
>            Reporter: Di Li
>            Assignee: Di Li
>             Fix For: trunk
>
>         Attachments: AMBARI-20400.patch, AMBARI-20400-v2.patch
>
>
> It's possible to install a cluster without Tez and Slider via blueprint. In this case, Yarn historyserver start logic prints two warnings about unable to copy tez and slider tar ball to HDFS.
> Yarn history server should skip the copy hdfs tar ball logic for tez and slider if they are not installed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)