You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2017/08/11 21:02:00 UTC

[jira] [Commented] (AMBARI-21708) History Server cannot be started due to wrong permissions of /mr-history

    [ https://issues.apache.org/jira/browse/AMBARI-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124049#comment-16124049 ] 

Hadoop QA commented on AMBARI-21708:
------------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12881429/AMBARI-21708.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified test files.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:red}-1 core tests{color}.  The test build failed in [ambari-server|https://builds.apache.org/job/Ambari-trunk-test-patch/11985//artifact/patch-work/testrun_ambari-server.txt] 

Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/11985//console

This message is automatically generated.

> History Server cannot be started due to wrong permissions of /mr-history
> ------------------------------------------------------------------------
>
>                 Key: AMBARI-21708
>                 URL: https://issues.apache.org/jira/browse/AMBARI-21708
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 3.0.0
>            Reporter: Doroszlai, Attila
>            Assignee: Doroszlai, Attila
>            Priority: Critical
>             Fix For: 3.0.0
>
>         Attachments: AMBARI-21708.patch
>
>
> Steps to reproduce:
> # Install Ambari from trunk
> # Create cluster with MapReduce2
> Result: History Server becomes stopped after starting it.
> During startup History Server tries to create {{/mr-history/tmp}}, but fails:
> {noformat:title=mapred-mapred-historyserver.log}
> 2017-08-09 11:54:20,957 INFO  service.AbstractService (AbstractService.java:noteFailure(272)) - Service org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Error creating intermediate done directory
> ...
> Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=mapred, access=WRITE, inode="/mr-history/tmp":hdfs:hdfs:drwxr-xr-x
> ...
> 2017-08-09 11:54:20,971 INFO  util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status -1
> {noformat}
> Caused by wrong permissions on {{/mr-history}}:
> {noformat:title=trunk}
> drwxr-xr-x   - hdfs   hdfs            0 2017-08-09 11:54 /mr-history
> drwxrwxrwx   - mapred hadoop          0 2017-08-09 11:54 /mr-history/done
> {noformat}
> {noformat:title=branch-2.5}
> drwxrwxrwx   - mapred hadoop          0 2017-08-09 12:26 /mr-history
> drwxrwxrwx   - mapred hadoop          0 2017-08-09 12:26 /mr-history/done
> drwxrwxrwt   - mapred hadoop          0 2017-08-09 12:26 /mr-history/tmp
> {noformat}
> In AMBARI-21116 recursive permissions were eliminated for the wrong directory in {{YARN/2.1.0.2.0}}: {{mapreduce_jobhistory_done_dir}} instead of {{node_labels_dir}}.
> Compare:
> {noformat:title=YARN/2.1.0.2.0/package/scripts/yarn.py}
>    params.HdfsResource(params.mapreduce_jobhistory_done_dir,
>                         type="directory",
>                          action="create_on_execute",
>                          owner=params.mapred_user,
>                          group=params.user_group,
>  -                       change_permissions_for_parents=True,
>                          mode=0777
>     )
> {noformat}
> with:
> {noformat:title=YARN/3.0.0.3.0/package/scripts/yarn.py}
>      params.HdfsResource(params.node_labels_dir,
>                            type="directory",
>                            action="create_on_execute",
>  -                         change_permissions_for_parents=True,
>                            owner=params.yarn_user,
>                            group=params.user_group,
>                            mode=0700
>      )
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)