You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Yuqi Gu (Jira)" <ji...@apache.org> on 2022/07/08 09:25:00 UTC
[jira] [Resolved] (BIGTOP-3718) Fix MapReduce2 service-check in Amabri Mpack
[ https://issues.apache.org/jira/browse/BIGTOP-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuqi Gu resolved BIGTOP-3718.
-----------------------------
Resolution: Fixed
The patch was mergd: https://github.com/apache/bigtop/pull/932
> Fix MapReduce2 service-check in Amabri Mpack
> --------------------------------------------
>
> Key: BIGTOP-3718
> URL: https://issues.apache.org/jira/browse/BIGTOP-3718
> Project: Bigtop
> Issue Type: Sub-task
> Components: deployment
> Affects Versions: 3.1.0
> Reporter: Yuqi Gu
> Assignee: Yuqi Gu
> Priority: Major
> Fix For: 3.2.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> It failed to check MapReduce2 service when deploying it by Bigtop Mpack in Ambari:
> {code:java}
> 2022-07-01 13:19:25,961 - call returned (0, '')
> 2022-07-01 13:19:25,961 - get_user_call_output returned (0, u'\{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File does not exist: /user/ambari-qa/mapredsmokeoutput"}}404', u'')
> 2022-07-01 13:19:25,962 - HdfsResource['/user/ambari-qa/mapredsmokeinput'] \{'security_enabled': False, 'hadoop_bin_dir': '/usr/bin', 'keytab': [EMPTY], 'source': '/etc/passwd', 'dfs_type': 'HDFS', 'default_fs': 'hdfs://bigtop-mpack-slave1-ctos7-x86:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': '/usr/bin/kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'action': ['create_on_execute'], 'hadoop_conf_dir': '/etc/hadoop/conf', 'type': 'file', 'immutable_paths': [u'/mr-history/done', u'/app-logs', u'/tmp']}
> 2022-07-01 13:19:25,963 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%\{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://bigtop-mpack-slave1-ctos7-x86:50070/webhdfs/v1/user/ambari-qa/mapredsmokeinput?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpCrcuqS 2>/tmp/tmpY_kPWZ''] \{'logoutput': None, 'quiet': False}
> 2022-07-01 13:19:26,047 - call returned (0, '')
> 2022-07-01 13:19:26,047 - get_user_call_output returned (0, u'\{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File does not exist: /user/ambari-qa/mapredsmokeinput"}}404', u'')
> 2022-07-01 13:19:26,048 - Creating new file /user/ambari-qa/mapredsmokeinput in DFS
> 2022-07-01 13:19:26,049 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%\{http_code}'"'"' -X PUT --data-binary @/etc/passwd -H '"'"'Content-Type: application/octet-stream'"'"' '"'"'http://bigtop-mpack-slave1-ctos7-x86:50070/webhdfs/v1/user/ambari-qa/mapredsmokeinput?op=CREATE&user.name=hdfs&overwrite=True'"'"' 1>/tmp/tmpenz4Y2 2>/tmp/tmppzNhuA''] \{'logoutput': None, 'quiet': False}
> Command failed after 1 tries
> {code}
>
> This task is to refine the Ambari service check python scripts to fix the issues.
> {code:java}
> And also fix the "JAR does not exist":
> File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of 'hadoop --config /etc/hadoop/conf jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.*.jar wordcount /user/ambari-qa/mapredsmokeinput /user/ambari-qa/mapredsmokeoutput' returned 255. JAR does not exist or is not a normal file: /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.*.jar
> {code}
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)