You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Yu Hou (Jira)" <ji...@apache.org> on 2022/08/28 05:40:00 UTC

[jira] [Updated] (BIGTOP-3788) Fix Ambari-HDFS components fail to start when kerberos enabled

     [ https://issues.apache.org/jira/browse/BIGTOP-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yu Hou updated BIGTOP-3788:
---------------------------
    Summary: Fix Ambari-HDFS components fail to start when kerberos enabled  (was: Fix Ambari-HDFS components start error when kerberos enabled)

> Fix Ambari-HDFS components fail to start when kerberos enabled
> --------------------------------------------------------------
>
>                 Key: BIGTOP-3788
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3788
>             Project: Bigtop
>          Issue Type: Sub-task
>         Environment: bigtop-3.2.0-snapshot
> hdfs-3.3.4
>            Reporter: Yu Hou
>            Assignee: Yu Hou
>            Priority: Major
>
> It failed  to start Datanode and Namenode when enable kerberos.
> Failed to start DataNode
> {code:java}
> Traceback (most recent call last):
>   File "/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HDFS/package/scripts/datanode.py", line 172, in <module>
>     DataNode().execute()
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 355, in execute
>     self.execute_prefix_function(self.command_name, 'post', env)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 386, in execute_prefix_function
>     method(env)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 428, in post_start
>     raise Fail("Pid file {0} doesn't exist after starting of the component.".format(pid_file))
> resource_management.core.exceptions.Fail: Pid file /var/run/hadoop/hdfs/hadoop-hdfs-datanode.pid doesn't exist after starting of the component.
> {code}
> Failed to start Namenode
> {code:java}
> Traceback (most recent call last):
>   File "/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HDFS/package/scripts/namenode.py", line 410, in <module>
>     NameNode().execute()
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HDFS/package/scripts/namenode.py", line 141, in start
>     upgrade_suspended=params.upgrade_suspended, env=env)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 89, in thunk
>     return fn(*args, **kwargs)
>   File "/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HDFS/package/scripts/hdfs_namenode.py", line 239, in namenode
>     create_hdfs_directories(name_service)
>   File "/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HDFS/package/scripts/hdfs_namenode.py", line 309, in create_hdfs_directories
>     nameservices=name_services,
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
>     self.env.run()
>   File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
>     self.run_action(resource, action)
>   File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
>     provider_action()
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 677, in action_create_on_execute
>     self.action_delayed("create")
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 674, in action_delayed
>     self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 373, in action_delayed
>     self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 395, in action_delayed_for_nameservice
>     self._assert_valid()
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 334, in _assert_valid
>     self.target_status = self._get_file_status(target)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 497, in _get_file_status
>     list_status = self.util.run_command(target, 'GETFILESTATUS', method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 214, in run_command
>     return self._run_command(*args, **kwargs)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 295, in _run_command
>     raise WebHDFSCallException(err_msg, result_dict)
> resource_management.libraries.providers.hdfs_resource.WebHDFSCallException: Execution of 'curl -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' --negotiate -u : 'http://ambari-agent-01:50070/webhdfs/v1/tmp?op=GETFILESTATUS'' returned status_code=403. 
> {
>   "RemoteException": {
>     "exception": "SecurityException", 
>     "javaClassName": "java.lang.SecurityException", 
>     "message": "Failed to obtain user group information: java.io.IOException: Security enabled but user not authenticated by filter"
>   }
> }
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)