You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Attila Magyar (JIRA)" <ji...@apache.org> on 2018/07/10 12:09:01 UTC

[jira] [Updated] (AMBARI-24272) OneFS service check fails with 'dfs_type' is not set.

     [ https://issues.apache.org/jira/browse/AMBARI-24272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Attila Magyar updated AMBARI-24272:
-----------------------------------
    Description: 
Following error comes when running a OneFS service check.

{code}
resource_management.core.exceptions.Fail: Resource parameter 'dfs_type' is not set.


stderr:
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/ONEFS/package/scripts/service_check.py", line 59, in <module>
    HdfsServiceCheck().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/ONEFS/package/scripts/service_check.py", line 43, in service_check
    mode=0777
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 119, in run_action
    provider = provider_class(resource)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 594, in __init__
    self.assert_parameter_is_set('dfs_type')
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 673, in assert_parameter_is_set
    raise Fail("Resource parameter '{0}' is not set.".format(parameter_name))
resource_management.core.exceptions.Fail: Resource parameter 'dfs_type' is not set.
stdout:
2018-07-09 17:29:05,706 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1485/hadoop/conf
2018-07-09 17:29:05,715 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1485/hadoop/conf
2018-07-09 17:29:05,717 - checked_call['hostid'] {}
2018-07-09 17:29:05,721 - checked_call returned (0, 'f20a5572')
2018-07-09 17:29:05,722 - HdfsResource['/tmp'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1485/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': '', 'default_fs': 'hdfs://ah-onefs-hdp3.west.isilon.com:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': None, 'user': 'hdfs', 'action': ['create_on_execute'], 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1485/hadoop/conf', 'type': 'directory', 'immutable_paths': [u'/apps/hive/warehouse', u'/mr-history/done', u'/app-logs', u'/tmp'], 'mode': 0777}

Command failed after 1 tries
{code}


In params_linux.py, dfs_type should come from clusterLevelParams instead of commandParams.
 


  was:
{code}
resource_management.core.exceptions.Fail: Resource parameter 'dfs_type' is not set.


stderr:
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/ONEFS/package/scripts/service_check.py", line 59, in <module>
    HdfsServiceCheck().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/ONEFS/package/scripts/service_check.py", line 43, in service_check
    mode=0777
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 119, in run_action
    provider = provider_class(resource)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 594, in __init__
    self.assert_parameter_is_set('dfs_type')
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 673, in assert_parameter_is_set
    raise Fail("Resource parameter '{0}' is not set.".format(parameter_name))
resource_management.core.exceptions.Fail: Resource parameter 'dfs_type' is not set.
stdout:
2018-07-09 17:29:05,706 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1485/hadoop/conf
2018-07-09 17:29:05,715 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1485/hadoop/conf
2018-07-09 17:29:05,717 - checked_call['hostid'] {}
2018-07-09 17:29:05,721 - checked_call returned (0, 'f20a5572')
2018-07-09 17:29:05,722 - HdfsResource['/tmp'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1485/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': '', 'default_fs': 'hdfs://ah-onefs-hdp3.west.isilon.com:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': None, 'user': 'hdfs', 'action': ['create_on_execute'], 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1485/hadoop/conf', 'type': 'directory', 'immutable_paths': [u'/apps/hive/warehouse', u'/mr-history/done', u'/app-logs', u'/tmp'], 'mode': 0777}

Command failed after 1 tries
{code}


> OneFS service check fails with 'dfs_type' is not set.
> -----------------------------------------------------
>
>                 Key: AMBARI-24272
>                 URL: https://issues.apache.org/jira/browse/AMBARI-24272
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.7.0
>            Reporter: Attila Magyar
>            Assignee: Attila Magyar
>            Priority: Major
>             Fix For: 2.7.1
>
>
> Following error comes when running a OneFS service check.
> {code}
> resource_management.core.exceptions.Fail: Resource parameter 'dfs_type' is not set.
> stderr:
> Traceback (most recent call last):
>   File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/ONEFS/package/scripts/service_check.py", line 59, in <module>
>     HdfsServiceCheck().execute()
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/ONEFS/package/scripts/service_check.py", line 43, in service_check
>     mode=0777
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
>     self.env.run()
>   File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
>     self.run_action(resource, action)
>   File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 119, in run_action
>     provider = provider_class(resource)
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 594, in __init__
>     self.assert_parameter_is_set('dfs_type')
>   File "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", line 673, in assert_parameter_is_set
>     raise Fail("Resource parameter '{0}' is not set.".format(parameter_name))
> resource_management.core.exceptions.Fail: Resource parameter 'dfs_type' is not set.
> stdout:
> 2018-07-09 17:29:05,706 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1485/hadoop/conf
> 2018-07-09 17:29:05,715 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1485/hadoop/conf
> 2018-07-09 17:29:05,717 - checked_call['hostid'] {}
> 2018-07-09 17:29:05,721 - checked_call returned (0, 'f20a5572')
> 2018-07-09 17:29:05,722 - HdfsResource['/tmp'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1485/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': '', 'default_fs': 'hdfs://ah-onefs-hdp3.west.isilon.com:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': None, 'user': 'hdfs', 'action': ['create_on_execute'], 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1485/hadoop/conf', 'type': 'directory', 'immutable_paths': [u'/apps/hive/warehouse', u'/mr-history/done', u'/app-logs', u'/tmp'], 'mode': 0777}
> Command failed after 1 tries
> {code}
> In params_linux.py, dfs_type should come from clusterLevelParams instead of commandParams.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)