You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Swapan Shridhar (JIRA)" <ji...@apache.org> on 2017/10/10 23:18:00 UTC
[jira] [Comment Edited] (AMBARI-22196) Refactor non-stack
cluster-env configs to cluster settings
[ https://issues.apache.org/jira/browse/AMBARI-22196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199544#comment-16199544 ]
Swapan Shridhar edited comment on AMBARI-22196 at 10/10/17 11:17 PM:
---------------------------------------------------------------------
*API testing*
*Get all cluster-settings :*
{code:title=http://<host>:<port>/api/v1/cluster_settings/}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/",
"items": [
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"property_name": "agent_mounts_ignore_list"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/alerts_repeat_tolerance",
"ClusterSettingsInfo": {
"property_name": "alerts_repeat_tolerance"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/enable_external_ranger",
"ClusterSettingsInfo": {
"property_name": "enable_external_ranger"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/fetch_nonlocal_groups",
"ClusterSettingsInfo": {
"property_name": "fetch_nonlocal_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/hide_yarn_memory_widget",
"ClusterSettingsInfo": {
"property_name": "hide_yarn_memory_widget"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_bad_mounts",
"ClusterSettingsInfo": {
"property_name": "ignore_bad_mounts"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_groupsusers_create",
"ClusterSettingsInfo": {
"property_name": "ignore_groupsusers_create"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/kerberos_domain",
"ClusterSettingsInfo": {
"property_name": "kerberos_domain"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_dirs_on_root",
"ClusterSettingsInfo": {
"property_name": "manage_dirs_on_root"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_hive_fsroot",
"ClusterSettingsInfo": {
"property_name": "manage_hive_fsroot"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/managed_hdfs_resource_property_names",
"ClusterSettingsInfo": {
"property_name": "managed_hdfs_resource_property_names"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_safemode_exit_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_safemode_exit_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/one_dir_per_partition",
"ClusterSettingsInfo": {
"property_name": "one_dir_per_partition"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/override_uid",
"ClusterSettingsInfo": {
"property_name": "override_uid"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_enabled",
"ClusterSettingsInfo": {
"property_name": "recovery_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_lifetime_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_lifetime_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_retry_interval",
"ClusterSettingsInfo": {
"property_name": "recovery_retry_interval"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_type",
"ClusterSettingsInfo": {
"property_name": "recovery_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_window_in_minutes",
"ClusterSettingsInfo": {
"property_name": "recovery_window_in_minutes"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_suse_rhel_template",
"ClusterSettingsInfo": {
"property_name": "repo_suse_rhel_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_ubuntu_template",
"ClusterSettingsInfo": {
"property_name": "repo_ubuntu_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/security_enabled",
"ClusterSettingsInfo": {
"property_name": "security_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/service_check_type",
"ClusterSettingsInfo": {
"property_name": "service_check_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser",
"ClusterSettingsInfo": {
"property_name": "smokeuser"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser_keytab",
"ClusterSettingsInfo": {
"property_name": "smokeuser_keytab"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_fast_jar_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_fast_jar_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_oozie_share_lib_to_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_oozie_share_lib_to_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_tarballs_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_tarballs_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_create_users_and_groups",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_create_users_and_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_setup_jce",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_setup_jce"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/user_group",
"ClusterSettingsInfo": {
"property_name": "user_group"
}
}
]
}
{code}
*Get specific cluster-setting*
{code:title=http://<host>:<port>/api/v1/cluster_settings/agent_mounts_ignore_list}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"final": "false",
"property_depends_on": [],
"property_description": "Comma separated list of the mounts which would be ignored by Ambari during property values suggestion by Stack Advisor",
"property_name": "agent_mounts_ignore_list",
"property_type": [],
"property_value": "",
"property_value_attributes": {
"visible": true,
"keyStore": false,
"empty_value_valid": true
},
"type": "cluster-settings.xml"
}
}
{code}
*Get specific non-existing cluster-setting*
{code:title=http://172.22.102.6:8080/api/v1/cluster_settings/non-existing-setting}
{
"status": 404,
"message": "The requested resource doesn't exist: non-existing-setting, in cluster-settings.xml"
}
{code}
was (Author: swapanshridhar):
*API testing*
**Get all cluster-settings :**
{code:title=http://<host>:<port>/api/v1/cluster_settings/}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/",
"items": [
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"property_name": "agent_mounts_ignore_list"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/alerts_repeat_tolerance",
"ClusterSettingsInfo": {
"property_name": "alerts_repeat_tolerance"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/enable_external_ranger",
"ClusterSettingsInfo": {
"property_name": "enable_external_ranger"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/fetch_nonlocal_groups",
"ClusterSettingsInfo": {
"property_name": "fetch_nonlocal_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/hide_yarn_memory_widget",
"ClusterSettingsInfo": {
"property_name": "hide_yarn_memory_widget"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_bad_mounts",
"ClusterSettingsInfo": {
"property_name": "ignore_bad_mounts"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_groupsusers_create",
"ClusterSettingsInfo": {
"property_name": "ignore_groupsusers_create"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/kerberos_domain",
"ClusterSettingsInfo": {
"property_name": "kerberos_domain"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_dirs_on_root",
"ClusterSettingsInfo": {
"property_name": "manage_dirs_on_root"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_hive_fsroot",
"ClusterSettingsInfo": {
"property_name": "manage_hive_fsroot"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/managed_hdfs_resource_property_names",
"ClusterSettingsInfo": {
"property_name": "managed_hdfs_resource_property_names"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_safemode_exit_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_safemode_exit_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/one_dir_per_partition",
"ClusterSettingsInfo": {
"property_name": "one_dir_per_partition"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/override_uid",
"ClusterSettingsInfo": {
"property_name": "override_uid"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_enabled",
"ClusterSettingsInfo": {
"property_name": "recovery_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_lifetime_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_lifetime_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_retry_interval",
"ClusterSettingsInfo": {
"property_name": "recovery_retry_interval"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_type",
"ClusterSettingsInfo": {
"property_name": "recovery_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_window_in_minutes",
"ClusterSettingsInfo": {
"property_name": "recovery_window_in_minutes"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_suse_rhel_template",
"ClusterSettingsInfo": {
"property_name": "repo_suse_rhel_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_ubuntu_template",
"ClusterSettingsInfo": {
"property_name": "repo_ubuntu_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/security_enabled",
"ClusterSettingsInfo": {
"property_name": "security_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/service_check_type",
"ClusterSettingsInfo": {
"property_name": "service_check_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser",
"ClusterSettingsInfo": {
"property_name": "smokeuser"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser_keytab",
"ClusterSettingsInfo": {
"property_name": "smokeuser_keytab"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_fast_jar_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_fast_jar_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_oozie_share_lib_to_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_oozie_share_lib_to_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_tarballs_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_tarballs_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_create_users_and_groups",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_create_users_and_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_setup_jce",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_setup_jce"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/user_group",
"ClusterSettingsInfo": {
"property_name": "user_group"
}
}
]
}
{code}
**Get specific cluster-setting**
{code:title=http://<host>:<port>/api/v1/cluster_settings/agent_mounts_ignore_list}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"final": "false",
"property_depends_on": [],
"property_description": "Comma separated list of the mounts which would be ignored by Ambari during property values suggestion by Stack Advisor",
"property_name": "agent_mounts_ignore_list",
"property_type": [],
"property_value": "",
"property_value_attributes": {
"visible": true,
"keyStore": false,
"empty_value_valid": true
},
"type": "cluster-settings.xml"
}
}
{code}
**Get specific non-existing cluster-setting**
{code:title=http://172.22.102.6:8080/api/v1/cluster_settings/non-existing-setting}
{
"status": 404,
"message": "The requested resource doesn't exist: non-existing-setting, in cluster-settings.xml"
}
{code}
> Refactor non-stack cluster-env configs to cluster settings
> ----------------------------------------------------------
>
> Key: AMBARI-22196
> URL: https://issues.apache.org/jira/browse/AMBARI-22196
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.5.2
> Reporter: Swapan Shridhar
> Assignee: Swapan Shridhar
> Priority: Critical
> Fix For: trunk, 3.0.0
>
>
> *Following to be done as part of this JIRA:*
> - Move all non-stack specific configs in *cluster-env.xml* to *cluster-settings.xml*
> - For example {{cluster-env/security_enabled}} is a cluster setting and shouldn't be associated with any stack/mpack.
> {code}
> <property>
> <name>security_enabled</name>
> <value>false</value>
> <description>Hadoop Security</description>
> <on-ambari-upgrade add="true"/>
> </property>
> {code}
> - Add new file as : {{/var/lib/ambari-server/resources/cluster-settings.xml}} which includes all the read only cluster specific settings.
> *New API Endpoint serving the cluster-settings* : api/v1/cluster_settings
> *Followup work :*
> - AMBARI-22197 takes care of removing cluster-env.xml and associated code and API once we have AMBARI-22198 completed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)