You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Jesus Alvarez (JIRA)" <ji...@apache.org> on 2018/05/06 03:34:00 UTC
[jira] [Updated] (AMBARI-23774) Knox configs for
webhdfs_service_urls do not get updated when WebHDFS HTTPS is enabled
[ https://issues.apache.org/jira/browse/AMBARI-23774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jesus Alvarez updated AMBARI-23774:
-----------------------------------
Description:
After enabling *dfs.http.policy* to *HTTPS_ONLY*, knox's topology will still assume WebHDFS is on HTTP.
Knox's Advanced Topology resolves the webHDFS URLs as:
{code:java}
{{ <service>}}
{{ <role>WEBHDFS</role>}}
{{ webhdfs_service_urls}}
{{ </service>}}
{code}
The issue is, in ambari's knox params_linux.py, the webhdfs_service_urls will always be prefaced with *"http"*
{code:java}
...
webhdfs_service_urls += buildUrlElement("http", host, namenode_port_map[host], "/webhdfs")
else:
{{ webhdfs_service_urls = buildUrlElement("http", namenode_host, namenode_http_port, "/webhdfs")}}
{code}
[https://github.com/apache/ambari/blob/5a982c29311336380cc27c8a752820f4ad55ffb4/ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py#L192]
was:
After enabling *dfs.http.policy* to *HTTPS_ONLY*, knox's topology will still assume WebHDFS is on HTTP.
Knox's Advanced Topology resolves the webHDFS URLs as:
{{ <service>}}
{{ <role>WEBHDFS</role>}}
{{ \{{webhdfs_service_urls}}}}
{{ </service>}}
The issue is, in ambari's knox params_linux.py, the webhdfs_service_urls will always be prefaced with *"http"*
{{webhdfs_service_urls += buildUrlElement("*http*", host, namenode_port_map[host], "/webhdfs")}}
{{else:}}
{{ webhdfs_service_urls = buildUrlElement("*http*", namenode_host, namenode_http_port, "/webhdfs")}}
https://github.com/apache/ambari/blob/5a982c29311336380cc27c8a752820f4ad55ffb4/ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py#L192
> Knox configs for webhdfs_service_urls do not get updated when WebHDFS HTTPS is enabled
> --------------------------------------------------------------------------------------
>
> Key: AMBARI-23774
> URL: https://issues.apache.org/jira/browse/AMBARI-23774
> Project: Ambari
> Issue Type: Bug
> Affects Versions: 2.7.0
> Environment: Issue present in HDP 2.6.4.
> Checked Trunk Ambari 2.7.0 code and same issue in params_linux.py
> Reporter: Jesus Alvarez
> Priority: Minor
>
> After enabling *dfs.http.policy* to *HTTPS_ONLY*, knox's topology will still assume WebHDFS is on HTTP.
>
> Knox's Advanced Topology resolves the webHDFS URLs as:
>
>
> {code:java}
> {{ <service>}}
> {{ <role>WEBHDFS</role>}}
> {{ webhdfs_service_urls}}
> {{ </service>}}
> {code}
>
> The issue is, in ambari's knox params_linux.py, the webhdfs_service_urls will always be prefaced with *"http"*
>
> {code:java}
> ...
> webhdfs_service_urls += buildUrlElement("http", host, namenode_port_map[host], "/webhdfs")
> else:
> {{ webhdfs_service_urls = buildUrlElement("http", namenode_host, namenode_http_port, "/webhdfs")}}
> {code}
>
> [https://github.com/apache/ambari/blob/5a982c29311336380cc27c8a752820f4ad55ffb4/ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py#L192]
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)