[jira] [Commented] (KNOX-1000) Hadoop Java Filesystem API support through Knox

["Rob Vesse (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KNOX-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138168#comment-16138168 ] 

Rob Vesse commented on KNOX-1000:
---------------------------------

Knox is designed as a HTTP proxy whereas the lower level filesystem API is RPC-based. Are you actually asking for support for Kerberos authentication to a Kerberized HDFS cluster via Web HDFS?

> Hadoop Java Filesystem API support through Knox
> -----------------------------------------------
>
>                 Key: KNOX-1000
>                 URL: https://issues.apache.org/jira/browse/KNOX-1000
>             Project: Apache Knox
>          Issue Type: Bug
>    Affects Versions: 0.9.1, 0.11.0, 0.12.0, 0.13.0
>            Reporter: Jeffrey E  Rodriguez
>             Fix For: 0.14.0
>
>
> This Jira is to re-open a discussion on this issue from:
> https://mail-archives.apache.org/mod_mbox/knox-user/201511.mbox/%3CCACRbFyiy77fc5EHQ5c5oOQM=MZ_UPmEVsoH7ERmDrEuoOvNbjg@mail.gmail.com%3E
> 1. Hadoop FileSystem api needs to provide a "proxy" mechanism where we can add the user credentials. (same issue as any library or API try to access Knox).  We may need to open a Hadoop Jira for this.
> 2. Knox Kerberos support (http client access to webhdfs) doesn't support "file access token". (whatever this means).
> 3. Use of Transfer-Encoding header in Knox. 
> Ideally we should be able to use Knox URL through the Hadoop FileSystem api so we  call from a Jupyter or Zeppelin notebook. Also it would help to programtically use the Hadoop Filesystem api through Knox.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)