You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2016/10/29 01:14:58 UTC
[jira] [Resolved] (ARROW-350) Add Kerberos support to HDFS shim
[ https://issues.apache.org/jira/browse/ARROW-350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wes McKinney resolved ARROW-350.
--------------------------------
Resolution: Fixed
Issue resolved by pull request 185
[https://github.com/apache/arrow/pull/185]
> Add Kerberos support to HDFS shim
> ---------------------------------
>
> Key: ARROW-350
> URL: https://issues.apache.org/jira/browse/ARROW-350
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Python
> Reporter: Christopher Aycock
> Assignee: Christopher Aycock
>
> Speaking with [~wesmckinn], it would be really helpful to have Kerberos support in our HDFS logic. This should be straightforward; I would just need to switch to {{hdfsBuilderConnect()}} in the shim.
> On a side note, is there a reason we aren't using Pivotal's libhdfs3? It uses RPCs natively rather than JNI.
> https://github.com/Pivotal-Data-Attic/pivotalrd-libhdfs3
> Dask has Python wrappers for this.
> https://github.com/dask/hdfs3
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)