You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Christopher Aycock (JIRA)" <ji...@apache.org> on 2016/10/27 14:50:58 UTC
[jira] [Created] (ARROW-350) Add Kerberos support to HDFS shim
Christopher Aycock created ARROW-350:
----------------------------------------
Summary: Add Kerberos support to HDFS shim
Key: ARROW-350
URL: https://issues.apache.org/jira/browse/ARROW-350
Project: Apache Arrow
Issue Type: Improvement
Components: C++, Python
Reporter: Christopher Aycock
Assignee: Christopher Aycock
Speaking with [~wesmckinn], it would be really helpful to have Kerberos support in our HDFS logic. This should be straightforward; I would just need to switch to {{hdfsBuilderConnect()}} in the shim.
On a side note, is there a reason we aren't using Pivotal's libhdfs3? It uses RPCs natively rather than JNI.
https://github.com/Pivotal-Data-Attic/pivotalrd-libhdfs3
Dask has Python wrappers for this.
https://github.com/dask/hdfs3
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)