[jira] [Resolved] (ARROW-2661) [Python/C++] Allow passing HDFS Config values via map/dict instead of needing an hdfs-site.xml file

["Uwe L. Korn (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Uwe L. Korn resolved ARROW-2661.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 0.10.0

Issue resolved by pull request 2097
[https://github.com/apache/arrow/pull/2097]

> [Python/C++] Allow passing HDFS Config values via map/dict instead of needing an hdfs-site.xml file
> ---------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-2661
>                 URL: https://issues.apache.org/jira/browse/ARROW-2661
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++, Python
>    Affects Versions: 0.10.0
>            Reporter: Matt Topol
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 0.10.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> Currently in order to pass HDFS configurations of values down to the underlying libhdfs driver you have to either set HADOOP_HOME (using libhdfs) or LIBHDFS3_CONF (for libhdfs3) to point to a location of an hdfs-site.xml file to use. However the API provided by them allows for calling hdfsBuilderConfSetStr to set arbitrary configuration values on the hdfsBuilder object. This would allow for consumers to programmatically set any arbitrary configurations they want including allowing for encryption and other complex hdfs configurations without needing to provide an hdfs-site.xml file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)