[jira] [Created] (HDFS-14301) libhdfs should expose a method to get conf parameters from a hdfsFS instance

["Sahil Takiar (JIRA)" <ji...@apache.org>]

Sahil Takiar created HDFS-14301:
-----------------------------------

             Summary: libhdfs should expose a method to get conf parameters from a hdfsFS instance
                 Key: HDFS-14301
                 URL: https://issues.apache.org/jira/browse/HDFS-14301
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: hdfs-client, libhdfs, native
            Reporter: Sahil Takiar
            Assignee: Sahil Takiar


libhdfs currently exposes a few methods for getting the values of a configuration parameters: {{hdfsConfGetStr}} and {{hdfsConfGetInt}}. The issue is that in {{hdfs.c}} the implementation of these methods simply calls {{new Configuration()}} and fetches values using {{get}}. The issue is that calling {{new Configuration}} simply loads the current {{hdfs-site.xml}}, {{core-site.xml}}, etc. which does not take into account the scenario where the default configuration has been modified for specific filesystem instances. For example, the {{hdfsBuilder}} exposes a {{hdfsBuilderConfSetStr}} method that allows setting non-default configuration parameters.

This could lead to issues such as:
{code:java}
struct hdfsBuilder *bld;
bld = hdfsNewBuilder();
hdfsBuilderSetForceNewInstance(bld);
hdfsBuilderConfSetStr(bld, "hello", "world");
hdfs = hdfsBuilderConnect(bld);

char* value = NULL;
hdfsConfGetStr("hello", &value);
// Value is NULL!
{code}
This JIRA proposes adding a new set of methods to libhdfs that take in a {{hdfsFS}} object and get the value of the key from the {{hdfsFS}} object rather than using {{new Configuration}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org