[jira] [Created] (PIG-5261) Support for macro based property definitions in Pig

["Sridhar Sailappan (JIRA)" <ji...@apache.org>]

Sridhar Sailappan created PIG-5261:
--------------------------------------

             Summary: Support for macro based property definitions in Pig
                 Key: PIG-5261
                 URL: https://issues.apache.org/jira/browse/PIG-5261
             Project: Pig
          Issue Type: Improvement
          Components: parser
    Affects Versions: 0.16.0
            Reporter: Sridhar Sailappan


The attached patch provides support for property configurations with macro based definitions (relying on variable expansion of Hadoop Configuration).
 
e.g., Consider the following definition of properties for HDFS.
1) The property "fs.defaultFS" is defined to have value "${fs.defaultFS.dev}"
2) The custom property "fs.defaultFS.dev" is defined to have value "hdfs://dev-sandbox.domain.com:8020"
 
Now, when referencing the property "fs.defaultFS", the value should be resolved to "hdfs://dev-sandbox.domain.com:8020".
 
This is typical variable expansion that is expected in Hadoop Configuration. Refer: https://hadoop.apache.org/docs/r2.6.0/api/org/apache/hadoop/conf/Configuration.html
This functionality of variable expansion is not available with Pig. The attached patch (on branch-0.16) addresses this need.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)