[jira] [Assigned] (HADOOP-9570) Configuration.addResource() should only parse the new resource

["Daryn Sharp (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp reassigned HADOOP-9570:
-----------------------------------

    Assignee: Daryn Sharp  (was: Gopal V)

> Configuration.addResource() should only parse the new resource
> --------------------------------------------------------------
>
>                 Key: HADOOP-9570
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9570
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: conf
>         Environment: Ubuntu LXC
>            Reporter: Gopal V
>            Assignee: Daryn Sharp
>            Priority: Minor
>         Attachments: HADOOP-9570.branch-2.8.patch, HADOOP-9750.patch
>
>
> Hadoop configuration parsing re-parses all configuration files when a new resource is added to the configuration object.
> This is wasteful and runs through every deprecation check unnecessarily.
> {code}
> JobConf clone = new JobConf(job);
> clone.addResource(...);
> {code}
> will reparse every file including core-site, hdfs-site etc.
> Resource addition can be taken care of cleanly, if the addResourceObject() call applies the new resource, followed by applying the overlay, without re-parsing any of the older files already loaded into the hashtable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org