You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2013/05/17 19:59:16 UTC

[jira] [Created] (HADOOP-9570) Configuration.addResource() should only parse the new resource

Gopal V created HADOOP-9570:
-------------------------------

             Summary: Configuration.addResource() should only parse the new resource
                 Key: HADOOP-9570
                 URL: https://issues.apache.org/jira/browse/HADOOP-9570
             Project: Hadoop Common
          Issue Type: Bug
          Components: conf
         Environment: Ubuntu LXC
            Reporter: Gopal V
            Assignee: Gopal V
            Priority: Minor


Hadoop configuration parsing re-parses all configuration files when a new resource is added to the configuration object.

This is wasteful and runs through every deprecation check unnecessarily.

{code}
JobConf clone = new JobConf(job);
clone.addResource(...);
{code}

will reparse every file including core-site, hdfs-site etc.

Resource addition can be taken care of cleanly, if the addResourceObject() call applies the new resource, followed by applying the overlay, without re-parsing any of the older files already loaded into the hashtable.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira