You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2010/01/12 23:27:54 UTC

[jira] Created: (HADOOP-6488) Measure memory usage of Configuration object resource tracking

Measure memory usage of Configuration object resource tracking
--------------------------------------------------------------

                 Key: HADOOP-6488
                 URL: https://issues.apache.org/jira/browse/HADOOP-6488
             Project: Hadoop Common
          Issue Type: Task
          Components: conf
    Affects Versions: 0.22.0
            Reporter: Todd Lipcon


HADOOP-6408 modified Configuration to track the resource from which each setting was set. There's some concern that this may increase the JT memory footprint too much. This JIRA is to measure and record the memory usage for Configuration before and after HADOOP-6408.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-6488) Measure memory usage of Configuration object resource tracking

Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840244#action_12840244 ] 

Steve Loughran commented on HADOOP-6488:
----------------------------------------

Would be nice  if the unknown load locations were just silent rather than  <!--Loaded from Unknown-->, as it doesn't help the readability of the generated files much. This could reduce the footprint slightly too.

> Measure memory usage of Configuration object resource tracking
> --------------------------------------------------------------
>
>                 Key: HADOOP-6488
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6488
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: conf
>    Affects Versions: 0.22.0
>            Reporter: Todd Lipcon
>
> HADOOP-6408 modified Configuration to track the resource from which each setting was set. There's some concern that this may increase the JT memory footprint too much. This JIRA is to measure and record the memory usage for Configuration before and after HADOOP-6408.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-6488) Measure memory usage of Configuration object resource tracking

Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840247#action_12840247 ] 

Steve Loughran commented on HADOOP-6488:
----------------------------------------

and if the items were sorted, reading configuration options easier

> Measure memory usage of Configuration object resource tracking
> --------------------------------------------------------------
>
>                 Key: HADOOP-6488
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6488
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: conf
>    Affects Versions: 0.22.0
>            Reporter: Todd Lipcon
>
> HADOOP-6408 modified Configuration to track the resource from which each setting was set. There's some concern that this may increase the JT memory footprint too much. This JIRA is to measure and record the memory usage for Configuration before and after HADOOP-6408.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-6488) Measure memory usage of Configuration object resource tracking

Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12799563#action_12799563 ] 

Hemanth Yamijala commented on HADOOP-6488:
------------------------------------------

Todd comments in HADOOP-6408 seem to make sense to me and it appears not to be a concern. We are just being very diligent here.

> Measure memory usage of Configuration object resource tracking
> --------------------------------------------------------------
>
>                 Key: HADOOP-6488
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6488
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: conf
>    Affects Versions: 0.22.0
>            Reporter: Todd Lipcon
>
> HADOOP-6408 modified Configuration to track the resource from which each setting was set. There's some concern that this may increase the JT memory footprint too much. This JIRA is to measure and record the memory usage for Configuration before and after HADOOP-6408.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-6488) Measure memory usage of Configuration object resource tracking

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840293#action_12840293 ] 

Todd Lipcon commented on HADOOP-6488:
-------------------------------------

Steve, can you open a new JIRA for those suggestions? I'll be happy to review.

> Measure memory usage of Configuration object resource tracking
> --------------------------------------------------------------
>
>                 Key: HADOOP-6488
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6488
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: conf
>    Affects Versions: 0.22.0
>            Reporter: Todd Lipcon
>
> HADOOP-6408 modified Configuration to track the resource from which each setting was set. There's some concern that this may increase the JT memory footprint too much. This JIRA is to measure and record the memory usage for Configuration before and after HADOOP-6408.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.