You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2009/04/03 20:13:13 UTC

[jira] Updated: (HADOOP-5585) FileSystem statistic counters are too high when JVM reuse is enabled.

     [ https://issues.apache.org/jira/browse/HADOOP-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-5585:
----------------------------------

    Attachment: h5585.patch

This patch fixes a javadoc warning and the broken javadoc link that Chris commented on. It also extends the testcase from HADOOP-5437 to detect the file system statistics not being cleared between tasks.

> FileSystem statistic counters are too high when JVM reuse is enabled.
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-5585
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5585
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>            Priority: Blocker
>             Fix For: 0.20.0
>
>         Attachments: h5585.patch, h5585.patch
>
>
> When JVM reuse is enabled, the FileSystem.Statistics are not cleared between tasks. That means that the second task gets credit for its own reads and writes as well as the first. The third gets credit for all 3 tasks reads and writes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.