You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Swapnil Daingade (JIRA)" <ji...@apache.org> on 2014/09/03 02:22:54 UTC

[jira] [Updated] (HADOOP-11044) FileSystem counters can overflow for large number of readOps, largeReadOps, writeOps

     [ https://issues.apache.org/jira/browse/HADOOP-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Swapnil Daingade updated HADOOP-11044:
--------------------------------------
    Attachment: 11044.patch

Based on the discussion on the JIRA decided to go with this approach suggested by Gary.
2) Add new methods to return long types and switch the internal types to long and simply cast the internal longs to ints when returned via the int methods. Mark the int methods deprecated, then remove them after next release. This puts overflow problem onto the int type methods. 

> FileSystem counters can overflow for large number of readOps, largeReadOps, writeOps
> ------------------------------------------------------------------------------------
>
>                 Key: HADOOP-11044
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11044
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 2.5.0, 2.4.1
>            Reporter: Swapnil Daingade
>            Priority: Minor
>         Attachments: 11044.patch
>
>
> The org.apache.hadoop.fs.FileSystem.Statistics.StatisticsData class defines readOps, largeReadOps, writeOps as int. Also the The org.apache.hadoop.fs.FileSystem.Statistics class has methods like getReadOps(), getLargeReadOps() and getWriteOps() that return int. These int values can overflow if the exceed 2^31-1 showing negative values. It would be nice if these can be changed to long.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)