You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2008/03/11 23:16:46 UTC
[jira] Created: (HADOOP-3001) FileSystems should track how many
bytes are read and written
FileSystems should track how many bytes are read and written
------------------------------------------------------------
Key: HADOOP-3001
URL: https://issues.apache.org/jira/browse/HADOOP-3001
Project: Hadoop Core
Issue Type: New Feature
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Fix For: 0.17.0
It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Status: Patch Available (was: Open)
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Status: Open (was: Patch Available)
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Attachment: 3001.patch
This patch extends the FileSystem to get a statistics object that it can use for update the number of bytes read and written by the client. Map/Reduce gets task counters that count the number of bytes read and written by HDFS, LocalRaw, S3, and KFS.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.17.0
>
> Attachments: 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Attachment: 3001-4.patch
Removed a couple of unrelated changes that slipped in.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585374#action_12585374 ]
Hadoop QA commented on HADOOP-3001:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12379335/3001-6.patch
against trunk revision 643282.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit -1. The applied patch generated 200 release audit warnings (more than the trunk's current 199 warnings).
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/artifact/trunk/build/test/checkstyle-errors.html
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/artifact/trunk/current/releaseAuditDiffWarnings.txt
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2149/console
This message is automatically generated.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584957#action_12584957 ]
Hadoop QA commented on HADOOP-3001:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12379207/3001-4.patch
against trunk revision 643282.
@author +1. The patch does not contain any @author tags.
tests included -1. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2130/console
This message is automatically generated.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Status: Open (was: Patch Available)
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed] (was: [Reviewed, Incompatible change])
Status: Resolved (was: Patch Available)
I just committed this.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584985#action_12584985 ]
Chris Douglas commented on HADOOP-3001:
---------------------------------------
Only two minor nits, but neither is pressing:
* It looks like you picked up a whitespace change to SequenceFileRecordReader
* The FileSystem.Statistics objects can be {{final}}
+1
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Release Note: Adds new framework map/reduce counters that track the number of bytes read and written to HDFS, local, KFS, and S3 file systems.
Status: Patch Available (was: Open)
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3001:
----------------------------------
Hadoop Flags: [Incompatible change, Reviewed]
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581032#action_12581032 ]
Hadoop QA commented on HADOOP-3001:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12378354/3001.patch
against trunk revision 619744.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 51 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac -1. The applied patch generated 579 javac compiler warnings (more than the trunk's current 575 warnings).
release audit -1. The applied patch generated 198 release audit warnings (more than the trunk's current 197 warnings).
findbugs -1. The patch appears to introduce 1 new Findbugs warnings.
core tests -1. The patch failed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/artifact/trunk/build/test/checkstyle-errors.html
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/artifact/trunk/current/releaseAuditDiffWarnings.txt
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2020/console
This message is automatically generated.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.17.0
>
> Attachments: 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Attachment: 3001-2.patch
I updated to trunk.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Status: Open (was: Patch Available)
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Hadoop Flags: [Incompatible change, Reviewed] (was: [Reviewed, Incompatible change])
Status: Patch Available (was: Open)
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Attachment: 3001-5.patch
Added test case and removed spacing diff.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Status: Patch Available (was: Open)
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.17.0
>
> Attachments: 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-3001:
--------------------------------
Component/s: fs
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Components: fs
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585986#action_12585986 ]
Hudson commented on HADOOP-3001:
--------------------------------
Integrated in Hadoop-trunk #451 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/451/])
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3001) FileSystems should track how many
bytes are read and written
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3001:
----------------------------------
Attachment: 3001-6.patch
added final as chris suggested.
> FileSystems should track how many bytes are read and written
> ------------------------------------------------------------
>
> Key: HADOOP-3001
> URL: https://issues.apache.org/jira/browse/HADOOP-3001
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3001-2.patch, 3001-4.patch, 3001-5.patch, 3001-6.patch, 3001.patch
>
>
> It would be nice if the file systems could track the number of bytes read and written for each class of FileSystem. Map/Reduce could then report these numbers back as counters to provide information about how much data is read and written.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.