You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2011/07/13 12:47:59 UTC
[jira] [Commented] (MAPREDUCE-2365) Add counters for
FileInputFormat (BYTES_READ) and FileOutputFormat (BYTES_WRITTEN)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13064475#comment-13064475 ]
Hadoop QA commented on MAPREDUCE-2365:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12486278/MR2365.patch
against trunk revision 1145889.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these core unit tests:
org.apache.hadoop.cli.TestMRCLI
org.apache.hadoop.fs.TestFileSystem
-1 contrib tests. The patch failed contrib unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/463//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/463//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/463//console
This message is automatically generated.
> Add counters for FileInputFormat (BYTES_READ) and FileOutputFormat (BYTES_WRITTEN)
> ----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2365
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2365
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Owen O'Malley
> Assignee: Siddharth Seth
> Fix For: 0.20.203.0, 0.23.0
>
> Attachments: MR2365.patch
>
>
> MAP_INPUT_BYTES and MAP_OUTPUT_BYTES will be computed using the difference between FileSystem
> counters before and after each next(K,V) and collect/write op.
> In case compression is being used, these counters will represent the compressed data sizes. The uncompressed size will
> not be available.
> This is not a direct back-port of 5710. (Counters will be computed in MapTask instead of in individual RecordReaders).
> 0.20.100 ->
> New API -> MAP_INPUT_BYTES will be computed using this method
> Old API -> MAP_INPUT_BYTES will remain unchanged.
> 0.23 ->
> New API -> MAP_INPUT_BYTES will be computed using this method
> Old API -> MAP_INPUT_BYTES likely to use this method
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira