You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Laurent Goujon (JIRA)" <ji...@apache.org> on 2015/09/21 22:51:04 UTC

[jira] [Created] (MAPREDUCE-6486) File{Input|Output}Format counters not updated when using viewfs

Laurent Goujon created MAPREDUCE-6486:
-----------------------------------------

             Summary: File{Input|Output}Format counters not updated when using viewfs
                 Key: MAPREDUCE-6486
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6486
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2, task
            Reporter: Laurent Goujon


MapReduce tasks rely on filesystem stats to update FileInputFormatCounter and FileOutputFormatCounter bytes counters.

But if the filesystem is viewfs, stats are not updated and counters are zero. However the resolved filesystem for the input and output paths have their stats updated, and should be used by the framework (which could be done by resolving the path first).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)