You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@giraph.apache.org by "Bruno Dumon (JIRA)" <ji...@apache.org> on 2015/02/24 15:30:05 UTC

[jira] [Created] (GIRAPH-995) Support use of counters in InputFormats

Bruno Dumon created GIRAPH-995:
----------------------------------

             Summary: Support use of counters in InputFormats
                 Key: GIRAPH-995
                 URL: https://issues.apache.org/jira/browse/GIRAPH-995
             Project: Giraph
          Issue Type: Improvement
            Reporter: Bruno Dumon


I'm working on a custom EdgeInputFormat where I'd like to use map reduce counters. I've noticed these don't work, because the TaskAttemptContext contains a DummyReporter.

This is because WrappedEdgeInputFormat.createEdgeReader() creates a different TaskAttemptContext to pass to the my reader, I assume because of threadsafety considerations.

I patched HadoopUtils.makeTaskAttemptContext() to support counters, but only in case HADOOP_NON_JOBCONTEXT_IS_INTERFACE, because only in that case it possible to pass on a StatusReporter to the TaskAttemptContextImpl.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)