You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Eli Reisman (JIRA)" <ji...@apache.org> on 2013/01/06 21:12:12 UTC
[jira] [Commented] (GIRAPH-469) Cleanup GraphMapper
[ https://issues.apache.org/jira/browse/GIRAPH-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13545477#comment-13545477 ]
Eli Reisman commented on GIRAPH-469:
------------------------------------
All of these refactors seem great. I love the idea of getting the Giraph-specific business logic in GraphMapper into an abstract base and letting mapper-specific code in GraphMapper just inherit this functionality. This will make it easier to plug in a "pure YARN" implementation next to GraphMapper later that does not inherit Mapper<Object,Object,Object,Object> and so on.
As for getting rid of the mapper-specific stuff in GraphMapper altogether, I don't think we can do that while still retaining compatibility with MRv1 Hadoop clusters.
> Cleanup GraphMapper
> -------------------
>
> Key: GIRAPH-469
> URL: https://issues.apache.org/jira/browse/GIRAPH-469
> Project: Giraph
> Issue Type: Improvement
> Reporter: Nitay Joffe
> Assignee: Nitay Joffe
>
> I don't see why we even call a map() method seeing as we are overriding run(). We are clearly not particularly "mapreduce-y" so we should make it our entry point more clear than a map(). Also I think we should have something like a WorkerThread similar to MasterThread and clean up all of this to just creare whichever threads the node is assigned roles of.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira