You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Thomas Jungblut (JIRA)" <ji...@apache.org> on 2011/09/18 11:38:08 UTC

[jira] [Commented] (HAMA-439) Reorganize modules for YARN/MR-NextGen integration

    [ https://issues.apache.org/jira/browse/HAMA-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107402#comment-13107402 ] 

Thomas Jungblut commented on HAMA-439:
--------------------------------------

I'm +1 with that solution. 

An alternative would be to just add a sole module which is called HamaYARN which contains the new YARN code. 

So we keep our structure of:
-Core
-Examples
-Graph
And add:
-HamaYARN  (with dependency of Core)

Negative: In this way we can change the code of our BSPJob (just for example) since it is lying in the core package.
So I'll tend to your solution Vinod.

Any third opinion?

> Reorganize modules for YARN/MR-NextGen integration
> --------------------------------------------------
>
>                 Key: HAMA-439
>                 URL: https://issues.apache.org/jira/browse/HAMA-439
>             Project: Hama
>          Issue Type: Bug
>            Reporter: Vinod Kumar Vavilapalli
>
> I'd like to get started on HamaV2 to work with YARN/MR-nextgen.
> Here's what I think should be the module structure:
>  - *api*: Code from HamaV1 related to APIs that will be moved to this new module. This will mainly have the BSP APIs: _BSP_, _BSPPeerInterface_ and all the related records like _BSPMessage_, _BSPMessageBundle etc.
>  - *core*: Current/HamaV1 server code. Will have the current _BSPMaster_/_GroomServer_ infrastructure. We should probably rename it to {{classic-server}} or something similar.
>  - *server*: New Hama server implementation to work with YARN. Will have _BSPApplicationMaster_, _BSPTask_ and related code.
>  - *client*: Code from HamaV1 related to client that will be moved to this new module. This will mainly have the client-submission classes/interfaces like _BSPJob_, _BSPJobClient_, _JobStatus_ etc. It will be configurable to either run with the classic-server implementation or with YARN.
> There will not be any package changes but only code-moves across modules, so we will be backwards compatible.
> How does it look? Any thoughts/suggestions?

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira