You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Filipe Manana (JIRA)" <ji...@apache.org> on 2010/08/19 13:38:15 UTC
[jira] Commented: (HAMA-282) Add superstep counter
[ https://issues.apache.org/jira/browse/HAMA-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900255#action_12900255 ]
Filipe Manana commented on HAMA-282:
------------------------------------
Hello,
I would like to start contributing to Hama.
Is this a good feature to start with?
cheers
> Add superstep counter
> ---------------------
>
> Key: HAMA-282
> URL: https://issues.apache.org/jira/browse/HAMA-282
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Commented: (HAMA-282) Add superstep counter
Posted by Filipe David Manana <fd...@apache.org>.
On Fri, Aug 20, 2010 at 8:04 AM, Edward J. Yoon <ed...@apache.org>wrote:
> Dear fdmanana, Thanks for your interest.
>
You're welcome.
It's been a while now that I got interested in Hama. However I haven't yet
looked carefully to its code.
>
> > Is this a good feature to start with?
>
> Yes, I think so. BTW, you need to wait few days for this. The reason
> is that the number of supersteps should be counted by the master
> server but I'm heavily touching code of master/slave server for
> HAMA-276 now. Moreover, there is a lot of hard coded path and TODO
> things.
>
> However, It is OK to contribute only part of superstep counting.
> Please see the part of BSPPeer.enterbarrier() method and heartbeat
> messages between the master/slave servers.
> ----
>
> And, let me explain more detail about the current status of HAMA TRUNK ....
>
> When user submits a BSP job, the mechanism is almost same with the M/R
> framework. The basic flow is as below:
>
> 1) User submits a BSP job to Hama BSP cluster.
> 2) Then, the BSPMaster will manage jobs that user have submitted to
> the BSP cluster.
> 2-1) Adding job to the scheduler.
> 2-2) Assign Task to slaves.
> 3) the GroomServer (slave) copies job/jar file to local and launches
> tasks on its host.
>
> And, Hadoop RPC will be used for the BSP send, get and sync
> communication among BSPPeer.
>
> Now the no. 3) is not implemented yet.
>
Thanks for explanation :)
I'm finishing reading the BSP paper from Leslie.
I'll then jump into the code.
cheers
>
> Thanks.
>
> On Thu, Aug 19, 2010 at 8:38 PM, Filipe Manana (JIRA) <ji...@apache.org>
> wrote:
> >
> > [
> https://issues.apache.org/jira/browse/HAMA-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900255#action_12900255]
> >
> > Filipe Manana commented on HAMA-282:
> > ------------------------------------
> >
> > Hello,
> >
> > I would like to start contributing to Hama.
> > Is this a good feature to start with?
> >
> > cheers
> >
> >> Add superstep counter
> >> ---------------------
> >>
> >> Key: HAMA-282
> >> URL: https://issues.apache.org/jira/browse/HAMA-282
> >> Project: Hama
> >> Issue Type: Sub-task
> >> Reporter: Edward J. Yoon
> >>
> >
> >
> > --
> > This message is automatically generated by JIRA.
> > -
> > You can reply to this email to add a comment to the issue online.
> >
> >
>
>
>
> --
> Best Regards, Edward J. Yoon
> edwardyoon@apache.org
> http://blog.udanax.org
>
--
Filipe David Manana,
fdmanana@gmail.com, fdmanana@apache.org
"Reasonable men adapt themselves to the world.
Unreasonable men adapt the world to themselves.
That's why all progress depends on unreasonable men."
Re: [jira] Commented: (HAMA-282) Add superstep counter
Posted by "Edward J. Yoon" <ed...@apache.org>.
Dear fdmanana, Thanks for your interest.
> Is this a good feature to start with?
Yes, I think so. BTW, you need to wait few days for this. The reason
is that the number of supersteps should be counted by the master
server but I'm heavily touching code of master/slave server for
HAMA-276 now. Moreover, there is a lot of hard coded path and TODO
things.
However, It is OK to contribute only part of superstep counting.
Please see the part of BSPPeer.enterbarrier() method and heartbeat
messages between the master/slave servers.
----
And, let me explain more detail about the current status of HAMA TRUNK ....
When user submits a BSP job, the mechanism is almost same with the M/R
framework. The basic flow is as below:
1) User submits a BSP job to Hama BSP cluster.
2) Then, the BSPMaster will manage jobs that user have submitted to
the BSP cluster.
2-1) Adding job to the scheduler.
2-2) Assign Task to slaves.
3) the GroomServer (slave) copies job/jar file to local and launches
tasks on its host.
And, Hadoop RPC will be used for the BSP send, get and sync
communication among BSPPeer.
Now the no. 3) is not implemented yet.
Thanks.
On Thu, Aug 19, 2010 at 8:38 PM, Filipe Manana (JIRA) <ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/HAMA-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900255#action_12900255 ]
>
> Filipe Manana commented on HAMA-282:
> ------------------------------------
>
> Hello,
>
> I would like to start contributing to Hama.
> Is this a good feature to start with?
>
> cheers
>
>> Add superstep counter
>> ---------------------
>>
>> Key: HAMA-282
>> URL: https://issues.apache.org/jira/browse/HAMA-282
>> Project: Hama
>> Issue Type: Sub-task
>> Reporter: Edward J. Yoon
>>
>
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>
--
Best Regards, Edward J. Yoon
edwardyoon@apache.org
http://blog.udanax.org