You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hama.apache.org by qswm611 <qs...@163.com> on 2013/07/05 12:02:43 UTC

how to save memory

I  want to ask a question that why sorting message can save memory during Hama running?

Re: how to save memory

Posted by "Edward J. Yoon" <ed...@apache.org>.

Hi,

Google's Pregel is a vertex-centric programming model, and it allows
users to define communication between vertices. But, system creates
one processor per input split (partition), not vertex. Each split
contains multiple vertices.... Please don't ask "why?" :-)

Consequently, each processor need to group whole messages by vertex ID
after barrier synchronization. This message grouping requires huge
memory space.

By sorting the messages by vertex ID, we processes vertices
sequentially and avoids memory consumption.

On Fri, Jul 5, 2013 at 7:02 PM, qswm611 <qs...@163.com> wrote:
> I  want to ask a question that why sorting message can save memory during Hama running?



-- 
Best Regards, Edward J. Yoon
@eddieyoon