Pregel clone projects

["Edward J. Yoon" <ed...@apache.org>]

Hi,

Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
jpregel, .., etc. (although they are all the early stage)

I still believe that the core is a BSP computing engine but, "Pregel
clone" is a good marketing strategy.

Should we plan the Pregel-like graph APIs for 0.4-incubating?

Thanks.
-- 
Best Regards, Edward J. Yoon
@eddieyoon

Re: Pregel clone projects

["Edward J. Yoon" <ed...@apache.org>]

> I think having a Pregel-like API would be good but I'd like more to add such
> an API rather than replacing the current BSP-oriented one.

+1

On Wed, Jun 29, 2011 at 5:33 PM, Tommaso Teofili
<to...@gmail.com> wrote:
> I think having a Pregel-like API would be good but I'd like more to add such
> an API rather than replacing the current BSP-oriented one.
>
> 2011/6/29 Eric Charles <er...@u-mangate.com>
>
>> Yes, from Hadoop Summit Page, I read: "Similar to Pregel, Giraph follows
>> the bulk-synchronous parallel model relative to graphs where vertices can
>> send messages to other vertices during a given superstep."
>>
>> If you don't explicitly mention Pregel in Hama headline, there are less
>> change you will be heard.
>>
>
> I agree, it may be worth to have something about it on the wiki.
> Regards,
> Tommaso
>
>
>>
>> Thx
>>
>>
>> On 29/06/11 08:12, Thomas Jungblut wrote:
>>
>>> Hey,
>>>
>>> just have seen JPregel. Don't think they going to get far, since this is
>>> just a 1:1 java-portation of the pregel paper.
>>> Giraphs presentation is today, are there any live feeds of the hadoop
>>> summit?:)
>>>
>>> I'm +1 for pregel-like API because the "thinking like a vertex" is always
>>> more intuitive than BSP itself. If we can manage to add, let's call it TLV
>>> (Thinking Like a Vertex) AND to keep the BSP engine as itself, Hama would
>>> be
>>> very powerful.
>>>
>>> Greetings
>>>
>>>
>>> 2011/6/29 Edward J. Yoon<ed...@apache.org>
>>>
>>>  Hi,
>>>>
>>>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>>>> jpregel, .., etc. (although they are all the early stage)
>>>>
>>>> I still believe that the core is a BSP computing engine but, "Pregel
>>>> clone" is a good marketing strategy.
>>>>
>>>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>>>>
>>>> Thanks.
>>>> --
>>>> Best Regards, Edward J. Yoon
>>>> @eddieyoon
>>>>
>>>>
>>>
>>>
>>>
>> --
>> Eric
>>
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Re: Pregel clone projects

[Tommaso Teofili <to...@gmail.com>]

I think having a Pregel-like API would be good but I'd like more to add such
an API rather than replacing the current BSP-oriented one.

2011/6/29 Eric Charles <er...@u-mangate.com>

> Yes, from Hadoop Summit Page, I read: "Similar to Pregel, Giraph follows
> the bulk-synchronous parallel model relative to graphs where vertices can
> send messages to other vertices during a given superstep."
>
> If you don't explicitly mention Pregel in Hama headline, there are less
> change you will be heard.
>

I agree, it may be worth to have something about it on the wiki.
Regards,
Tommaso


>
> Thx
>
>
> On 29/06/11 08:12, Thomas Jungblut wrote:
>
>> Hey,
>>
>> just have seen JPregel. Don't think they going to get far, since this is
>> just a 1:1 java-portation of the pregel paper.
>> Giraphs presentation is today, are there any live feeds of the hadoop
>> summit?:)
>>
>> I'm +1 for pregel-like API because the "thinking like a vertex" is always
>> more intuitive than BSP itself. If we can manage to add, let's call it TLV
>> (Thinking Like a Vertex) AND to keep the BSP engine as itself, Hama would
>> be
>> very powerful.
>>
>> Greetings
>>
>>
>> 2011/6/29 Edward J. Yoon<ed...@apache.org>
>>
>>  Hi,
>>>
>>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>>> jpregel, .., etc. (although they are all the early stage)
>>>
>>> I still believe that the core is a BSP computing engine but, "Pregel
>>> clone" is a good marketing strategy.
>>>
>>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>>>
>>> Thanks.
>>> --
>>> Best Regards, Edward J. Yoon
>>> @eddieyoon
>>>
>>>
>>
>>
>>
> --
> Eric
>

Re: Pregel clone projects

[Eric Charles <er...@u-mangate.com>]

Yes, from Hadoop Summit Page, I read: "Similar to Pregel, Giraph follows 
the bulk-synchronous parallel model relative to graphs where vertices 
can send messages to other vertices during a given superstep."

If you don't explicitly mention Pregel in Hama headline, there are less 
change you will be heard.

Thx

On 29/06/11 08:12, Thomas Jungblut wrote:
> Hey,
>
> just have seen JPregel. Don't think they going to get far, since this is
> just a 1:1 java-portation of the pregel paper.
> Giraphs presentation is today, are there any live feeds of the hadoop
> summit?:)
>
> I'm +1 for pregel-like API because the "thinking like a vertex" is always
> more intuitive than BSP itself. If we can manage to add, let's call it TLV
> (Thinking Like a Vertex) AND to keep the BSP engine as itself, Hama would be
> very powerful.
>
> Greetings
>
>
> 2011/6/29 Edward J. Yoon<ed...@apache.org>
>
>> Hi,
>>
>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>> jpregel, .., etc. (although they are all the early stage)
>>
>> I still believe that the core is a BSP computing engine but, "Pregel
>> clone" is a good marketing strategy.
>>
>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>>
>> Thanks.
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
>
>
>

-- 
Eric

Re: Pregel clone projects

[Thomas Jungblut <th...@googlemail.com>]

Hey,

just have seen JPregel. Don't think they going to get far, since this is
just a 1:1 java-portation of the pregel paper.
Giraphs presentation is today, are there any live feeds of the hadoop
summit?:)

I'm +1 for pregel-like API because the "thinking like a vertex" is always
more intuitive than BSP itself. If we can manage to add, let's call it TLV
(Thinking Like a Vertex) AND to keep the BSP engine as itself, Hama would be
very powerful.

Greetings


2011/6/29 Edward J. Yoon <ed...@apache.org>

> Hi,
>
> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
> jpregel, .., etc. (although they are all the early stage)
>
> I still believe that the core is a BSP computing engine but, "Pregel
> clone" is a good marketing strategy.
>
> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>
> Thanks.
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>



-- 
Thomas Jungblut
Berlin

mobile: 0170-3081070

business: thomas.jungblut@testberichte.de
private: thomas.jungblut@gmail.com

Re: Pregel clone projects

["Edward J. Yoon" <ed...@apache.org>]

Thanks!

On Fri, Jul 1, 2011 at 9:13 AM, Joseph Boyd
<jo...@cbsinteractive.com> wrote:
> This page:
>  https://github.com/raveldata/goldenorb/wiki/Using-GoldenOrb
>
> Gives a good overview of what it's like to write code against goldenorb.
>
>
> ...joe
>
>
> On Thu, Jun 30, 2011 at 3:23 PM, Edward J. Yoon <ed...@apache.org> wrote:
>> +1
>>
>> And, just FYI, http://blog.udanax.org/2011/06/rough-analysis-of-googles-pregel-clone.html
>>
>> On Fri, Jul 1, 2011 at 4:28 AM, Thomas Jungblut
>> <th...@googlemail.com> wrote:
>>> Very nice. I'm opening an issue scheduled for 0.4.0.
>>>
>>> 2011/6/30 Miklós Erdélyi <er...@gmail.com>
>>>
>>>> Yes, sure!
>>>> I still need to clean up bits of the code before I can upload it.
>>>>
>>>> On Thu, Jun 30, 2011 at 12:38 AM, Edward J. Yoon <ed...@apache.org>
>>>> wrote:
>>>> > Cool.
>>>> >
>>>> > Do you have a plan to upload a patch?
>>>> >
>>>> > Sent from my iPad
>>>> >
>>>> > On Jun 30, 2011, at 4:24 AM, Miklós Erdélyi <er...@gmail.com> wrote:
>>>> >
>>>> >> Hey,
>>>> >>
>>>> >> I've already implemented a graph package on top of HAMA in which you
>>>> >> might be interested.
>>>> >> It supports the basic Pregel API, i.e., "thinking like a vertex" based
>>>> >> on HAMA. The reason why I haven't released it yet is that it does not
>>>> >> support general graph input/data output -- currently it can only load
>>>> >> partitioned graphs from the local filesystem (in practice graphs
>>>> >> accessible through NFS on a cluster) and there's no infrastructure in
>>>> >> place for outputting data from vertexes.
>>>> >>
>>>> >> If there are any volunteers wanting to help putting it into a
>>>> >> releasable shape, raise your hands! :D
>>>> >>
>>>> >> Cheers,
>>>> >> Miklos
>>>> >>
>>>> >>
>>>> >> On Wed, Jun 29, 2011 at 3:22 AM, Edward J. Yoon <ed...@apache.org>
>>>> wrote:
>>>> >>> Hi,
>>>> >>>
>>>> >>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>>>> >>> jpregel, .., etc. (although they are all the early stage)
>>>> >>>
>>>> >>> I still believe that the core is a BSP computing engine but, "Pregel
>>>> >>> clone" is a good marketing strategy.
>>>> >>>
>>>> >>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>>>> >>>
>>>> >>> Thanks.
>>>> >>> --
>>>> >>> Best Regards, Edward J. Yoon
>>>> >>> @eddieyoon
>>>> >>>
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> Thomas Jungblut
>>> Berlin
>>>
>>> mobile: 0170-3081070
>>>
>>> business: thomas.jungblut@testberichte.de
>>> private: thomas.jungblut@gmail.com
>>>
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Re: Pregel clone projects

[Joseph Boyd <jo...@cbsinteractive.com>]

This page:
  https://github.com/raveldata/goldenorb/wiki/Using-GoldenOrb

Gives a good overview of what it's like to write code against goldenorb.


...joe


On Thu, Jun 30, 2011 at 3:23 PM, Edward J. Yoon <ed...@apache.org> wrote:
> +1
>
> And, just FYI, http://blog.udanax.org/2011/06/rough-analysis-of-googles-pregel-clone.html
>
> On Fri, Jul 1, 2011 at 4:28 AM, Thomas Jungblut
> <th...@googlemail.com> wrote:
>> Very nice. I'm opening an issue scheduled for 0.4.0.
>>
>> 2011/6/30 Miklós Erdélyi <er...@gmail.com>
>>
>>> Yes, sure!
>>> I still need to clean up bits of the code before I can upload it.
>>>
>>> On Thu, Jun 30, 2011 at 12:38 AM, Edward J. Yoon <ed...@apache.org>
>>> wrote:
>>> > Cool.
>>> >
>>> > Do you have a plan to upload a patch?
>>> >
>>> > Sent from my iPad
>>> >
>>> > On Jun 30, 2011, at 4:24 AM, Miklós Erdélyi <er...@gmail.com> wrote:
>>> >
>>> >> Hey,
>>> >>
>>> >> I've already implemented a graph package on top of HAMA in which you
>>> >> might be interested.
>>> >> It supports the basic Pregel API, i.e., "thinking like a vertex" based
>>> >> on HAMA. The reason why I haven't released it yet is that it does not
>>> >> support general graph input/data output -- currently it can only load
>>> >> partitioned graphs from the local filesystem (in practice graphs
>>> >> accessible through NFS on a cluster) and there's no infrastructure in
>>> >> place for outputting data from vertexes.
>>> >>
>>> >> If there are any volunteers wanting to help putting it into a
>>> >> releasable shape, raise your hands! :D
>>> >>
>>> >> Cheers,
>>> >> Miklos
>>> >>
>>> >>
>>> >> On Wed, Jun 29, 2011 at 3:22 AM, Edward J. Yoon <ed...@apache.org>
>>> wrote:
>>> >>> Hi,
>>> >>>
>>> >>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>>> >>> jpregel, .., etc. (although they are all the early stage)
>>> >>>
>>> >>> I still believe that the core is a BSP computing engine but, "Pregel
>>> >>> clone" is a good marketing strategy.
>>> >>>
>>> >>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>>> >>>
>>> >>> Thanks.
>>> >>> --
>>> >>> Best Regards, Edward J. Yoon
>>> >>> @eddieyoon
>>> >>>
>>> >
>>>
>>
>>
>>
>> --
>> Thomas Jungblut
>> Berlin
>>
>> mobile: 0170-3081070
>>
>> business: thomas.jungblut@testberichte.de
>> private: thomas.jungblut@gmail.com
>>
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>

Re: Pregel clone projects

["Edward J. Yoon" <ed...@apache.org>]

+1

And, just FYI, http://blog.udanax.org/2011/06/rough-analysis-of-googles-pregel-clone.html

On Fri, Jul 1, 2011 at 4:28 AM, Thomas Jungblut
<th...@googlemail.com> wrote:
> Very nice. I'm opening an issue scheduled for 0.4.0.
>
> 2011/6/30 Miklós Erdélyi <er...@gmail.com>
>
>> Yes, sure!
>> I still need to clean up bits of the code before I can upload it.
>>
>> On Thu, Jun 30, 2011 at 12:38 AM, Edward J. Yoon <ed...@apache.org>
>> wrote:
>> > Cool.
>> >
>> > Do you have a plan to upload a patch?
>> >
>> > Sent from my iPad
>> >
>> > On Jun 30, 2011, at 4:24 AM, Miklós Erdélyi <er...@gmail.com> wrote:
>> >
>> >> Hey,
>> >>
>> >> I've already implemented a graph package on top of HAMA in which you
>> >> might be interested.
>> >> It supports the basic Pregel API, i.e., "thinking like a vertex" based
>> >> on HAMA. The reason why I haven't released it yet is that it does not
>> >> support general graph input/data output -- currently it can only load
>> >> partitioned graphs from the local filesystem (in practice graphs
>> >> accessible through NFS on a cluster) and there's no infrastructure in
>> >> place for outputting data from vertexes.
>> >>
>> >> If there are any volunteers wanting to help putting it into a
>> >> releasable shape, raise your hands! :D
>> >>
>> >> Cheers,
>> >> Miklos
>> >>
>> >>
>> >> On Wed, Jun 29, 2011 at 3:22 AM, Edward J. Yoon <ed...@apache.org>
>> wrote:
>> >>> Hi,
>> >>>
>> >>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>> >>> jpregel, .., etc. (although they are all the early stage)
>> >>>
>> >>> I still believe that the core is a BSP computing engine but, "Pregel
>> >>> clone" is a good marketing strategy.
>> >>>
>> >>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>> >>>
>> >>> Thanks.
>> >>> --
>> >>> Best Regards, Edward J. Yoon
>> >>> @eddieyoon
>> >>>
>> >
>>
>
>
>
> --
> Thomas Jungblut
> Berlin
>
> mobile: 0170-3081070
>
> business: thomas.jungblut@testberichte.de
> private: thomas.jungblut@gmail.com
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Re: Pregel clone projects

[Thomas Jungblut <th...@googlemail.com>]

Very nice. I'm opening an issue scheduled for 0.4.0.

2011/6/30 Miklós Erdélyi <er...@gmail.com>

> Yes, sure!
> I still need to clean up bits of the code before I can upload it.
>
> On Thu, Jun 30, 2011 at 12:38 AM, Edward J. Yoon <ed...@apache.org>
> wrote:
> > Cool.
> >
> > Do you have a plan to upload a patch?
> >
> > Sent from my iPad
> >
> > On Jun 30, 2011, at 4:24 AM, Miklós Erdélyi <er...@gmail.com> wrote:
> >
> >> Hey,
> >>
> >> I've already implemented a graph package on top of HAMA in which you
> >> might be interested.
> >> It supports the basic Pregel API, i.e., "thinking like a vertex" based
> >> on HAMA. The reason why I haven't released it yet is that it does not
> >> support general graph input/data output -- currently it can only load
> >> partitioned graphs from the local filesystem (in practice graphs
> >> accessible through NFS on a cluster) and there's no infrastructure in
> >> place for outputting data from vertexes.
> >>
> >> If there are any volunteers wanting to help putting it into a
> >> releasable shape, raise your hands! :D
> >>
> >> Cheers,
> >> Miklos
> >>
> >>
> >> On Wed, Jun 29, 2011 at 3:22 AM, Edward J. Yoon <ed...@apache.org>
> wrote:
> >>> Hi,
> >>>
> >>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
> >>> jpregel, .., etc. (although they are all the early stage)
> >>>
> >>> I still believe that the core is a BSP computing engine but, "Pregel
> >>> clone" is a good marketing strategy.
> >>>
> >>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
> >>>
> >>> Thanks.
> >>> --
> >>> Best Regards, Edward J. Yoon
> >>> @eddieyoon
> >>>
> >
>



-- 
Thomas Jungblut
Berlin

mobile: 0170-3081070

business: thomas.jungblut@testberichte.de
private: thomas.jungblut@gmail.com

Re: Pregel clone projects

[Miklós Erdélyi <er...@gmail.com>]

Yes, sure!
I still need to clean up bits of the code before I can upload it.

On Thu, Jun 30, 2011 at 12:38 AM, Edward J. Yoon <ed...@apache.org> wrote:
> Cool.
>
> Do you have a plan to upload a patch?
>
> Sent from my iPad
>
> On Jun 30, 2011, at 4:24 AM, Miklós Erdélyi <er...@gmail.com> wrote:
>
>> Hey,
>>
>> I've already implemented a graph package on top of HAMA in which you
>> might be interested.
>> It supports the basic Pregel API, i.e., "thinking like a vertex" based
>> on HAMA. The reason why I haven't released it yet is that it does not
>> support general graph input/data output -- currently it can only load
>> partitioned graphs from the local filesystem (in practice graphs
>> accessible through NFS on a cluster) and there's no infrastructure in
>> place for outputting data from vertexes.
>>
>> If there are any volunteers wanting to help putting it into a
>> releasable shape, raise your hands! :D
>>
>> Cheers,
>> Miklos
>>
>>
>> On Wed, Jun 29, 2011 at 3:22 AM, Edward J. Yoon <ed...@apache.org> wrote:
>>> Hi,
>>>
>>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>>> jpregel, .., etc. (although they are all the early stage)
>>>
>>> I still believe that the core is a BSP computing engine but, "Pregel
>>> clone" is a good marketing strategy.
>>>
>>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>>>
>>> Thanks.
>>> --
>>> Best Regards, Edward J. Yoon
>>> @eddieyoon
>>>
>

Re: Pregel clone projects

["Edward J. Yoon" <ed...@apache.org>]

Cool.

Do you have a plan to upload a patch?

Sent from my iPad

On Jun 30, 2011, at 4:24 AM, Miklós Erdélyi <er...@gmail.com> wrote:

> Hey,
> 
> I've already implemented a graph package on top of HAMA in which you
> might be interested.
> It supports the basic Pregel API, i.e., "thinking like a vertex" based
> on HAMA. The reason why I haven't released it yet is that it does not
> support general graph input/data output -- currently it can only load
> partitioned graphs from the local filesystem (in practice graphs
> accessible through NFS on a cluster) and there's no infrastructure in
> place for outputting data from vertexes.
> 
> If there are any volunteers wanting to help putting it into a
> releasable shape, raise your hands! :D
> 
> Cheers,
> Miklos
> 
> 
> On Wed, Jun 29, 2011 at 3:22 AM, Edward J. Yoon <ed...@apache.org> wrote:
>> Hi,
>> 
>> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
>> jpregel, .., etc. (although they are all the early stage)
>> 
>> I still believe that the core is a BSP computing engine but, "Pregel
>> clone" is a good marketing strategy.
>> 
>> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>> 
>> Thanks.
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>> 

Re: Pregel clone projects

[Miklós Erdélyi <er...@gmail.com>]

Hey,

I've already implemented a graph package on top of HAMA in which you
might be interested.
It supports the basic Pregel API, i.e., "thinking like a vertex" based
on HAMA. The reason why I haven't released it yet is that it does not
support general graph input/data output -- currently it can only load
partitioned graphs from the local filesystem (in practice graphs
accessible through NFS on a cluster) and there's no infrastructure in
place for outputting data from vertexes.

If there are any volunteers wanting to help putting it into a
releasable shape, raise your hands! :D

Cheers,
Miklos


On Wed, Jun 29, 2011 at 3:22 AM, Edward J. Yoon <ed...@apache.org> wrote:
> Hi,
>
> Recently, I'm see many Pregel clone projects e.g., giraph, goldenorb,
> jpregel, .., etc. (although they are all the early stage)
>
> I still believe that the core is a BSP computing engine but, "Pregel
> clone" is a good marketing strategy.
>
> Should we plan the Pregel-like graph APIs for 0.4-incubating?
>
> Thanks.
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>