You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by Praveen Sripati <pr...@gmail.com> on 2012/03/25 15:32:09 UTC

Tools/frameworks on top of Hama

Hi,

Does it make to sense to have some tools/frameworks on top of Hama? Like
Pig, Hive and others for Hadoop. Some of them can make using Hama easier
and some add additional functionality on top of Hama.

The intent is not to develop the tools immediately, but to start a thought
process and discussion around it.

Thanks,
Praveen

Re: Tools/frameworks on top of Hama

Posted by "Edward J. Yoon" <ed...@apache.org>.
P.S.,

>> Does it make to sense to have some tools/frameworks on top of Hama?

Of course. :)

On Mon, Mar 26, 2012 at 5:09 PM, Edward J. Yoon <ed...@apache.org> wrote:
> RDF query processing[1] is my very old idea but, just think and thinking always.
>
> 1. http://webcache.googleusercontent.com/search?q=cache:JTCc9EfkhawJ:mail-archives.apache.org/mod_mbox/incubator-cvs/200803.mbox/%253C20080306024921.4647.30016%40eos.apache.org%253E+&cd=3&hl=en&ct=clnk
>
> On Sun, Mar 25, 2012 at 10:32 PM, Praveen Sripati
> <pr...@gmail.com> wrote:
>> Hi,
>>
>> Does it make to sense to have some tools/frameworks on top of Hama? Like
>> Pig, Hive and others for Hadoop. Some of them can make using Hama easier
>> and some add additional functionality on top of Hama.
>>
>> The intent is not to develop the tools immediately, but to start a thought
>> process and discussion around it.
>>
>> Thanks,
>> Praveen
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Re: Tools/frameworks on top of Hama

Posted by "Edward J. Yoon" <ed...@apache.org>.
RDF query processing[1] is my very old idea but, just think and thinking always.

1. http://webcache.googleusercontent.com/search?q=cache:JTCc9EfkhawJ:mail-archives.apache.org/mod_mbox/incubator-cvs/200803.mbox/%253C20080306024921.4647.30016%40eos.apache.org%253E+&cd=3&hl=en&ct=clnk

On Sun, Mar 25, 2012 at 10:32 PM, Praveen Sripati
<pr...@gmail.com> wrote:
> Hi,
>
> Does it make to sense to have some tools/frameworks on top of Hama? Like
> Pig, Hive and others for Hadoop. Some of them can make using Hama easier
> and some add additional functionality on top of Hama.
>
> The intent is not to develop the tools immediately, but to start a thought
> process and discussion around it.
>
> Thanks,
> Praveen



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Re: Tools/frameworks on top of Hama

Posted by Tommaso Teofili <to...@gmail.com>.
on my personal TODO list I have running Lucene and UIMA on top of Hama, and
also some basic ML/NLP algorithms.
Tommaso

2012/4/25 Praveen Sripati <pr...@gmail.com>

> Thomas,
>
> > Once we graduated I will mail arround the Pig and Hive community who is
> interested in it, because I'm not very experienced in query parsing,
> execution plans and stuff.
>
> This class be useful to get you started. I was always curious about
> compilers. So, I am taking this class along with the ML class for the next
> 10 weeks. ML class is very interesting.
>
> https://www.coursera.org/course/compilers
>
> Praveen
>
> On Sun, Mar 25, 2012 at 11:03 PM, Thomas Jungblut <
> thomas.jungblut@googlemail.com> wrote:
>
> > Yep, that is what we have discussed as well.
> > Currently I'm in the design phase of a real-time query engine on top of
> > Hama.
> > I guess we are calling it "Harq" and it will be somekind of hedgehog.
> >
> > Once we graduated I will mail arround the Pig and Hive community who is
> > interested in it, because I'm not very experienced in query parsing,
> > execution plans and stuff.
> >
> > That is definitely on our TODO list.
> > I just have to admit that I'd like to have Giraph running on top of Hama,
> > because they have a much more mature graph functionality. But they didn't
> > wanted to, so we are going to build our own.
> >
> > Am 25. März 2012 17:42 schrieb Apurv Verma <da...@gmail.com>:
> >
> > > +1
> > > In the coming time we'll have to figure out, how to port all map-reduce
> > > algorithms to an efficient BSP model. I was planning to learn to do
> this
> > > during my summer vacations.
> > >
> > > --
> > > thanks and regards,
> > >
> > > Apurv Verma
> > > B. Tech.(CSE)
> > > IIT- Ropar
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Sun, Mar 25, 2012 at 7:02 PM, Praveen Sripati
> > > <pr...@gmail.com>wrote:
> > >
> > > > Hi,
> > > >
> > > > Does it make to sense to have some tools/frameworks on top of Hama?
> > Like
> > > > Pig, Hive and others for Hadoop. Some of them can make using Hama
> > easier
> > > > and some add additional functionality on top of Hama.
> > > >
> > > > The intent is not to develop the tools immediately, but to start a
> > > thought
> > > > process and discussion around it.
> > > >
> > > > Thanks,
> > > > Praveen
> > > >
> > >
> >
> >
> >
> > --
> > Thomas Jungblut
> > Berlin <th...@gmail.com>
> >
>

Re: Tools/frameworks on top of Hama

Posted by Praveen Sripati <pr...@gmail.com>.
Thomas,

> Once we graduated I will mail arround the Pig and Hive community who is
interested in it, because I'm not very experienced in query parsing,
execution plans and stuff.

This class be useful to get you started. I was always curious about
compilers. So, I am taking this class along with the ML class for the next
10 weeks. ML class is very interesting.

https://www.coursera.org/course/compilers

Praveen

On Sun, Mar 25, 2012 at 11:03 PM, Thomas Jungblut <
thomas.jungblut@googlemail.com> wrote:

> Yep, that is what we have discussed as well.
> Currently I'm in the design phase of a real-time query engine on top of
> Hama.
> I guess we are calling it "Harq" and it will be somekind of hedgehog.
>
> Once we graduated I will mail arround the Pig and Hive community who is
> interested in it, because I'm not very experienced in query parsing,
> execution plans and stuff.
>
> That is definitely on our TODO list.
> I just have to admit that I'd like to have Giraph running on top of Hama,
> because they have a much more mature graph functionality. But they didn't
> wanted to, so we are going to build our own.
>
> Am 25. März 2012 17:42 schrieb Apurv Verma <da...@gmail.com>:
>
> > +1
> > In the coming time we'll have to figure out, how to port all map-reduce
> > algorithms to an efficient BSP model. I was planning to learn to do this
> > during my summer vacations.
> >
> > --
> > thanks and regards,
> >
> > Apurv Verma
> > B. Tech.(CSE)
> > IIT- Ropar
> >
> >
> >
> >
> >
> >
> > On Sun, Mar 25, 2012 at 7:02 PM, Praveen Sripati
> > <pr...@gmail.com>wrote:
> >
> > > Hi,
> > >
> > > Does it make to sense to have some tools/frameworks on top of Hama?
> Like
> > > Pig, Hive and others for Hadoop. Some of them can make using Hama
> easier
> > > and some add additional functionality on top of Hama.
> > >
> > > The intent is not to develop the tools immediately, but to start a
> > thought
> > > process and discussion around it.
> > >
> > > Thanks,
> > > Praveen
> > >
> >
>
>
>
> --
> Thomas Jungblut
> Berlin <th...@gmail.com>
>

Re: Tools/frameworks on top of Hama

Posted by Thomas Jungblut <th...@googlemail.com>.
Yep, that is what we have discussed as well.
Currently I'm in the design phase of a real-time query engine on top of
Hama.
I guess we are calling it "Harq" and it will be somekind of hedgehog.

Once we graduated I will mail arround the Pig and Hive community who is
interested in it, because I'm not very experienced in query parsing,
execution plans and stuff.

That is definitely on our TODO list.
I just have to admit that I'd like to have Giraph running on top of Hama,
because they have a much more mature graph functionality. But they didn't
wanted to, so we are going to build our own.

Am 25. März 2012 17:42 schrieb Apurv Verma <da...@gmail.com>:

> +1
> In the coming time we'll have to figure out, how to port all map-reduce
> algorithms to an efficient BSP model. I was planning to learn to do this
> during my summer vacations.
>
> --
> thanks and regards,
>
> Apurv Verma
> B. Tech.(CSE)
> IIT- Ropar
>
>
>
>
>
>
> On Sun, Mar 25, 2012 at 7:02 PM, Praveen Sripati
> <pr...@gmail.com>wrote:
>
> > Hi,
> >
> > Does it make to sense to have some tools/frameworks on top of Hama? Like
> > Pig, Hive and others for Hadoop. Some of them can make using Hama easier
> > and some add additional functionality on top of Hama.
> >
> > The intent is not to develop the tools immediately, but to start a
> thought
> > process and discussion around it.
> >
> > Thanks,
> > Praveen
> >
>



-- 
Thomas Jungblut
Berlin <th...@gmail.com>

Re: Tools/frameworks on top of Hama

Posted by Apurv Verma <da...@gmail.com>.
+1
In the coming time we'll have to figure out, how to port all map-reduce
algorithms to an efficient BSP model. I was planning to learn to do this
during my summer vacations.

--
thanks and regards,

Apurv Verma
B. Tech.(CSE)
IIT- Ropar






On Sun, Mar 25, 2012 at 7:02 PM, Praveen Sripati
<pr...@gmail.com>wrote:

> Hi,
>
> Does it make to sense to have some tools/frameworks on top of Hama? Like
> Pig, Hive and others for Hadoop. Some of them can make using Hama easier
> and some add additional functionality on top of Hama.
>
> The intent is not to develop the tools immediately, but to start a thought
> process and discussion around it.
>
> Thanks,
> Praveen
>