You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Alan Gates <ga...@yahoo-inc.com> on 2007/10/30 18:44:24 UTC
Re: Yahoo Pig - Some updates
edward yoon wrote:
>> After looking a little at HBase, it looks like building load and store > functions in pig to read from and write to hbase shouldn't be too hard.
>>
> yeah, i agree.
>
>
>> Changing pig to take advantage of more hbase features than just full > scan and a new version of rows in a table would take quite a bit more work.
>>
>
> I'm thinking of moving hbase shell works to pig latin project.
> what do you think?
>
By hbase shell are you thinking of the SQL like support? I'm not sure
about that. At some point we'll want to put SQL on top of pig just
because there's such a large SQL community out there, and translation
from (read only) SQL->pig is fairly straight forward. So we want to
make sure we think all the way through what SQL we want before we just
adopt something from another project.
Also, I think we need to relocate this conversation to the pig-user
mailing list, as it seems pig specific at this point (and pig even has
its own mailing lists now).
Alan.
RE: Yahoo Pig - Some updates
Posted by edward yoon <we...@udanax.org>.
Thanks, Dr.Ted
I see what your saying.
As for the matters related to adding hbase storage options,
It would be good to start after discussing the matters further with hbase people.
As for the shell stuff,
I will make a proposal once a better idea on the relationship between hbase and pig comes up.
Any advice welcome.
Thanks,
Edward.
------------------------------
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org
> Date: Tue, 30 Oct 2007 22:21:29 -0700
> Subject: Re: Yahoo Pig - Some updates
> From: tdunning@veoh.com
> To: pig-dev@incubator.apache.org; pig-user@incubator.apache.org; gates@yahoo-inc.com
>
>
>
>
> On 10/30/07 7:11 PM, "edward yoon" wrote:
>
>> Well then, What do you think about hbase storage option for Pig?
>
> I think that is a grand idea. Pig could provide high throughput batch
> analysis of hbase databases.
>
>> If you're positive about hbase storage option,
>> Pig will manipulate the hbase databases and the ultimate goal of hbase shell
>> and pig could be the same (as for SQL-related discussions, we should leave it
>> on the side.)
>
> The ultimate goals are clearly relatively similar. I also shouldn't be
> discouraging you from trying to do anything you would find interesting.
>
> I just think that it would slow down experimentation on both sides (hbase
> and pig) if they were tied too closely together at an early stage.
>
> Hbase shell is, from what I can see, quite a hot bed of experimentation with
> syntax and interface. Pig is all about how to express map-reduce
> computations easily and efficiently. In the short run, those cultures
> should not be forced to live by each others assumptions.
>
_________________________________________________________________
Climb to the top of the charts! Play Star Shuffle: the word scramble challenge with star power.
http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
RE: Yahoo Pig - Some updates
Posted by edward yoon <we...@udanax.org>.
Thanks, Dr.Ted
I see what your saying.
As for the matters related to adding hbase storage options,
It would be good to start after discussing the matters further with hbase people.
As for the shell stuff,
I will make a proposal once a better idea on the relationship between hbase and pig comes up.
Any advice welcome.
Thanks,
Edward.
------------------------------
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org
> Date: Tue, 30 Oct 2007 22:21:29 -0700
> Subject: Re: Yahoo Pig - Some updates
> From: tdunning@veoh.com
> To: pig-dev@incubator.apache.org; pig-user@incubator.apache.org; gates@yahoo-inc.com
>
>
>
>
> On 10/30/07 7:11 PM, "edward yoon" wrote:
>
>> Well then, What do you think about hbase storage option for Pig?
>
> I think that is a grand idea. Pig could provide high throughput batch
> analysis of hbase databases.
>
>> If you're positive about hbase storage option,
>> Pig will manipulate the hbase databases and the ultimate goal of hbase shell
>> and pig could be the same (as for SQL-related discussions, we should leave it
>> on the side.)
>
> The ultimate goals are clearly relatively similar. I also shouldn't be
> discouraging you from trying to do anything you would find interesting.
>
> I just think that it would slow down experimentation on both sides (hbase
> and pig) if they were tied too closely together at an early stage.
>
> Hbase shell is, from what I can see, quite a hot bed of experimentation with
> syntax and interface. Pig is all about how to express map-reduce
> computations easily and efficiently. In the short run, those cultures
> should not be forced to live by each others assumptions.
>
_________________________________________________________________
Climb to the top of the charts! Play Star Shuffle: the word scramble challenge with star power.
http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
Re: Yahoo Pig - Some updates
Posted by Ted Dunning <td...@veoh.com>.
On 10/30/07 7:11 PM, "edward yoon" <we...@udanax.org> wrote:
> Well then, What do you think about hbase storage option for Pig?
I think that is a grand idea. Pig could provide high throughput batch
analysis of hbase databases.
> If you're positive about hbase storage option,
> Pig will manipulate the hbase databases and the ultimate goal of hbase shell
> and pig could be the same (as for SQL-related discussions, we should leave it
> on the side.)
The ultimate goals are clearly relatively similar. I also shouldn't be
discouraging you from trying to do anything you would find interesting.
I just think that it would slow down experimentation on both sides (hbase
and pig) if they were tied too closely together at an early stage.
Hbase shell is, from what I can see, quite a hot bed of experimentation with
syntax and interface. Pig is all about how to express map-reduce
computations easily and efficiently. In the short run, those cultures
should not be forced to live by each others assumptions.
Re: Yahoo Pig - Some updates
Posted by Ted Dunning <td...@veoh.com>.
On 10/30/07 7:11 PM, "edward yoon" <we...@udanax.org> wrote:
> Well then, What do you think about hbase storage option for Pig?
I think that is a grand idea. Pig could provide high throughput batch
analysis of hbase databases.
> If you're positive about hbase storage option,
> Pig will manipulate the hbase databases and the ultimate goal of hbase shell
> and pig could be the same (as for SQL-related discussions, we should leave it
> on the side.)
The ultimate goals are clearly relatively similar. I also shouldn't be
discouraging you from trying to do anything you would find interesting.
I just think that it would slow down experimentation on both sides (hbase
and pig) if they were tied too closely together at an early stage.
Hbase shell is, from what I can see, quite a hot bed of experimentation with
syntax and interface. Pig is all about how to express map-reduce
computations easily and efficiently. In the short run, those cultures
should not be forced to live by each others assumptions.
RE: Yahoo Pig - Some updates
Posted by edward yoon <we...@udanax.org>.
Thanks, Dr.Ted.
Well then, What do you think about hbase storage option for Pig?
If you're positive about hbase storage option,
Pig will manipulate the hbase databases and the ultimate goal of hbase shell and pig could be the same.
(as for SQL-related discussions, we should leave it on the side.)
I welcome your any advice.
thanks,
edward j. yoon
------------------------------
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org
> Date: Tue, 30 Oct 2007 18:41:16 -0700
> Subject: Re: Yahoo Pig - Some updates
> From: tdunning@veoh.com
> To: pig-dev@incubator.apache.org; gates@yahoo-inc.com
> CC: pig-user@incubator.apache.org
>
>
> Pig is the software.
>
> Pig latin is the language that pig uses.
>
> Pig != SQL (or even SQL-like). I frankly like pig much better than SQL in
> some respects (group + optional flatten works better for me, I love nested
> data structures).
>
> I think that the goals of pig and hbase shell are sufficiently different
> that combining them at this point would cause serious problem. The things
> missing from pig's shell now are error messages and ability to inspect
> structures and plans and reliable execution, not SQL-like query languages.
>
>
> On 10/30/07 6:33 PM, "edward yoon" wrote:
>
>>
>>> By hbase shell are you thinking of the SQL like support? I'm not sure> about
>>> that. At some point we'll want to put SQL on top of pig just> because
>>> there's such a large SQL community out there, and translation> from (read
>>> only) SQL->pig is fairly straight forward. So we want to> make sure we think
>>> all the way through what SQL we want before we just> adopt something from
>>> another project.
>>
>> yeah, we're ready for SQL-like query support in hbase shell.also, i'm thinking
>> about extended sql query languages for (rdf, gis, matrix... etc.) on hbase.
>> but now, ..
>> i hope pig latin uses hadoop + hbase additionally. and using pig latin's data
>> processing capacity, i hope to create an sql-like service by integrating my
>> works to pig latin
>> i welcome your any advice.
>>
>> thanks,
>> edward j. yoon
>>
>> ------------------------------
>> B. Regards,
>> Edward yoon @ NHN, corp.
>> Home : http://www.udanax.org> Date: Tue, 30 Oct 2007 10:44:24 -0700> From:
>> gates@yahoo-inc.com> To: webmaster@udanax.org> CC:
>> pig-user@incubator.apache.org> Subject: Re: Yahoo Pig - Some updates>>>>
>> edward yoon wrote:>>> After looking a little at HBase, it looks like building
>> load and store> functions in pig to read from and write to hbase shouldn't be
>> too hard.>>>>> yeah, i agree.>>>>>>> Changing pig to take advantage
>> of more hbase features than just full> scan and a new version of rows in a
>> table would take quite a bit more work.>>>>>>> I'm thinking of moving
>> hbase shell works to pig latin project.>> what do you think?>>> By hbase
>> shell are you thinking of the SQL like support? I'm not sure> about that. At
>> some point we'll want to put SQL on top of pig just> because there's such a
>> large SQL community out there, and translation> from (read only) SQL->pig is
>> fairly straight forward. So we want to> make sure we think all the way
>> through what SQL we want before we just> adopt something from another
>> project.>> Also, I think we need to relocate this conversation to the
>> pig-user> mailing list, as it seems pig specific at this point (and pig even
>> has> its own mailing lists now).>> Alan.>
>> _________________________________________________________________
>> Climb to the top of the charts! Play Star Shuffle: the word scramble
>> challenge with star power.
>> http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
>
_________________________________________________________________
Peek-a-boo FREE Tricks & Treats for You!
http://www.reallivemoms.com?ocid=TXT_TAGHM&loc=us
RE: Yahoo Pig - Some updates
Posted by edward yoon <we...@udanax.org>.
Thanks, Dr.Ted.
Well then, What do you think about hbase storage option for Pig?
If you're positive about hbase storage option,
Pig will manipulate the hbase databases and the ultimate goal of hbase shell and pig could be the same.
(as for SQL-related discussions, we should leave it on the side.)
I welcome your any advice.
thanks,
edward j. yoon
------------------------------
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org
> Date: Tue, 30 Oct 2007 18:41:16 -0700
> Subject: Re: Yahoo Pig - Some updates
> From: tdunning@veoh.com
> To: pig-dev@incubator.apache.org; gates@yahoo-inc.com
> CC: pig-user@incubator.apache.org
>
>
> Pig is the software.
>
> Pig latin is the language that pig uses.
>
> Pig != SQL (or even SQL-like). I frankly like pig much better than SQL in
> some respects (group + optional flatten works better for me, I love nested
> data structures).
>
> I think that the goals of pig and hbase shell are sufficiently different
> that combining them at this point would cause serious problem. The things
> missing from pig's shell now are error messages and ability to inspect
> structures and plans and reliable execution, not SQL-like query languages.
>
>
> On 10/30/07 6:33 PM, "edward yoon" wrote:
>
>>
>>> By hbase shell are you thinking of the SQL like support? I'm not sure> about
>>> that. At some point we'll want to put SQL on top of pig just> because
>>> there's such a large SQL community out there, and translation> from (read
>>> only) SQL->pig is fairly straight forward. So we want to> make sure we think
>>> all the way through what SQL we want before we just> adopt something from
>>> another project.
>>
>> yeah, we're ready for SQL-like query support in hbase shell.also, i'm thinking
>> about extended sql query languages for (rdf, gis, matrix... etc.) on hbase.
>> but now, ..
>> i hope pig latin uses hadoop + hbase additionally. and using pig latin's data
>> processing capacity, i hope to create an sql-like service by integrating my
>> works to pig latin
>> i welcome your any advice.
>>
>> thanks,
>> edward j. yoon
>>
>> ------------------------------
>> B. Regards,
>> Edward yoon @ NHN, corp.
>> Home : http://www.udanax.org> Date: Tue, 30 Oct 2007 10:44:24 -0700> From:
>> gates@yahoo-inc.com> To: webmaster@udanax.org> CC:
>> pig-user@incubator.apache.org> Subject: Re: Yahoo Pig - Some updates>>>>
>> edward yoon wrote:>>> After looking a little at HBase, it looks like building
>> load and store> functions in pig to read from and write to hbase shouldn't be
>> too hard.>>>>> yeah, i agree.>>>>>>> Changing pig to take advantage
>> of more hbase features than just full> scan and a new version of rows in a
>> table would take quite a bit more work.>>>>>>> I'm thinking of moving
>> hbase shell works to pig latin project.>> what do you think?>>> By hbase
>> shell are you thinking of the SQL like support? I'm not sure> about that. At
>> some point we'll want to put SQL on top of pig just> because there's such a
>> large SQL community out there, and translation> from (read only) SQL->pig is
>> fairly straight forward. So we want to> make sure we think all the way
>> through what SQL we want before we just> adopt something from another
>> project.>> Also, I think we need to relocate this conversation to the
>> pig-user> mailing list, as it seems pig specific at this point (and pig even
>> has> its own mailing lists now).>> Alan.>
>> _________________________________________________________________
>> Climb to the top of the charts! Play Star Shuffle: the word scramble
>> challenge with star power.
>> http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
>
_________________________________________________________________
Peek-a-boo FREE Tricks & Treats for You!
http://www.reallivemoms.com?ocid=TXT_TAGHM&loc=us
please don't crosspost!
Posted by Doug Cutting <cu...@apache.org>.
Please do not post messages to both pig-user and pig-dev. Please choose
one or the other. Many folks are on both lists and do not need to see
two copies of the message.
Doug
Re: Yahoo Pig - Some updates
Posted by Ted Dunning <td...@veoh.com>.
Pig is the software.
Pig latin is the language that pig uses.
Pig != SQL (or even SQL-like). I frankly like pig much better than SQL in
some respects (group + optional flatten works better for me, I love nested
data structures).
I think that the goals of pig and hbase shell are sufficiently different
that combining them at this point would cause serious problem. The things
missing from pig's shell now are error messages and ability to inspect
structures and plans and reliable execution, not SQL-like query languages.
On 10/30/07 6:33 PM, "edward yoon" <we...@udanax.org> wrote:
>
>> By hbase shell are you thinking of the SQL like support? I'm not sure > about
>> that. At some point we'll want to put SQL on top of pig just > because
>> there's such a large SQL community out there, and translation > from (read
>> only) SQL->pig is fairly straight forward. So we want to > make sure we think
>> all the way through what SQL we want before we just > adopt something from
>> another project.
>
> yeah, we're ready for SQL-like query support in hbase shell.also, i'm thinking
> about extended sql query languages for (rdf, gis, matrix... etc.) on hbase.
> but now, ..
> i hope pig latin uses hadoop + hbase additionally. and using pig latin's data
> processing capacity, i hope to create an sql-like service by integrating my
> works to pig latin
> i welcome your any advice.
>
> thanks,
> edward j. yoon
>
> ------------------------------
> B. Regards,
> Edward yoon @ NHN, corp.
> Home : http://www.udanax.org> Date: Tue, 30 Oct 2007 10:44:24 -0700> From:
> gates@yahoo-inc.com> To: webmaster@udanax.org> CC:
> pig-user@incubator.apache.org> Subject: Re: Yahoo Pig - Some updates> > > >
> edward yoon wrote:> >> After looking a little at HBase, it looks like building
> load and store > functions in pig to read from and write to hbase shouldn't be
> too hard. > >> > > yeah, i agree.> > > > > >> Changing pig to take advantage
> of more hbase features than just full > scan and a new version of rows in a
> table would take quite a bit more work.> >> > > > > I'm thinking of moving
> hbase shell works to pig latin project. > > what do you think? > > > By hbase
> shell are you thinking of the SQL like support? I'm not sure > about that. At
> some point we'll want to put SQL on top of pig just > because there's such a
> large SQL community out there, and translation > from (read only) SQL->pig is
> fairly straight forward. So we want to > make sure we think all the way
> through what SQL we want before we just > adopt something from another
> project.> > Also, I think we need to relocate this conversation to the
> pig-user > mailing list, as it seems pig specific at this point (and pig even
> has > its own mailing lists now).> > Alan.>
> _________________________________________________________________
> Climb to the top of the charts! Play Star Shuffle: the word scramble
> challenge with star power.
> http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
Re: Yahoo Pig - Some updates
Posted by Ted Dunning <td...@veoh.com>.
Pig is the software.
Pig latin is the language that pig uses.
Pig != SQL (or even SQL-like). I frankly like pig much better than SQL in
some respects (group + optional flatten works better for me, I love nested
data structures).
I think that the goals of pig and hbase shell are sufficiently different
that combining them at this point would cause serious problem. The things
missing from pig's shell now are error messages and ability to inspect
structures and plans and reliable execution, not SQL-like query languages.
On 10/30/07 6:33 PM, "edward yoon" <we...@udanax.org> wrote:
>
>> By hbase shell are you thinking of the SQL like support? I'm not sure > about
>> that. At some point we'll want to put SQL on top of pig just > because
>> there's such a large SQL community out there, and translation > from (read
>> only) SQL->pig is fairly straight forward. So we want to > make sure we think
>> all the way through what SQL we want before we just > adopt something from
>> another project.
>
> yeah, we're ready for SQL-like query support in hbase shell.also, i'm thinking
> about extended sql query languages for (rdf, gis, matrix... etc.) on hbase.
> but now, ..
> i hope pig latin uses hadoop + hbase additionally. and using pig latin's data
> processing capacity, i hope to create an sql-like service by integrating my
> works to pig latin
> i welcome your any advice.
>
> thanks,
> edward j. yoon
>
> ------------------------------
> B. Regards,
> Edward yoon @ NHN, corp.
> Home : http://www.udanax.org> Date: Tue, 30 Oct 2007 10:44:24 -0700> From:
> gates@yahoo-inc.com> To: webmaster@udanax.org> CC:
> pig-user@incubator.apache.org> Subject: Re: Yahoo Pig - Some updates> > > >
> edward yoon wrote:> >> After looking a little at HBase, it looks like building
> load and store > functions in pig to read from and write to hbase shouldn't be
> too hard. > >> > > yeah, i agree.> > > > > >> Changing pig to take advantage
> of more hbase features than just full > scan and a new version of rows in a
> table would take quite a bit more work.> >> > > > > I'm thinking of moving
> hbase shell works to pig latin project. > > what do you think? > > > By hbase
> shell are you thinking of the SQL like support? I'm not sure > about that. At
> some point we'll want to put SQL on top of pig just > because there's such a
> large SQL community out there, and translation > from (read only) SQL->pig is
> fairly straight forward. So we want to > make sure we think all the way
> through what SQL we want before we just > adopt something from another
> project.> > Also, I think we need to relocate this conversation to the
> pig-user > mailing list, as it seems pig specific at this point (and pig even
> has > its own mailing lists now).> > Alan.>
> _________________________________________________________________
> Climb to the top of the charts! Play Star Shuffle: the word scramble
> challenge with star power.
> http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
RE: Yahoo Pig - Some updates
Posted by edward yoon <we...@udanax.org>.
> By hbase shell are you thinking of the SQL like support? I'm not sure > about that. At some point we'll want to put SQL on top of pig just > because there's such a large SQL community out there, and translation > from (read only) SQL->pig is fairly straight forward. So we want to > make sure we think all the way through what SQL we want before we just > adopt something from another project.
yeah, we're ready for SQL-like query support in hbase shell.also, i'm thinking about extended sql query languages for (rdf, gis, matrix... etc.) on hbase.
but now, ..
i hope pig latin uses hadoop + hbase additionally. and using pig latin's data processing capacity, i hope to create an sql-like service by integrating my works to pig latin
i welcome your any advice.
thanks,
edward j. yoon
------------------------------
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org> Date: Tue, 30 Oct 2007 10:44:24 -0700> From: gates@yahoo-inc.com> To: webmaster@udanax.org> CC: pig-user@incubator.apache.org> Subject: Re: Yahoo Pig - Some updates> > > > edward yoon wrote:> >> After looking a little at HBase, it looks like building load and store > functions in pig to read from and write to hbase shouldn't be too hard. > >> > > yeah, i agree.> > > > > >> Changing pig to take advantage of more hbase features than just full > scan and a new version of rows in a table would take quite a bit more work.> >> > > > > I'm thinking of moving hbase shell works to pig latin project. > > what do you think? > > > By hbase shell are you thinking of the SQL like support? I'm not sure > about that. At some point we'll want to put SQL on top of pig just > because there's such a large SQL community out there, and translation > from (read only) SQL->pig is fairly straight forward. So we want to > make sure we think all the way through what SQL we want before we just > adopt something from another project.> > Also, I think we need to relocate this conversation to the pig-user > mailing list, as it seems pig specific at this point (and pig even has > its own mailing lists now).> > Alan.>
_________________________________________________________________
Climb to the top of the charts! Play Star Shuffle: the word scramble challenge with star power.
http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
RE: Yahoo Pig - Some updates
Posted by edward yoon <we...@udanax.org>.
> By hbase shell are you thinking of the SQL like support? I'm not sure > about that. At some point we'll want to put SQL on top of pig just > because there's such a large SQL community out there, and translation > from (read only) SQL->pig is fairly straight forward. So we want to > make sure we think all the way through what SQL we want before we just > adopt something from another project.
yeah, we're ready for SQL-like query support in hbase shell.also, i'm thinking about extended sql query languages for (rdf, gis, matrix... etc.) on hbase.
but now, ..
i hope pig latin uses hadoop + hbase additionally. and using pig latin's data processing capacity, i hope to create an sql-like service by integrating my works to pig latin
i welcome your any advice.
thanks,
edward j. yoon
------------------------------
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org> Date: Tue, 30 Oct 2007 10:44:24 -0700> From: gates@yahoo-inc.com> To: webmaster@udanax.org> CC: pig-user@incubator.apache.org> Subject: Re: Yahoo Pig - Some updates> > > > edward yoon wrote:> >> After looking a little at HBase, it looks like building load and store > functions in pig to read from and write to hbase shouldn't be too hard. > >> > > yeah, i agree.> > > > > >> Changing pig to take advantage of more hbase features than just full > scan and a new version of rows in a table would take quite a bit more work.> >> > > > > I'm thinking of moving hbase shell works to pig latin project. > > what do you think? > > > By hbase shell are you thinking of the SQL like support? I'm not sure > about that. At some point we'll want to put SQL on top of pig just > because there's such a large SQL community out there, and translation > from (read only) SQL->pig is fairly straight forward. So we want to > make sure we think all the way through what SQL we want before we just > adopt something from another project.> > Also, I think we need to relocate this conversation to the pig-user > mailing list, as it seems pig specific at this point (and pig even has > its own mailing lists now).> > Alan.>
_________________________________________________________________
Climb to the top of the charts! Play Star Shuffle: the word scramble challenge with star power.
http://club.live.com/star_shuffle.aspx?icid=starshuffle_wlmailtextlink_oct
RE: Yahoo Pig - Some updates
Posted by edward yoon <we...@udanax.org>.
Sorry for my broken text email.
> By hbase shell are you thinking of the SQL like support? I'm not sure
> about that. At some point we'll want to put SQL on top of pig just
> because there's such a large SQL community out there, and translation
> from (read only) SQL->pig is fairly straight forward. So we want to
> make sure we think all the way through what SQL we want before we just
> adopt something from another project.
yeah, we're ready for SQL-like query support in hbase shell.
also, i'm thinking about extended sql query languages for (rdf, gis, matrix... etc.) on hbase.
but now, ..
i hope pig latin uses hadoop + hbase additionally.
and using pig latin's data processing capacity,
i hope to create an sql-like service by integrating my works to pig latin
i welcome your any advice.
thanks,
edward j. yoon
------------------------------
B. Regards,
Edward yoon @ NHN, corp.
Home : http://www.udanax.org
> Date: Tue, 30 Oct 2007 10:44:24 -0700
> From: gates@yahoo-inc.com
> To: webmaster@udanax.org
> CC: pig-user@incubator.apache.org
> Subject: Re: Yahoo Pig - Some updates
>
>
>
> edward yoon wrote:
>>> After looking a little at HBase, it looks like building load and store> functions in pig to read from and write to hbase shouldn't be too hard.
>>>
>> yeah, i agree.
>>
>>
>>> Changing pig to take advantage of more hbase features than just full> scan and a new version of rows in a table would take quite a bit more work.
>>>
>>
>> I'm thinking of moving hbase shell works to pig latin project.
>> what do you think?
>>
> By hbase shell are you thinking of the SQL like support? I'm not sure
> about that. At some point we'll want to put SQL on top of pig just
> because there's such a large SQL community out there, and translation
> from (read only) SQL->pig is fairly straight forward. So we want to
> make sure we think all the way through what SQL we want before we just
> adopt something from another project.
>
> Also, I think we need to relocate this conversation to the pig-user
> mailing list, as it seems pig specific at this point (and pig even has
> its own mailing lists now).
>
> Alan.
>
_________________________________________________________________
Windows Live Hotmail and Microsoft Office Outlook – together at last. Get it now.
http://office.microsoft.com/en-us/outlook/HA102225181033.aspx?pid=CL100626971033