You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Bharath Mundlapudi <mu...@gmail.com> on 2012/09/14 19:34:14 UTC
Latest Pig vs Hive comparisons
Hello Community,
Is there any document/blog comparing different features offered by Pig 0.8
(0.9, 0.10) or greater and Hive 0.8 (0.9)?
-Bharath
Re: Latest Pig vs Hive comparisons
Posted by Bharath Mundlapudi <mu...@gmail.com>.
>> So the differences are too numerous to mention.
>From a feature point of view (at a macro level) not many difference. IMHO,
Lars did a fantastic job of listing those differences. Unfortunately, both
the projects are moving targets and that article needs an update. If time
permits, I will write a blog on this.
-Bharath
On Thu, Sep 20, 2012 at 1:21 PM, Edward Capriolo <ed...@gmail.com>wrote:
> While pig and hive are mostly the same (as they abstract you from the
> internals of map reduce) they are totally different (as one is a flow
> language and one is an interpreted sql like language).
>
> So the differences are too numerous to mention.
>
> On Thu, Sep 20, 2012 at 3:48 PM, Bharath Mundlapudi
> <mu...@gmail.com> wrote:
> > Thanks all for the links. But i must say none of the links covered my
> > question. The link, Aniket provided has some information which i already
> > looked at - Author probably need to update the content.
> >
> > I was looking for new features up-to-date comparison.
> >
> > -Bharath
> >
> > On Wed, Sep 19, 2012 at 1:35 PM, Bertrand Dechoux <de...@gmail.com>
> > wrote:
> >>
> >> Although the two first links are interesting reads, I would recommend
> you
> >> the last one provided by Russel.
> >>
> >> The key thing is not to think "I will choose the most efficient wrt to
> >> performance" but "I will choose the most in tune with my use cases".
> >> Secondly, HCatalog is really something worth mentioning. Basically, the
> >> difference in format handling as explained in the other articles is less
> >> hard-lined now.
> >>
> >> Regards
> >>
> >> Bertrand
> >>
> >>
> >> On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney <
> russell.jurney@gmail.com>
> >> wrote:
> >>>
> >>> A presentation on Hive vs Pig by a committer on both projects is here:
> >>> http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/
> >>>
> >>>
> >>> Russell Jurney
> >>> twitter.com/rjurney
> >>> russell.jurney@gmail.com
> >>> datasyndrome.com
> >>>
> >>> On Sep 18, 2012, at 3:01 PM, Aniket Mokashi <an...@gmail.com>
> wrote:
> >>>
> >>> (Probably not what you are looking for) Check
> >>> -http://www.larsgeorge.com/2009/10/hive-vs-pig.html
> >>>
> >>> ~Aniket
> >>>
> >>> On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney
> >>> <ru...@gmail.com> wrote:
> >>>>
> >>>> A detailed post comparing Pig/Hive performance from last week:
> >>>>
> http://hortonworks.com/blog/pig-performance-and-optimization-analysis/
> >>>>
> >>>> Russell Jurney
> >>>> twitter.com/rjurney
> >>>> russell.jurney@gmail.com
> >>>> datasyndrome.com
> >>>>
> >>>> On Sep 14, 2012, at 10:55 AM, Anurag Tangri <ta...@gmail.com>
> >>>> wrote:
> >>>>
> >>>> > Knowing performance statistics would be good too.
> >>>> >
> >>>> > Sent from my iPhone
> >>>> >
> >>>> > On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi
> >>>> > <mu...@gmail.com> wrote:
> >>>> >
> >>>> >> Hello Community,
> >>>> >>
> >>>> >> Is there any document/blog comparing different features offered by
> >>>> >> Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
> >>>> >>
> >>>> >> -Bharath
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> "...:::Aniket:::... Quetzalco@tl"
> >>
> >>
> >>
> >>
> >> --
> >> Bertrand Dechoux
> >
> >
>
Re: Latest Pig vs Hive comparisons
Posted by Edward Capriolo <ed...@gmail.com>.
While pig and hive are mostly the same (as they abstract you from the
internals of map reduce) they are totally different (as one is a flow
language and one is an interpreted sql like language).
So the differences are too numerous to mention.
On Thu, Sep 20, 2012 at 3:48 PM, Bharath Mundlapudi
<mu...@gmail.com> wrote:
> Thanks all for the links. But i must say none of the links covered my
> question. The link, Aniket provided has some information which i already
> looked at - Author probably need to update the content.
>
> I was looking for new features up-to-date comparison.
>
> -Bharath
>
> On Wed, Sep 19, 2012 at 1:35 PM, Bertrand Dechoux <de...@gmail.com>
> wrote:
>>
>> Although the two first links are interesting reads, I would recommend you
>> the last one provided by Russel.
>>
>> The key thing is not to think "I will choose the most efficient wrt to
>> performance" but "I will choose the most in tune with my use cases".
>> Secondly, HCatalog is really something worth mentioning. Basically, the
>> difference in format handling as explained in the other articles is less
>> hard-lined now.
>>
>> Regards
>>
>> Bertrand
>>
>>
>> On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney <ru...@gmail.com>
>> wrote:
>>>
>>> A presentation on Hive vs Pig by a committer on both projects is here:
>>> http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/
>>>
>>>
>>> Russell Jurney
>>> twitter.com/rjurney
>>> russell.jurney@gmail.com
>>> datasyndrome.com
>>>
>>> On Sep 18, 2012, at 3:01 PM, Aniket Mokashi <an...@gmail.com> wrote:
>>>
>>> (Probably not what you are looking for) Check
>>> -http://www.larsgeorge.com/2009/10/hive-vs-pig.html
>>>
>>> ~Aniket
>>>
>>> On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney
>>> <ru...@gmail.com> wrote:
>>>>
>>>> A detailed post comparing Pig/Hive performance from last week:
>>>> http://hortonworks.com/blog/pig-performance-and-optimization-analysis/
>>>>
>>>> Russell Jurney
>>>> twitter.com/rjurney
>>>> russell.jurney@gmail.com
>>>> datasyndrome.com
>>>>
>>>> On Sep 14, 2012, at 10:55 AM, Anurag Tangri <ta...@gmail.com>
>>>> wrote:
>>>>
>>>> > Knowing performance statistics would be good too.
>>>> >
>>>> > Sent from my iPhone
>>>> >
>>>> > On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi
>>>> > <mu...@gmail.com> wrote:
>>>> >
>>>> >> Hello Community,
>>>> >>
>>>> >> Is there any document/blog comparing different features offered by
>>>> >> Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
>>>> >>
>>>> >> -Bharath
>>>
>>>
>>>
>>>
>>> --
>>> "...:::Aniket:::... Quetzalco@tl"
>>
>>
>>
>>
>> --
>> Bertrand Dechoux
>
>
Re: Latest Pig vs Hive comparisons
Posted by Bharath Mundlapudi <mu...@gmail.com>.
Thanks all for the links. But i must say none of the links covered my
question. The link, Aniket provided has some information which i already
looked at - Author probably need to update the content.
I was looking for new features up-to-date comparison.
-Bharath
On Wed, Sep 19, 2012 at 1:35 PM, Bertrand Dechoux <de...@gmail.com>wrote:
> Although the two first links are interesting reads, I would recommend you
> the last one provided by Russel.
>
> The key thing is not to think "I will choose the most efficient wrt
> to performance" but "I will choose the most in tune with my use cases".
> Secondly, HCatalog is really something worth mentioning. Basically, the
> difference in format handling as explained in the other articles is less
> hard-lined now.
>
> Regards
>
> Bertrand
>
>
> On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney <ru...@gmail.com>wrote:
>
>> A presentation on Hive vs Pig by a committer on both projects is here:
>> http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/
>>
>>
>> Russell Jurney
>> twitter.com/rjurney
>> russell.jurney@gmail.com
>> datasyndrome.com
>>
>> On Sep 18, 2012, at 3:01 PM, Aniket Mokashi <an...@gmail.com> wrote:
>>
>> (Probably not what you are looking for) Check -
>> http://www.larsgeorge.com/2009/10/hive-vs-pig.html
>>
>> ~Aniket
>>
>> On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney <russell.jurney@gmail.com
>> > wrote:
>>
>>> A detailed post comparing Pig/Hive performance from last week:
>>> http://hortonworks.com/blog/pig-performance-and-optimization-analysis/
>>>
>>> Russell Jurney
>>> twitter.com/rjurney
>>> russell.jurney@gmail.com
>>> datasyndrome.com
>>>
>>> On Sep 14, 2012, at 10:55 AM, Anurag Tangri <ta...@gmail.com>
>>> wrote:
>>>
>>> > Knowing performance statistics would be good too.
>>> >
>>> > Sent from my iPhone
>>> >
>>> > On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi <mu...@gmail.com>
>>> wrote:
>>> >
>>> >> Hello Community,
>>> >>
>>> >> Is there any document/blog comparing different features offered by
>>> Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
>>> >>
>>> >> -Bharath
>>>
>>
>>
>>
>> --
>> "...:::Aniket:::... Quetzalco@tl"
>>
>>
>
>
> --
> Bertrand Dechoux
>
Re: Latest Pig vs Hive comparisons
Posted by Bertrand Dechoux <de...@gmail.com>.
Although the two first links are interesting reads, I would recommend you
the last one provided by Russel.
The key thing is not to think "I will choose the most efficient wrt
to performance" but "I will choose the most in tune with my use cases".
Secondly, HCatalog is really something worth mentioning. Basically, the
difference in format handling as explained in the other articles is less
hard-lined now.
Regards
Bertrand
On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney <ru...@gmail.com>wrote:
> A presentation on Hive vs Pig by a committer on both projects is here:
> http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/
>
>
> Russell Jurney
> twitter.com/rjurney
> russell.jurney@gmail.com
> datasyndrome.com
>
> On Sep 18, 2012, at 3:01 PM, Aniket Mokashi <an...@gmail.com> wrote:
>
> (Probably not what you are looking for) Check -
> http://www.larsgeorge.com/2009/10/hive-vs-pig.html
>
> ~Aniket
>
> On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney <ru...@gmail.com>wrote:
>
>> A detailed post comparing Pig/Hive performance from last week:
>> http://hortonworks.com/blog/pig-performance-and-optimization-analysis/
>>
>> Russell Jurney
>> twitter.com/rjurney
>> russell.jurney@gmail.com
>> datasyndrome.com
>>
>> On Sep 14, 2012, at 10:55 AM, Anurag Tangri <ta...@gmail.com>
>> wrote:
>>
>> > Knowing performance statistics would be good too.
>> >
>> > Sent from my iPhone
>> >
>> > On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi <mu...@gmail.com>
>> wrote:
>> >
>> >> Hello Community,
>> >>
>> >> Is there any document/blog comparing different features offered by Pig
>> 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
>> >>
>> >> -Bharath
>>
>
>
>
> --
> "...:::Aniket:::... Quetzalco@tl"
>
>
--
Bertrand Dechoux
Re: Latest Pig vs Hive comparisons
Posted by Russell Jurney <ru...@gmail.com>.
A presentation on Hive vs Pig by a committer on both projects is here:
http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/
Russell Jurney
twitter.com/rjurney
russell.jurney@gmail.com
datasyndrome.com
On Sep 18, 2012, at 3:01 PM, Aniket Mokashi <an...@gmail.com> wrote:
(Probably not what you are looking for) Check -
http://www.larsgeorge.com/2009/10/hive-vs-pig.html
~Aniket
On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney <ru...@gmail.com>wrote:
> A detailed post comparing Pig/Hive performance from last week:
> http://hortonworks.com/blog/pig-performance-and-optimization-analysis/
>
> Russell Jurney
> twitter.com/rjurney
> russell.jurney@gmail.com
> datasyndrome.com
>
> On Sep 14, 2012, at 10:55 AM, Anurag Tangri <ta...@gmail.com>
> wrote:
>
> > Knowing performance statistics would be good too.
> >
> > Sent from my iPhone
> >
> > On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi <mu...@gmail.com>
> wrote:
> >
> >> Hello Community,
> >>
> >> Is there any document/blog comparing different features offered by Pig
> 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
> >>
> >> -Bharath
>
--
"...:::Aniket:::... Quetzalco@tl"
Re: Latest Pig vs Hive comparisons
Posted by Aniket Mokashi <an...@gmail.com>.
(Probably not what you are looking for) Check -
http://www.larsgeorge.com/2009/10/hive-vs-pig.html
~Aniket
On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney <ru...@gmail.com>wrote:
> A detailed post comparing Pig/Hive performance from last week:
> http://hortonworks.com/blog/pig-performance-and-optimization-analysis/
>
> Russell Jurney
> twitter.com/rjurney
> russell.jurney@gmail.com
> datasyndrome.com
>
> On Sep 14, 2012, at 10:55 AM, Anurag Tangri <ta...@gmail.com>
> wrote:
>
> > Knowing performance statistics would be good too.
> >
> > Sent from my iPhone
> >
> > On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi <mu...@gmail.com>
> wrote:
> >
> >> Hello Community,
> >>
> >> Is there any document/blog comparing different features offered by Pig
> 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
> >>
> >> -Bharath
>
--
"...:::Aniket:::... Quetzalco@tl"
Re: Latest Pig vs Hive comparisons
Posted by Russell Jurney <ru...@gmail.com>.
A detailed post comparing Pig/Hive performance from last week:
http://hortonworks.com/blog/pig-performance-and-optimization-analysis/
Russell Jurney
twitter.com/rjurney
russell.jurney@gmail.com
datasyndrome.com
On Sep 14, 2012, at 10:55 AM, Anurag Tangri <ta...@gmail.com> wrote:
> Knowing performance statistics would be good too.
>
> Sent from my iPhone
>
> On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi <mu...@gmail.com> wrote:
>
>> Hello Community,
>>
>> Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
>>
>> -Bharath
Re: Latest Pig vs Hive comparisons
Posted by Anurag Tangri <ta...@gmail.com>.
Knowing performance statistics would be good too.
Sent from my iPhone
On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi <mu...@gmail.com> wrote:
> Hello Community,
>
> Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)?
>
> -Bharath