You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Olga Natkovich <ol...@yahoo-inc.com> on 2011/07/29 22:25:20 UTC
Pig 0.9.0 has been released!
Pig team is happy to announce Pig 0.9.0 release.
Apache Pig provides a high-level data-flow language and execution framework for parallel computation on Hadoop clusters. More details about Pig can be found at http://pig.apache.org/.
The highlights of this release are introduction of control structures, change of query parser, and semantic cleanup. The details of the release can be found at http://pig.apache.org/releases.html.
Olga
Re: Pig 0.9.0 has been released!
Posted by Christopher Smith <cb...@gmail.com>.
Thanks for the pointer Daniel! I always feel like a challenge with Pig
releases is getting a detailed description of all the changes. Doing
diffs on the docs is not exactly an efficient approach. ;-)
--Chris
On Fri, Jul 29, 2011 at 2:02 PM, Daniel Dai <da...@hortonworks.com> wrote:
> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> http://www.hortonworks.com/blog/. This serial contains three blogs and will
> be published in a few days.
>
> Thanks
> Daniel
>
> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com> wrote:
>
>> Pig team is happy to announce Pig 0.9.0 release.
>>
>> Apache Pig provides a high-level data-flow language and execution framework
>> for parallel computation on Hadoop clusters. More details about Pig can be
>> found at http://pig.apache.org/.
>>
>> The highlights of this release are introduction of control structures,
>> change of query parser, and semantic cleanup. The details of the release can
>> be found at http://pig.apache.org/releases.html.
>>
>> Olga
>>
>>
>
--
Chris
Re: Pig 0.9.0 has been released!
Posted by Daniel Eklund <do...@gmail.com>.
thanks guys... can't wait to try out the new release
On Fri, Jul 29, 2011 at 5:02 PM, Daniel Dai <da...@hortonworks.com> wrote:
> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> http://www.hortonworks.com/blog/. This serial contains three blogs and
> will
> be published in a few days.
>
> Thanks
> Daniel
>
> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
> wrote:
>
> > Pig team is happy to announce Pig 0.9.0 release.
> >
> > Apache Pig provides a high-level data-flow language and execution
> framework
> > for parallel computation on Hadoop clusters. More details about Pig can
> be
> > found at http://pig.apache.org/.
> >
> > The highlights of this release are introduction of control structures,
> > change of query parser, and semantic cleanup. The details of the release
> can
> > be found at http://pig.apache.org/releases.html.
> >
> > Olga
> >
> >
>
Re: Pig 0.9.0 has been released!
Posted by Shubham Chopra <sh...@gmail.com>.
Thanks for the documentation links!
~Shubham.
On Wed, Aug 24, 2011 at 1:21 PM, Alan Gates <ga...@hortonworks.com> wrote:
> Embedding in Python in 0.9 is still done via Java object. That is why we
> require Jython to execute the Python. The major differences are that we
> presented a very simple interface (compile, bind, run) that was designed
> with iterative and parallel execution in mind. We also made the bin/pig
> shell script that starts pig aware of Python so that the Python script
> itself can be passed to Pig. This allows Pig to do things like return
> proper line numbers for error messages.
>
> For a couple of great blogs on using the new interface, see
> http://www.hortonworks.com/pagerank-implementation-in-pig/ and
> http://www.hortonworks.com/transitive-closure-in-apache-pig/ For
> embedding docs see http://pig.apache.org/docs/r0.9.0/cont.html For API
> docs on the new interface see
> http://pig.apache.org/docs/r0.9.0/api/org/apache/pig/scripting/Pig.html
>
> Alan.
>
> On Aug 24, 2011, at 8:07 AM, Shubham Chopra wrote:
>
> > I am new to pig-0.9 and was exploring the embedding feature. I was
> wondering
> > how is python embedding introduced in pig-0.9 different from embedded
> > piglatin that could be used with java/scala? Any pointers to
> > blogs/documentation about the same would be really great!
> >
> > Thanks,
> > Shubham.
> >
> > On Fri, Jul 29, 2011 at 5:06 PM, Jeremy Hanna <
> jeremy.hanna1234@gmail.com>wrote:
> >
> >> Nice work Daniel and all on the release and the blog posts! Looking
> >> forward to the other two. We'll be testing out on our stuff because of
> all
> >> the great features added.
> >>
> >> On Jul 29, 2011, at 4:02 PM, Daniel Dai wrote:
> >>
> >>> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> >>> http://www.hortonworks.com/blog/. This serial contains three blogs and
> >> will
> >>> be published in a few days.
> >>>
> >>> Thanks
> >>> Daniel
> >>>
> >>> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
> >> wrote:
> >>>
> >>>> Pig team is happy to announce Pig 0.9.0 release.
> >>>>
> >>>> Apache Pig provides a high-level data-flow language and execution
> >> framework
> >>>> for parallel computation on Hadoop clusters. More details about Pig
> can
> >> be
> >>>> found at http://pig.apache.org/.
> >>>>
> >>>> The highlights of this release are introduction of control structures,
> >>>> change of query parser, and semantic cleanup. The details of the
> release
> >> can
> >>>> be found at http://pig.apache.org/releases.html.
> >>>>
> >>>> Olga
> >>>>
> >>>>
> >>
> >>
>
>
Re: Pig 0.9.0 has been released!
Posted by Alan Gates <ga...@hortonworks.com>.
Embedding in Python in 0.9 is still done via Java object. That is why we require Jython to execute the Python. The major differences are that we presented a very simple interface (compile, bind, run) that was designed with iterative and parallel execution in mind. We also made the bin/pig shell script that starts pig aware of Python so that the Python script itself can be passed to Pig. This allows Pig to do things like return proper line numbers for error messages.
For a couple of great blogs on using the new interface, see http://www.hortonworks.com/pagerank-implementation-in-pig/ and http://www.hortonworks.com/transitive-closure-in-apache-pig/ For embedding docs see http://pig.apache.org/docs/r0.9.0/cont.html For API docs on the new interface see http://pig.apache.org/docs/r0.9.0/api/org/apache/pig/scripting/Pig.html
Alan.
On Aug 24, 2011, at 8:07 AM, Shubham Chopra wrote:
> I am new to pig-0.9 and was exploring the embedding feature. I was wondering
> how is python embedding introduced in pig-0.9 different from embedded
> piglatin that could be used with java/scala? Any pointers to
> blogs/documentation about the same would be really great!
>
> Thanks,
> Shubham.
>
> On Fri, Jul 29, 2011 at 5:06 PM, Jeremy Hanna <je...@gmail.com>wrote:
>
>> Nice work Daniel and all on the release and the blog posts! Looking
>> forward to the other two. We'll be testing out on our stuff because of all
>> the great features added.
>>
>> On Jul 29, 2011, at 4:02 PM, Daniel Dai wrote:
>>
>>> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
>>> http://www.hortonworks.com/blog/. This serial contains three blogs and
>> will
>>> be published in a few days.
>>>
>>> Thanks
>>> Daniel
>>>
>>> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
>> wrote:
>>>
>>>> Pig team is happy to announce Pig 0.9.0 release.
>>>>
>>>> Apache Pig provides a high-level data-flow language and execution
>> framework
>>>> for parallel computation on Hadoop clusters. More details about Pig can
>> be
>>>> found at http://pig.apache.org/.
>>>>
>>>> The highlights of this release are introduction of control structures,
>>>> change of query parser, and semantic cleanup. The details of the release
>> can
>>>> be found at http://pig.apache.org/releases.html.
>>>>
>>>> Olga
>>>>
>>>>
>>
>>
Re: Pig 0.9.0 has been released!
Posted by Shubham Chopra <sh...@gmail.com>.
I am new to pig-0.9 and was exploring the embedding feature. I was wondering
how is python embedding introduced in pig-0.9 different from embedded
piglatin that could be used with java/scala? Any pointers to
blogs/documentation about the same would be really great!
Thanks,
Shubham.
On Fri, Jul 29, 2011 at 5:06 PM, Jeremy Hanna <je...@gmail.com>wrote:
> Nice work Daniel and all on the release and the blog posts! Looking
> forward to the other two. We'll be testing out on our stuff because of all
> the great features added.
>
> On Jul 29, 2011, at 4:02 PM, Daniel Dai wrote:
>
> > We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> > http://www.hortonworks.com/blog/. This serial contains three blogs and
> will
> > be published in a few days.
> >
> > Thanks
> > Daniel
> >
> > On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
> wrote:
> >
> >> Pig team is happy to announce Pig 0.9.0 release.
> >>
> >> Apache Pig provides a high-level data-flow language and execution
> framework
> >> for parallel computation on Hadoop clusters. More details about Pig can
> be
> >> found at http://pig.apache.org/.
> >>
> >> The highlights of this release are introduction of control structures,
> >> change of query parser, and semantic cleanup. The details of the release
> can
> >> be found at http://pig.apache.org/releases.html.
> >>
> >> Olga
> >>
> >>
>
>
Re: Pig 0.9.0 has been released!
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
Some excellent work in this release, thanks for all the hard work guys.
The docs! The blog posts! It's a whole new Pig :).
D
On Fri, Jul 29, 2011 at 2:06 PM, Jeremy Hanna <je...@gmail.com>wrote:
> Nice work Daniel and all on the release and the blog posts! Looking
> forward to the other two. We'll be testing out on our stuff because of all
> the great features added.
>
> On Jul 29, 2011, at 4:02 PM, Daniel Dai wrote:
>
> > We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> > http://www.hortonworks.com/blog/. This serial contains three blogs and
> will
> > be published in a few days.
> >
> > Thanks
> > Daniel
> >
> > On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
> wrote:
> >
> >> Pig team is happy to announce Pig 0.9.0 release.
> >>
> >> Apache Pig provides a high-level data-flow language and execution
> framework
> >> for parallel computation on Hadoop clusters. More details about Pig can
> be
> >> found at http://pig.apache.org/.
> >>
> >> The highlights of this release are introduction of control structures,
> >> change of query parser, and semantic cleanup. The details of the release
> can
> >> be found at http://pig.apache.org/releases.html.
> >>
> >> Olga
> >>
> >>
>
>
Re: Pig 0.9.0 has been released!
Posted by Jeremy Hanna <je...@gmail.com>.
Nice work Daniel and all on the release and the blog posts! Looking forward to the other two. We'll be testing out on our stuff because of all the great features added.
On Jul 29, 2011, at 4:02 PM, Daniel Dai wrote:
> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> http://www.hortonworks.com/blog/. This serial contains three blogs and will
> be published in a few days.
>
> Thanks
> Daniel
>
> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com> wrote:
>
>> Pig team is happy to announce Pig 0.9.0 release.
>>
>> Apache Pig provides a high-level data-flow language and execution framework
>> for parallel computation on Hadoop clusters. More details about Pig can be
>> found at http://pig.apache.org/.
>>
>> The highlights of this release are introduction of control structures,
>> change of query parser, and semantic cleanup. The details of the release can
>> be found at http://pig.apache.org/releases.html.
>>
>> Olga
>>
>>
Re: Pig 0.9.0 has been released!
Posted by Christopher Smith <cb...@gmail.com>.
Thanks for the pointer Daniel! I always feel like a challenge with Pig
releases is getting a detailed description of all the changes. Doing
diffs on the docs is not exactly an efficient approach. ;-)
--Chris
On Fri, Jul 29, 2011 at 2:02 PM, Daniel Dai <da...@hortonworks.com> wrote:
> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> http://www.hortonworks.com/blog/. This serial contains three blogs and will
> be published in a few days.
>
> Thanks
> Daniel
>
> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com> wrote:
>
>> Pig team is happy to announce Pig 0.9.0 release.
>>
>> Apache Pig provides a high-level data-flow language and execution framework
>> for parallel computation on Hadoop clusters. More details about Pig can be
>> found at http://pig.apache.org/.
>>
>> The highlights of this release are introduction of control structures,
>> change of query parser, and semantic cleanup. The details of the release can
>> be found at http://pig.apache.org/releases.html.
>>
>> Olga
>>
>>
>
--
Chris
RE: Pig 0.9.0 has been released!
Posted by Olga Natkovich <ol...@yahoo-inc.com>.
I think it is a good idea to have standard macros. I do not believe we have plans for that but feel free to contribute. We should definitely expand piggybank to include those.
Olga
-----Original Message-----
From: Raghu Angadi [mailto:angadi@gmail.com]
Sent: Sunday, July 31, 2011 7:07 PM
To: user@pig.apache.org
Subject: Re: Pig 0.9.0 has been released!
great to see major user facing features. Thanks guys.
Will we see some standard macros (e.g. rowcount()) similar to standard
UDFs?
Even rowcount may not be trivial for casual user to do correctly. Should
rowcount() example in the blog should COUNT_STAR() rather than COUNT()?
Raghu.
On Fri, Jul 29, 2011 at 2:02 PM, Daniel Dai <da...@hortonworks.com> wrote:
> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> http://www.hortonworks.com/blog/. This serial contains three blogs and
> will
> be published in a few days.
>
> Thanks
> Daniel
>
> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
> wrote:
>
> > Pig team is happy to announce Pig 0.9.0 release.
> >
> > Apache Pig provides a high-level data-flow language and execution
> framework
> > for parallel computation on Hadoop clusters. More details about Pig can
> be
> > found at http://pig.apache.org/.
> >
> > The highlights of this release are introduction of control structures,
> > change of query parser, and semantic cleanup. The details of the release
> can
> > be found at http://pig.apache.org/releases.html.
> >
> > Olga
> >
> >
>
Re: Pig 0.9.0 has been released!
Posted by Daniel Dai <da...@hortonworks.com>.
On Sun, Jul 31, 2011 at 7:06 PM, Raghu Angadi <an...@gmail.com> wrote:
> great to see major user facing features. Thanks guys.
>
> Will we see some standard macros (e.g. rowcount()) similar to standard
> UDFs?
>
> Even rowcount may not be trivial for casual user to do correctly. Should
> rowcount() example in the blog should COUNT_STAR() rather than COUNT()?
>
Yes, thanks pointing it out. I put a note on the blog.
>
> Raghu.
>
> On Fri, Jul 29, 2011 at 2:02 PM, Daniel Dai <da...@hortonworks.com> wrote:
>
> > We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> > http://www.hortonworks.com/blog/. This serial contains three blogs and
> > will
> > be published in a few days.
> >
> > Thanks
> > Daniel
> >
> > On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
> > wrote:
> >
> > > Pig team is happy to announce Pig 0.9.0 release.
> > >
> > > Apache Pig provides a high-level data-flow language and execution
> > framework
> > > for parallel computation on Hadoop clusters. More details about Pig can
> > be
> > > found at http://pig.apache.org/.
> > >
> > > The highlights of this release are introduction of control structures,
> > > change of query parser, and semantic cleanup. The details of the
> release
> > can
> > > be found at http://pig.apache.org/releases.html.
> > >
> > > Olga
> > >
> > >
> >
>
Re: Pig 0.9.0 has been released!
Posted by Raghu Angadi <an...@gmail.com>.
great to see major user facing features. Thanks guys.
Will we see some standard macros (e.g. rowcount()) similar to standard
UDFs?
Even rowcount may not be trivial for casual user to do correctly. Should
rowcount() example in the blog should COUNT_STAR() rather than COUNT()?
Raghu.
On Fri, Jul 29, 2011 at 2:02 PM, Daniel Dai <da...@hortonworks.com> wrote:
> We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
> http://www.hortonworks.com/blog/. This serial contains three blogs and
> will
> be published in a few days.
>
> Thanks
> Daniel
>
> On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com>
> wrote:
>
> > Pig team is happy to announce Pig 0.9.0 release.
> >
> > Apache Pig provides a high-level data-flow language and execution
> framework
> > for parallel computation on Hadoop clusters. More details about Pig can
> be
> > found at http://pig.apache.org/.
> >
> > The highlights of this release are introduction of control structures,
> > change of query parser, and semantic cleanup. The details of the release
> can
> > be found at http://pig.apache.org/releases.html.
> >
> > Olga
> >
> >
>
Re: Pig 0.9.0 has been released!
Posted by Daniel Dai <da...@hortonworks.com>.
We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
http://www.hortonworks.com/blog/. This serial contains three blogs and will
be published in a few days.
Thanks
Daniel
On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com> wrote:
> Pig team is happy to announce Pig 0.9.0 release.
>
> Apache Pig provides a high-level data-flow language and execution framework
> for parallel computation on Hadoop clusters. More details about Pig can be
> found at http://pig.apache.org/.
>
> The highlights of this release are introduction of control structures,
> change of query parser, and semantic cleanup. The details of the release can
> be found at http://pig.apache.org/releases.html.
>
> Olga
>
>
Re: Pig 0.9.0 has been released!
Posted by Daniel Dai <da...@hortonworks.com>.
We wrote a serial of blogs to describe the new feature of Pig 0.9.0 on
http://www.hortonworks.com/blog/. This serial contains three blogs and will
be published in a few days.
Thanks
Daniel
On Fri, Jul 29, 2011 at 1:25 PM, Olga Natkovich <ol...@yahoo-inc.com> wrote:
> Pig team is happy to announce Pig 0.9.0 release.
>
> Apache Pig provides a high-level data-flow language and execution framework
> for parallel computation on Hadoop clusters. More details about Pig can be
> found at http://pig.apache.org/.
>
> The highlights of this release are introduction of control structures,
> change of query parser, and semantic cleanup. The details of the release can
> be found at http://pig.apache.org/releases.html.
>
> Olga
>
>