You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Bill Graham <bi...@gmail.com> on 2013/02/07 22:24:28 UTC
Pig 11 release notes - draft
Hi,
In the Pig 11 release I'd like to include some specifics in the
RELEASE_NOTES.txt file. Julien compiled this list (which I've tweaked a
bit). Please give it a read and let me know if we've missed anything big,
or mis-stated anything. Maybe an absentee agenda item suggestion for those
at the meetup? :)
(I ran into some distractions this past week with cutting a release
candidate, but doing so is still high on my list. Stay tuned...)
- New RANK, CUBE and ROLLUP operators
- New DateType and Boolean data types
- Support for Groovy UDFs
- Support for loading macros from jars
- Support for custom PigReducerEstimators
- Suoport for custom PigProgressNotificatonListeners
- Support for schema-based Tuples for reduced memory footprint
- Support for passing environment variables to streaming jobs
- New cleanupOnSuccess method in StoreFunc interface
- UDF timing utilities
- UDF lifecycle improvements
- Performance improvements to merge join
- Performance improvements to local mode
- Performance improvements to algebraics in-memory aggregation
- Performance improvements to Spillable management
- Performance improvements to HBaseStorage
- Performance improvements to AvroStorage
- Penny has been removed
- 300+ bug fixes
*
*
thanks,
Bill
Re: Pig 11 release notes - draft
Posted by Bill Graham <bi...@gmail.com>.
This is great, thanks guys.
On Fri, Feb 8, 2013 at 12:36 PM, Prashant Kommireddi <pr...@gmail.com>wrote:
> Hey Bill,
>
> There are also a few new builtins for better Map support
> https://issues.apache.org/jira/browse/PIG-2600
> A way to load pig statements at startup
> https://issues.apache.org/jira/browse/PIG-2456
>
> -Prashant
>
> On Thu, Feb 7, 2013 at 3:11 PM, Rohini Palaniswamy
> <ro...@gmail.com>wrote:
>
> > This is something Daniel mentioned in his talk in pig meetup and is
> missing
> > in this list
> >
> > PIG-2482 - Integrate HCat DDL command into Pig
> >
> > Also there are a lot of UDFs added for DateTime datatype. A mention of
> that
> > would be good.
> >
> > Regards,
> > Rohini
> >
> >
> > On Thu, Feb 7, 2013 at 2:27 PM, Rohini Palaniswamy
> > <ro...@gmail.com>wrote:
> >
> > > Boolean data type is available from 0.10
> > >
> > > Regards,
> > > Rohini
> > >
> > >
> > > On Thu, Feb 7, 2013 at 1:24 PM, Bill Graham <bi...@gmail.com>
> > wrote:
> > >
> > >> Hi,
> > >>
> > >> In the Pig 11 release I'd like to include some specifics in the
> > >> RELEASE_NOTES.txt file. Julien compiled this list (which I've tweaked
> a
> > >> bit). Please give it a read and let me know if we've missed anything
> > big,
> > >> or mis-stated anything. Maybe an absentee agenda item suggestion for
> > those
> > >> at the meetup? :)
> > >>
> > >> (I ran into some distractions this past week with cutting a release
> > >> candidate, but doing so is still high on my list. Stay tuned...)
> > >>
> > >> - New RANK, CUBE and ROLLUP operators
> > >> - New DateType and Boolean data types
> > >> - Support for Groovy UDFs
> > >> - Support for loading macros from jars
> > >> - Support for custom PigReducerEstimators
> > >> - Suoport for custom PigProgressNotificatonListeners
> > >> - Support for schema-based Tuples for reduced memory footprint
> > >> - Support for passing environment variables to streaming jobs
> > >> - New cleanupOnSuccess method in StoreFunc interface
> > >> - UDF timing utilities
> > >> - UDF lifecycle improvements
> > >> - Performance improvements to merge join
> > >> - Performance improvements to local mode
> > >> - Performance improvements to algebraics in-memory aggregation
> > >> - Performance improvements to Spillable management
> > >> - Performance improvements to HBaseStorage
> > >> - Performance improvements to AvroStorage
> > >> - Penny has been removed
> > >> - 300+ bug fixes
> > >> *
> > >> *
> > >>
> > >> thanks,
> > >> Bill
> > >>
> > >
> > >
> >
>
--
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*
Re: Pig 11 release notes - draft
Posted by Prashant Kommireddi <pr...@gmail.com>.
Hey Bill,
There are also a few new builtins for better Map support
https://issues.apache.org/jira/browse/PIG-2600
A way to load pig statements at startup
https://issues.apache.org/jira/browse/PIG-2456
-Prashant
On Thu, Feb 7, 2013 at 3:11 PM, Rohini Palaniswamy
<ro...@gmail.com>wrote:
> This is something Daniel mentioned in his talk in pig meetup and is missing
> in this list
>
> PIG-2482 - Integrate HCat DDL command into Pig
>
> Also there are a lot of UDFs added for DateTime datatype. A mention of that
> would be good.
>
> Regards,
> Rohini
>
>
> On Thu, Feb 7, 2013 at 2:27 PM, Rohini Palaniswamy
> <ro...@gmail.com>wrote:
>
> > Boolean data type is available from 0.10
> >
> > Regards,
> > Rohini
> >
> >
> > On Thu, Feb 7, 2013 at 1:24 PM, Bill Graham <bi...@gmail.com>
> wrote:
> >
> >> Hi,
> >>
> >> In the Pig 11 release I'd like to include some specifics in the
> >> RELEASE_NOTES.txt file. Julien compiled this list (which I've tweaked a
> >> bit). Please give it a read and let me know if we've missed anything
> big,
> >> or mis-stated anything. Maybe an absentee agenda item suggestion for
> those
> >> at the meetup? :)
> >>
> >> (I ran into some distractions this past week with cutting a release
> >> candidate, but doing so is still high on my list. Stay tuned...)
> >>
> >> - New RANK, CUBE and ROLLUP operators
> >> - New DateType and Boolean data types
> >> - Support for Groovy UDFs
> >> - Support for loading macros from jars
> >> - Support for custom PigReducerEstimators
> >> - Suoport for custom PigProgressNotificatonListeners
> >> - Support for schema-based Tuples for reduced memory footprint
> >> - Support for passing environment variables to streaming jobs
> >> - New cleanupOnSuccess method in StoreFunc interface
> >> - UDF timing utilities
> >> - UDF lifecycle improvements
> >> - Performance improvements to merge join
> >> - Performance improvements to local mode
> >> - Performance improvements to algebraics in-memory aggregation
> >> - Performance improvements to Spillable management
> >> - Performance improvements to HBaseStorage
> >> - Performance improvements to AvroStorage
> >> - Penny has been removed
> >> - 300+ bug fixes
> >> *
> >> *
> >>
> >> thanks,
> >> Bill
> >>
> >
> >
>
Re: Pig 11 release notes - draft
Posted by Rohini Palaniswamy <ro...@gmail.com>.
This is something Daniel mentioned in his talk in pig meetup and is missing
in this list
PIG-2482 - Integrate HCat DDL command into Pig
Also there are a lot of UDFs added for DateTime datatype. A mention of that
would be good.
Regards,
Rohini
On Thu, Feb 7, 2013 at 2:27 PM, Rohini Palaniswamy
<ro...@gmail.com>wrote:
> Boolean data type is available from 0.10
>
> Regards,
> Rohini
>
>
> On Thu, Feb 7, 2013 at 1:24 PM, Bill Graham <bi...@gmail.com> wrote:
>
>> Hi,
>>
>> In the Pig 11 release I'd like to include some specifics in the
>> RELEASE_NOTES.txt file. Julien compiled this list (which I've tweaked a
>> bit). Please give it a read and let me know if we've missed anything big,
>> or mis-stated anything. Maybe an absentee agenda item suggestion for those
>> at the meetup? :)
>>
>> (I ran into some distractions this past week with cutting a release
>> candidate, but doing so is still high on my list. Stay tuned...)
>>
>> - New RANK, CUBE and ROLLUP operators
>> - New DateType and Boolean data types
>> - Support for Groovy UDFs
>> - Support for loading macros from jars
>> - Support for custom PigReducerEstimators
>> - Suoport for custom PigProgressNotificatonListeners
>> - Support for schema-based Tuples for reduced memory footprint
>> - Support for passing environment variables to streaming jobs
>> - New cleanupOnSuccess method in StoreFunc interface
>> - UDF timing utilities
>> - UDF lifecycle improvements
>> - Performance improvements to merge join
>> - Performance improvements to local mode
>> - Performance improvements to algebraics in-memory aggregation
>> - Performance improvements to Spillable management
>> - Performance improvements to HBaseStorage
>> - Performance improvements to AvroStorage
>> - Penny has been removed
>> - 300+ bug fixes
>> *
>> *
>>
>> thanks,
>> Bill
>>
>
>
Re: Pig 11 release notes - draft
Posted by Julien Le Dem <ju...@twitter.com>.
FYI, here is the presentation about new features in Pig-0.11 by Daniel
http://www.slideshare.net/hortonworks/new-features-in-pig-011
On Thu, Feb 7, 2013 at 2:27 PM, Rohini Palaniswamy
<ro...@gmail.com>wrote:
> Boolean data type is available from 0.10
>
> Regards,
> Rohini
>
>
> On Thu, Feb 7, 2013 at 1:24 PM, Bill Graham <bi...@gmail.com> wrote:
>
> > Hi,
> >
> > In the Pig 11 release I'd like to include some specifics in the
> > RELEASE_NOTES.txt file. Julien compiled this list (which I've tweaked a
> > bit). Please give it a read and let me know if we've missed anything big,
> > or mis-stated anything. Maybe an absentee agenda item suggestion for
> those
> > at the meetup? :)
> >
> > (I ran into some distractions this past week with cutting a release
> > candidate, but doing so is still high on my list. Stay tuned...)
> >
> > - New RANK, CUBE and ROLLUP operators
> > - New DateType and Boolean data types
> > - Support for Groovy UDFs
> > - Support for loading macros from jars
> > - Support for custom PigReducerEstimators
> > - Suoport for custom PigProgressNotificatonListeners
> > - Support for schema-based Tuples for reduced memory footprint
> > - Support for passing environment variables to streaming jobs
> > - New cleanupOnSuccess method in StoreFunc interface
> > - UDF timing utilities
> > - UDF lifecycle improvements
> > - Performance improvements to merge join
> > - Performance improvements to local mode
> > - Performance improvements to algebraics in-memory aggregation
> > - Performance improvements to Spillable management
> > - Performance improvements to HBaseStorage
> > - Performance improvements to AvroStorage
> > - Penny has been removed
> > - 300+ bug fixes
> > *
> > *
> >
> > thanks,
> > Bill
> >
>
Re: Pig 11 release notes - draft
Posted by Rohini Palaniswamy <ro...@gmail.com>.
Boolean data type is available from 0.10
Regards,
Rohini
On Thu, Feb 7, 2013 at 1:24 PM, Bill Graham <bi...@gmail.com> wrote:
> Hi,
>
> In the Pig 11 release I'd like to include some specifics in the
> RELEASE_NOTES.txt file. Julien compiled this list (which I've tweaked a
> bit). Please give it a read and let me know if we've missed anything big,
> or mis-stated anything. Maybe an absentee agenda item suggestion for those
> at the meetup? :)
>
> (I ran into some distractions this past week with cutting a release
> candidate, but doing so is still high on my list. Stay tuned...)
>
> - New RANK, CUBE and ROLLUP operators
> - New DateType and Boolean data types
> - Support for Groovy UDFs
> - Support for loading macros from jars
> - Support for custom PigReducerEstimators
> - Suoport for custom PigProgressNotificatonListeners
> - Support for schema-based Tuples for reduced memory footprint
> - Support for passing environment variables to streaming jobs
> - New cleanupOnSuccess method in StoreFunc interface
> - UDF timing utilities
> - UDF lifecycle improvements
> - Performance improvements to merge join
> - Performance improvements to local mode
> - Performance improvements to algebraics in-memory aggregation
> - Performance improvements to Spillable management
> - Performance improvements to HBaseStorage
> - Performance improvements to AvroStorage
> - Penny has been removed
> - 300+ bug fixes
> *
> *
>
> thanks,
> Bill
>