Re: Pig Status/Documentation

[Derek Springer <de...@gmail.com>]

Hi all,
My colleagues and I are interested in if there is any update on the status
of the items we discussed previously (documentation, tutorials, development
environment, etc). We are still excited to dig deeper with pig and would
appreciate any help! Thanks!

Derek Springer
UCLA CS Department

On Sat, Apr 5, 2008 at 7:04 AM, Chris Olston <ol...@yahoo-inc.com> wrote:

> Hi Derek,
>
> We just got word that a documentation writer will be joining our team (part
> time), so we should be able to improve the documentation a great deal over
> the next few months (will take a while to ramp up). For now, the current
> apache wiki will have to do (sorry, it's not very good), but feel free to
> ask lots of questions on this mailing list.
>
> We are in the process of constructing a comprehensive tutorial of Pig, that
> would walk you through installation and running a sample program over a
> public data set. We expect to have the tutorial done this month.
>
> As for the development environment, Shubham Chopra (cc'ed) has the token on
> that -- it's done and just needs to be pushed through the Apache commit
> process. Shubham: what's the ETA on getting that into the codebase? Will you
> be able to submit the patch for review within the next week?
>
> -Chris
>
>
>
> On Apr 4, 2008, at 1:32 PM, Derek Springer wrote:
>
>  Hi all,
>> I am currently a grad student in the Computer Science Department at UCLA
>> under Dr. Alfonso Cardenas. After communicating with Chris Olston we have
>> become interested in utilizing Pig for a number of our research projects.
>> To
>> that end, my colleagues and I were interested in if there are any
>> comprehensive documentation or guides that might assist us in implementing
>> Pig in our projects. We have had some success from the examples in the
>> wiki,
>> but we are definitely interested in really digging deep into what Pig can
>> do!
>>
>> Additionally, we are curious to know when the upcoming Pig development
>> environment is planning to be released. Is there a time frame outlined to
>> when we can expect this?
>>
>> Thanks!
>> Derek Springer
>>
>
> --
> Christopher Olston, Ph.D.
> Sr. Research Scientist
> Yahoo! Research
>
>
>

Re: Pig Status/Documentation

[Chris Olston <ol...@yahoo-inc.com>]

Hi Derek,

All of these items are moving forward, albeit more slowly than  
expected (as usual :). Here's the status:

documentation: the tech writer is working with us now and is  
currently getting up to speed.
tutorial: a draft is ready, and we are targeting June 1 to get it out  
on the web.
dev environment: the latest Pig release does include the "ILLUSTRATE"  
command, which is one of the components of our dev environment (makes  
it easier to play with pig scripts and see how data gets transformed  
by Pig commands). The eclipse plugin is still in the works.

-Chris


On May 7, 2008, at 1:32 PM, Derek Springer wrote:

> Hi all,
> My colleagues and I are interested in if there is any update on the  
> status
> of the items we discussed previously (documentation, tutorials,  
> development
> environment, etc). We are still excited to dig deeper with pig and  
> would
> appreciate any help! Thanks!
>
> Derek Springer
> UCLA CS Department
>
> On Sat, Apr 5, 2008 at 7:04 AM, Chris Olston <ol...@yahoo-inc.com>  
> wrote:
>
>> Hi Derek,
>>
>> We just got word that a documentation writer will be joining our  
>> team (part
>> time), so we should be able to improve the documentation a great  
>> deal over
>> the next few months (will take a while to ramp up). For now, the  
>> current
>> apache wiki will have to do (sorry, it's not very good), but feel  
>> free to
>> ask lots of questions on this mailing list.
>>
>> We are in the process of constructing a comprehensive tutorial of  
>> Pig, that
>> would walk you through installation and running a sample program  
>> over a
>> public data set. We expect to have the tutorial done this month.
>>
>> As for the development environment, Shubham Chopra (cc'ed) has the  
>> token on
>> that -- it's done and just needs to be pushed through the Apache  
>> commit
>> process. Shubham: what's the ETA on getting that into the  
>> codebase? Will you
>> be able to submit the patch for review within the next week?
>>
>> -Chris
>>
>>
>>
>> On Apr 4, 2008, at 1:32 PM, Derek Springer wrote:
>>
>>  Hi all,
>>> I am currently a grad student in the Computer Science Department  
>>> at UCLA
>>> under Dr. Alfonso Cardenas. After communicating with Chris Olston  
>>> we have
>>> become interested in utilizing Pig for a number of our research  
>>> projects.
>>> To
>>> that end, my colleagues and I were interested in if there are any
>>> comprehensive documentation or guides that might assist us in  
>>> implementing
>>> Pig in our projects. We have had some success from the examples  
>>> in the
>>> wiki,
>>> but we are definitely interested in really digging deep into what  
>>> Pig can
>>> do!
>>>
>>> Additionally, we are curious to know when the upcoming Pig  
>>> development
>>> environment is planning to be released. Is there a time frame  
>>> outlined to
>>> when we can expect this?
>>>
>>> Thanks!
>>> Derek Springer
>>>
>>
>> --
>> Christopher Olston, Ph.D.
>> Sr. Research Scientist
>> Yahoo! Research
>>
>>
>>

--
Christopher Olston, Ph.D.
Sr. Research Scientist
Yahoo! Research