Is there any good way to validate the pig scripts

[zhang jianfeng <zj...@gmail.com>]

Hi all,

Here I want to generate report based on pig scripts, and to insure the
quality of report I need some way to validate the pig scripts.

Is there any good way to validate it ?  and I am interested to know how
yahoo validate the pig scripts.


Best regards,

Jeff Zhang

RE: Is there any good way to validate the pig scripts

[Olga Natkovich <ol...@yahoo-inc.com>]

This patch has already been committed. If you ran against the trunk you
will have SAMPLE operator.

Olga 

> -----Original Message-----
> From: Amr Awadallah [mailto:aaa@cloudera.com] 
> Sent: Monday, May 11, 2009 12:11 PM
> To: pig-user@hadoop.apache.org
> Subject: Re: Is there any good way to validate the pig scripts
> 
> run it on a sample of the dataset and check output.
> 
> this sampling patch should prove helpful for that:
> 
> https://issues.apache.org/jira/browse/PIG-795
> 
> -- amr
> 
> zhang jianfeng wrote:
> > Hi all,
> >
> > Here I want to generate report based on pig scripts, and to 
> insure the 
> > quality of report I need some way to validate the pig scripts.
> >
> > Is there any good way to validate it ?  and I am interested to know 
> > how yahoo validate the pig scripts.
> >
> >
> > Best regards,
> >
> > Jeff Zhang
> >
> >   
> 

Re: Is there any good way to validate the pig scripts

[Amr Awadallah <aa...@cloudera.com>]

run it on a sample of the dataset and check output.

this sampling patch should prove helpful for that:

https://issues.apache.org/jira/browse/PIG-795

-- amr

zhang jianfeng wrote:
> Hi all,
>
> Here I want to generate report based on pig scripts, and to insure the
> quality of report I need some way to validate the pig scripts.
>
> Is there any good way to validate it ?  and I am interested to know how
> yahoo validate the pig scripts.
>
>
> Best regards,
>
> Jeff Zhang
>
>