You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Keren Ouaknine <ke...@gmail.com> on 2011/08/26 03:47:43 UTC
running pigmix scripts
Hello,
On https://issues.apache.org/jira/browse/PIG-200, one can find the scripts
to generate data. But the data seems generic, meaning no relation to the
pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix
There are three other patch files, containing a mixture of shell commands
and java code. One cant run these as is..
Is there someone in the community, who has a clean Hadoop env with pig and
checked the performance using pigmix and could publish the scripts to:
1. generate the data with the right parameters (file names, num of rows,
etc)
2. launch the pigmix scripts
Thanks,
Keren
--
Keren Ouaknine
Cell: +972 54 2565404
Web: www.kereno.com
Re: running pigmix scripts
Posted by Daniel Dai <da...@hortonworks.com>.
You only need to apply pigmix2.patch. Instruction is here:
https://issues.apache.org/jira/browse/PIG-200?focusedCommentId=12879256&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-12879256
Daniel
On Thu, Aug 25, 2011 at 8:08 PM, Keren Ouaknine <ke...@gmail.com> wrote:
> Hello Ashutosh,
>
> The files on PIG-200 are:
> - Generate_data.pl - generates pseudo-random data, no relation to scripts
> 1-17
> - 4 patches files each containing a mixture of java code and shell
> commands.
> These are not ready-to-use scripts for running pigmix..
>
> As for the results published, I cant use these as my purpose is to measure
> pig's performance against:
> - MR performance
> - HPCC performance
>
> Thus, I need to re-run the queries on my own cluster.
>
> Thanks,
> Keren
>
> On Fri, Aug 26, 2011 at 5:18 AM, Ashutosh Chauhan <ha...@apache.org>wrote:
>
>> Hey Keren,
>>
>> PIG-200 contains script meant precisely for PigMix queries. Can you be more
>> elaborate in why you are not able to use them. w.r.t numbers PigMix wiki
>> page you pointed contains the performance numbers though dated.
>>
>> Hope it helps,
>> Ashutosh
>>
>> On Thu, Aug 25, 2011 at 18:47, Keren Ouaknine <ke...@gmail.com> wrote:
>>
>> > Hello,
>> >
>> > On https://issues.apache.org/jira/browse/PIG-200, one can find the
>> scripts
>> > to generate data. But the data seems generic, meaning no relation to the
>> > pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix
>> >
>> > There are three other patch files, containing a mixture of shell commands
>> > and java code. One cant run these as is..
>> >
>> > Is there someone in the community, who has a clean Hadoop env with pig
>> and
>> > checked the performance using pigmix and could publish the scripts to:
>> > 1. generate the data with the right parameters (file names, num of rows,
>> > etc)
>> > 2. launch the pigmix scripts
>> >
>> > Thanks,
>> > Keren
>> >
>> > --
>> > Keren Ouaknine
>> > Cell: +972 54 2565404
>> > Web: www.kereno.com
>> >
>>
>
>
>
> --
> Keren Ouaknine
> Cell: +972 54 2565404
> Web: www.kereno.com
>
Re: running pigmix scripts
Posted by Keren Ouaknine <ke...@gmail.com>.
Hello Ashutosh,
The files on PIG-200 are:
- Generate_data.pl - generates pseudo-random data, no relation to scripts
1-17
- 4 patches files each containing a mixture of java code and shell
commands.
These are not ready-to-use scripts for running pigmix..
As for the results published, I cant use these as my purpose is to measure
pig's performance against:
- MR performance
- HPCC performance
Thus, I need to re-run the queries on my own cluster.
Thanks,
Keren
On Fri, Aug 26, 2011 at 5:18 AM, Ashutosh Chauhan <ha...@apache.org>wrote:
> Hey Keren,
>
> PIG-200 contains script meant precisely for PigMix queries. Can you be more
> elaborate in why you are not able to use them. w.r.t numbers PigMix wiki
> page you pointed contains the performance numbers though dated.
>
> Hope it helps,
> Ashutosh
>
> On Thu, Aug 25, 2011 at 18:47, Keren Ouaknine <ke...@gmail.com> wrote:
>
> > Hello,
> >
> > On https://issues.apache.org/jira/browse/PIG-200, one can find the
> scripts
> > to generate data. But the data seems generic, meaning no relation to the
> > pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix
> >
> > There are three other patch files, containing a mixture of shell commands
> > and java code. One cant run these as is..
> >
> > Is there someone in the community, who has a clean Hadoop env with pig
> and
> > checked the performance using pigmix and could publish the scripts to:
> > 1. generate the data with the right parameters (file names, num of rows,
> > etc)
> > 2. launch the pigmix scripts
> >
> > Thanks,
> > Keren
> >
> > --
> > Keren Ouaknine
> > Cell: +972 54 2565404
> > Web: www.kereno.com
> >
>
--
Keren Ouaknine
Cell: +972 54 2565404
Web: www.kereno.com
Re: running pigmix scripts
Posted by Ashutosh Chauhan <ha...@apache.org>.
Hey Keren,
PIG-200 contains script meant precisely for PigMix queries. Can you be more
elaborate in why you are not able to use them. w.r.t numbers PigMix wiki
page you pointed contains the performance numbers though dated.
Hope it helps,
Ashutosh
On Thu, Aug 25, 2011 at 18:47, Keren Ouaknine <ke...@gmail.com> wrote:
> Hello,
>
> On https://issues.apache.org/jira/browse/PIG-200, one can find the scripts
> to generate data. But the data seems generic, meaning no relation to the
> pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix
>
> There are three other patch files, containing a mixture of shell commands
> and java code. One cant run these as is..
>
> Is there someone in the community, who has a clean Hadoop env with pig and
> checked the performance using pigmix and could publish the scripts to:
> 1. generate the data with the right parameters (file names, num of rows,
> etc)
> 2. launch the pigmix scripts
>
> Thanks,
> Keren
>
> --
> Keren Ouaknine
> Cell: +972 54 2565404
> Web: www.kereno.com
>