You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Doug Luu <Do...@nominum.com> on 2010/04/09 02:09:05 UTC
Question: Whey this pig script failed ?
Here are my input: file 'lala'
a
b
c
d
File 'lele':
b
c
Here are my pig commands:
A = load 'lala' as (url);
B = load 'lele' as (url);
joining = join A by url left outer, B by url USING "replicated";
C = FILTER joining by $1 is null;
I expect to see C = (a,) (d,)
Instead, I got err msg when I dumped C. Details followed
[root@domU-12-31-39-03-75-58 ~]# pig -x local
2010-04-08 20:04:53,352 [main] INFO org.apache.pig.Main - Logging error messages to: /root/pig_1270771493352.log
grunt> A = load 'lala' as (url);
grunt> B = load 'lele' as (url);
grunt> joining = join A by url left outer, B by url USING "replicated";
grunt> dump joining;
2010-04-08 20:05:04,502 [main] WARN org.apache.pig.impl.io.FileLocalizer - FileLocalizer.create: failed to create /tmp/temp808841686
2010-04-08 20:05:04,528 [main] INFO org.apache.pig.backend.local.executionengine.LocalPigLauncher - Successfully stored result in: "file:/tmp/temp808841686/tmp-405093673"
2010-04-08 20:05:04,537 [main] INFO org.apache.pig.backend.local.executionengine.LocalPigLauncher - Records written : 4
2010-04-08 20:05:04,537 [main] INFO org.apache.pig.backend.local.executionengine.LocalPigLauncher - Bytes written : 70
2010-04-08 20:05:04,537 [main] INFO org.apache.pig.backend.local.executionengine.LocalPigLauncher - 100% complete!
2010-04-08 20:05:04,537 [main] INFO org.apache.pig.backend.local.executionengine.LocalPigLauncher - Success!!
(a,)
(b,b)
(c,c)
(d,)
grunt> C = FILTER joining by $1 is null;
grunt> describe C;
C: {A::url: bytearray,B::url: bytearray}
grunt> dump C;
2010-04-08 20:05:17,555 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1002: Unable to store alias C
Details at logfile: /root/pig_1270771493352.log
Re: Question: Whey this pig script failed ?
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
Judging by org.apache.pig.backend.local.executionengine.LocalPigLauncher,
he's on < 0.7
On Fri, Apr 9, 2010 at 10:39 AM, Richard Ding <rd...@yahoo-inc.com> wrote:
> Which version of Pig are you using? The script works with Pig jar built
> from trunk.
>
> Thanks,
> -Richard
> -----Original Message-----
> From: Dmitriy Ryaboy [mailto:dvryaboy@gmail.com]
> Sent: Thursday, April 08, 2010 5:43 PM
> To: pig-user@hadoop.apache.org
> Subject: Re: Question: Whey this pig script failed ?
>
> Using replicated mode is not supported in local mode.
> Do you get this error in mapreduce mode?
>
> -Dmitriy
>
> On Thu, Apr 8, 2010 at 5:09 PM, Doug Luu <Do...@nominum.com> wrote:
>
> > Here are my input: file 'lala'
> > a
> > b
> > c
> > d
> >
> > File 'lele':
> > b
> > c
> >
> > Here are my pig commands:
> >
> > A = load 'lala' as (url);
> > B = load 'lele' as (url);
> > joining = join A by url left outer, B by url USING "replicated";
> > C = FILTER joining by $1 is null;
> >
> > I expect to see C = (a,) (d,)
> > Instead, I got err msg when I dumped C. Details followed
> >
> >
> > [root@domU-12-31-39-03-75-58 ~]# pig -x local
> > 2010-04-08 20:04:53,352 [main] INFO org.apache.pig.Main - Logging
> error
> > messages to: /root/pig_1270771493352.log
> > grunt> A = load 'lala' as (url);
> > grunt> B = load 'lele' as (url);
> > grunt> joining = join A by url left outer, B by url USING
> "replicated";
> > grunt> dump joining;
> > 2010-04-08 20:05:04,502 [main] WARN
> org.apache.pig.impl.io.FileLocalizer -
> > FileLocalizer.create: failed to create /tmp/temp808841686
> > 2010-04-08 20:05:04,528 [main] INFO
> > org.apache.pig.backend.local.executionengine.LocalPigLauncher -
> > Successfully stored result in: "file:/tmp/temp808841686/tmp-405093673"
> > 2010-04-08 20:05:04,537 [main] INFO
> > org.apache.pig.backend.local.executionengine.LocalPigLauncher -
> Records
> > written : 4
> > 2010-04-08 20:05:04,537 [main] INFO
> > org.apache.pig.backend.local.executionengine.LocalPigLauncher - Bytes
> > written : 70
> > 2010-04-08 20:05:04,537 [main] INFO
> > org.apache.pig.backend.local.executionengine.LocalPigLauncher - 100%
> > complete!
> > 2010-04-08 20:05:04,537 [main] INFO
> > org.apache.pig.backend.local.executionengine.LocalPigLauncher -
> Success!!
> > (a,)
> > (b,b)
> > (c,c)
> > (d,)
> > grunt> C = FILTER joining by $1 is null;
> > grunt> describe C;
> > C: {A::url: bytearray,B::url: bytearray}
> > grunt> dump C;
> > 2010-04-08 20:05:17,555 [main] ERROR org.apache.pig.tools.grunt.Grunt
> -
> > ERROR 1002: Unable to store alias C
> > Details at logfile: /root/pig_1270771493352.log
> >
>
RE: Question: Whey this pig script failed ?
Posted by Richard Ding <rd...@yahoo-inc.com>.
Which version of Pig are you using? The script works with Pig jar built
from trunk.
Thanks,
-Richard
-----Original Message-----
From: Dmitriy Ryaboy [mailto:dvryaboy@gmail.com]
Sent: Thursday, April 08, 2010 5:43 PM
To: pig-user@hadoop.apache.org
Subject: Re: Question: Whey this pig script failed ?
Using replicated mode is not supported in local mode.
Do you get this error in mapreduce mode?
-Dmitriy
On Thu, Apr 8, 2010 at 5:09 PM, Doug Luu <Do...@nominum.com> wrote:
> Here are my input: file 'lala'
> a
> b
> c
> d
>
> File 'lele':
> b
> c
>
> Here are my pig commands:
>
> A = load 'lala' as (url);
> B = load 'lele' as (url);
> joining = join A by url left outer, B by url USING "replicated";
> C = FILTER joining by $1 is null;
>
> I expect to see C = (a,) (d,)
> Instead, I got err msg when I dumped C. Details followed
>
>
> [root@domU-12-31-39-03-75-58 ~]# pig -x local
> 2010-04-08 20:04:53,352 [main] INFO org.apache.pig.Main - Logging
error
> messages to: /root/pig_1270771493352.log
> grunt> A = load 'lala' as (url);
> grunt> B = load 'lele' as (url);
> grunt> joining = join A by url left outer, B by url USING
"replicated";
> grunt> dump joining;
> 2010-04-08 20:05:04,502 [main] WARN
org.apache.pig.impl.io.FileLocalizer -
> FileLocalizer.create: failed to create /tmp/temp808841686
> 2010-04-08 20:05:04,528 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher -
> Successfully stored result in: "file:/tmp/temp808841686/tmp-405093673"
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher -
Records
> written : 4
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher - Bytes
> written : 70
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher - 100%
> complete!
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher -
Success!!
> (a,)
> (b,b)
> (c,c)
> (d,)
> grunt> C = FILTER joining by $1 is null;
> grunt> describe C;
> C: {A::url: bytearray,B::url: bytearray}
> grunt> dump C;
> 2010-04-08 20:05:17,555 [main] ERROR org.apache.pig.tools.grunt.Grunt
-
> ERROR 1002: Unable to store alias C
> Details at logfile: /root/pig_1270771493352.log
>
Re: Question: Whey this pig script failed ?
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
Using replicated mode is not supported in local mode.
Do you get this error in mapreduce mode?
-Dmitriy
On Thu, Apr 8, 2010 at 5:09 PM, Doug Luu <Do...@nominum.com> wrote:
> Here are my input: file 'lala'
> a
> b
> c
> d
>
> File 'lele':
> b
> c
>
> Here are my pig commands:
>
> A = load 'lala' as (url);
> B = load 'lele' as (url);
> joining = join A by url left outer, B by url USING "replicated";
> C = FILTER joining by $1 is null;
>
> I expect to see C = (a,) (d,)
> Instead, I got err msg when I dumped C. Details followed
>
>
> [root@domU-12-31-39-03-75-58 ~]# pig -x local
> 2010-04-08 20:04:53,352 [main] INFO org.apache.pig.Main - Logging error
> messages to: /root/pig_1270771493352.log
> grunt> A = load 'lala' as (url);
> grunt> B = load 'lele' as (url);
> grunt> joining = join A by url left outer, B by url USING "replicated";
> grunt> dump joining;
> 2010-04-08 20:05:04,502 [main] WARN org.apache.pig.impl.io.FileLocalizer -
> FileLocalizer.create: failed to create /tmp/temp808841686
> 2010-04-08 20:05:04,528 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher -
> Successfully stored result in: "file:/tmp/temp808841686/tmp-405093673"
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher - Records
> written : 4
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher - Bytes
> written : 70
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher - 100%
> complete!
> 2010-04-08 20:05:04,537 [main] INFO
> org.apache.pig.backend.local.executionengine.LocalPigLauncher - Success!!
> (a,)
> (b,b)
> (c,c)
> (d,)
> grunt> C = FILTER joining by $1 is null;
> grunt> describe C;
> C: {A::url: bytearray,B::url: bytearray}
> grunt> dump C;
> 2010-04-08 20:05:17,555 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 1002: Unable to store alias C
> Details at logfile: /root/pig_1270771493352.log
>