You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Paul O'Leary <po...@quantivo.com> on 2008/10/07 02:56:57 UTC
RE: DISTINCT Problem
Hi Olga et al,
I have made a little progress in figuring out what's going on for me
with the types branch.
When 'test\utils\dotGraph\parser\Dot.jj' is generated the first line of
the generated file looks like this:
/*@bgen(jjtree) Generated By:JJTree: Do not edit this line.
C:\dev\pig\test\org\apache\pig\test\utils\dotGraph\parser\Dot.jj */
/*@egen*/options {
Long story short it chokes - believe it or not - on the '\u' of
'...test\utils...' because it thinks it's a Unicode character. I
believe this is a known issue with Java compilation and it explains why
it seems to be a Windows-only problem.
Don't know what the 'fix' is for this (other than getting off Windows)
but I can work around the problem by whacking the JJ file directly.
However, when I do this (on the types branch) I seem to see a problem
where I can't execute any commands from the grunt shell. Every command
fails immediately with a parse error:
2008-10-06 17:51:31,421 [main] INFO
org.apache.pig.backend.hadoop.executionengi
ne.HExecutionEngine - Connecting to map-reduce job tracker at:
localhost:9001
grunt> ls
org.apache.pig.tools.pigscript.parser.ParseException: Encountered "l" at
line 1,
column 1.
Was expecting one of:
<EOF>
"cat" ...
"cd" ...
<snip>
Don't know if this is related to the same issue above or caused by my
having to whack the file or what...?
Anyway, this all goes back to the DISTINCT problem I was seeing. I'd be
happy to try to recreate the problem on the types branch if I can get it
built or someone can provide me with a JAR to test with.
Thanks,
PaulO.
-----Original Message-----
From: Olga Natkovich [mailto:olgan@yahoo-inc.com]
Sent: Thursday, September 25, 2008 12:28 PM
To: pig-dev@incubator.apache.org
Subject: RE: DISTINCT Problem
We are not seeing it on our builds but none of us run on Window. While
we figure out what is going on, I can send you a jar file build from
types branch. Are you running with Hadoop 17 or Hadoop 18 cluster?
Olga
> -----Original Message-----
> From: Paul O'Leary [mailto:poleary@quantivo.com]
> Sent: Thursday, September 25, 2008 11:27 AM
> To: pig-dev@incubator.apache.org
> Subject: RE: DISTINCT Problem
>
> Yes. I cannot currently compile the 'types' branch.
>
> -----Original Message-----
> From: Olga Natkovich [mailto:olgan@yahoo-inc.com]
> Sent: Thursday, September 25, 2008 11:16 AM
> To: pig-dev@incubator.apache.org
> Subject: RE: DISTINCT Problem
>
> Is this repeatable?
>
RE: DISTINCT Problem
Posted by Paul O'Leary <po...@quantivo.com>.
Olga,
Never saw any JAR file come through... lost in the mail?
Could you please try again? Happy to test this on my end.
Cheers,
PaulO.
-----Original Message-----
From: Olga Natkovich [mailto:olgan@yahoo-inc.com]
Sent: Tuesday, October 07, 2008 8:34 AM
To: pig-dev@incubator.apache.org
Subject: RE: DISTINCT Problem
Hi Paul,
Did you try the jar file that I sent you?
Olga
> -----Original Message-----
> From: Paul O'Leary [mailto:poleary@quantivo.com]
> Sent: Monday, October 06, 2008 5:57 PM
> To: pig-dev@incubator.apache.org
> Subject: RE: DISTINCT Problem
>
> Hi Olga et al,
>
> I have made a little progress in figuring out what's going on
> for me with the types branch.
>
> When 'test\utils\dotGraph\parser\Dot.jj' is generated the
> first line of the generated file looks like this:
>
> /*@bgen(jjtree) Generated By:JJTree: Do not edit this line.
> C:\dev\pig\test\org\apache\pig\test\utils\dotGraph\parser\Dot.
> jj */ /*@egen*/options {
>
> Long story short it chokes - believe it or not - on the '\u'
> of '...test\utils...' because it thinks it's a Unicode
> character. I believe this is a known issue with Java
> compilation and it explains why it seems to be a Windows-only problem.
>
> Don't know what the 'fix' is for this (other than getting off
> Windows) but I can work around the problem by whacking the JJ
> file directly.
>
> However, when I do this (on the types branch) I seem to see a
> problem where I can't execute any commands from the grunt
> shell. Every command fails immediately with a parse error:
>
> 2008-10-06 17:51:31,421 [main] INFO
> org.apache.pig.backend.hadoop.executionengi
> ne.HExecutionEngine - Connecting to map-reduce job tracker at:
> localhost:9001
> grunt> ls
> org.apache.pig.tools.pigscript.parser.ParseException:
> Encountered "l" at line 1, column 1.
> Was expecting one of:
> <EOF>
> "cat" ...
> "cd" ...
> <snip>
>
> Don't know if this is related to the same issue above or
> caused by my having to whack the file or what...?
>
> Anyway, this all goes back to the DISTINCT problem I was
> seeing. I'd be happy to try to recreate the problem on the
> types branch if I can get it built or someone can provide me
> with a JAR to test with.
>
> Thanks,
> PaulO.
>
> -----Original Message-----
> From: Olga Natkovich [mailto:olgan@yahoo-inc.com]
> Sent: Thursday, September 25, 2008 12:28 PM
> To: pig-dev@incubator.apache.org
> Subject: RE: DISTINCT Problem
>
> We are not seeing it on our builds but none of us run on
> Window. While we figure out what is going on, I can send you
> a jar file build from types branch. Are you running with
> Hadoop 17 or Hadoop 18 cluster?
>
> Olga
>
> > -----Original Message-----
> > From: Paul O'Leary [mailto:poleary@quantivo.com]
> > Sent: Thursday, September 25, 2008 11:27 AM
> > To: pig-dev@incubator.apache.org
> > Subject: RE: DISTINCT Problem
> >
> > Yes. I cannot currently compile the 'types' branch.
> >
> > -----Original Message-----
> > From: Olga Natkovich [mailto:olgan@yahoo-inc.com]
> > Sent: Thursday, September 25, 2008 11:16 AM
> > To: pig-dev@incubator.apache.org
> > Subject: RE: DISTINCT Problem
> >
> > Is this repeatable?
> >
>
>
>
RE: DISTINCT Problem
Posted by Olga Natkovich <ol...@yahoo-inc.com>.
Hi Paul,
Did you try the jar file that I sent you?
Olga
> -----Original Message-----
> From: Paul O'Leary [mailto:poleary@quantivo.com]
> Sent: Monday, October 06, 2008 5:57 PM
> To: pig-dev@incubator.apache.org
> Subject: RE: DISTINCT Problem
>
> Hi Olga et al,
>
> I have made a little progress in figuring out what's going on
> for me with the types branch.
>
> When 'test\utils\dotGraph\parser\Dot.jj' is generated the
> first line of the generated file looks like this:
>
> /*@bgen(jjtree) Generated By:JJTree: Do not edit this line.
> C:\dev\pig\test\org\apache\pig\test\utils\dotGraph\parser\Dot.
> jj */ /*@egen*/options {
>
> Long story short it chokes - believe it or not - on the '\u'
> of '...test\utils...' because it thinks it's a Unicode
> character. I believe this is a known issue with Java
> compilation and it explains why it seems to be a Windows-only problem.
>
> Don't know what the 'fix' is for this (other than getting off
> Windows) but I can work around the problem by whacking the JJ
> file directly.
>
> However, when I do this (on the types branch) I seem to see a
> problem where I can't execute any commands from the grunt
> shell. Every command fails immediately with a parse error:
>
> 2008-10-06 17:51:31,421 [main] INFO
> org.apache.pig.backend.hadoop.executionengi
> ne.HExecutionEngine - Connecting to map-reduce job tracker at:
> localhost:9001
> grunt> ls
> org.apache.pig.tools.pigscript.parser.ParseException:
> Encountered "l" at line 1, column 1.
> Was expecting one of:
> <EOF>
> "cat" ...
> "cd" ...
> <snip>
>
> Don't know if this is related to the same issue above or
> caused by my having to whack the file or what...?
>
> Anyway, this all goes back to the DISTINCT problem I was
> seeing. I'd be happy to try to recreate the problem on the
> types branch if I can get it built or someone can provide me
> with a JAR to test with.
>
> Thanks,
> PaulO.
>
> -----Original Message-----
> From: Olga Natkovich [mailto:olgan@yahoo-inc.com]
> Sent: Thursday, September 25, 2008 12:28 PM
> To: pig-dev@incubator.apache.org
> Subject: RE: DISTINCT Problem
>
> We are not seeing it on our builds but none of us run on
> Window. While we figure out what is going on, I can send you
> a jar file build from types branch. Are you running with
> Hadoop 17 or Hadoop 18 cluster?
>
> Olga
>
> > -----Original Message-----
> > From: Paul O'Leary [mailto:poleary@quantivo.com]
> > Sent: Thursday, September 25, 2008 11:27 AM
> > To: pig-dev@incubator.apache.org
> > Subject: RE: DISTINCT Problem
> >
> > Yes. I cannot currently compile the 'types' branch.
> >
> > -----Original Message-----
> > From: Olga Natkovich [mailto:olgan@yahoo-inc.com]
> > Sent: Thursday, September 25, 2008 11:16 AM
> > To: pig-dev@incubator.apache.org
> > Subject: RE: DISTINCT Problem
> >
> > Is this repeatable?
> >
>
>
>