You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Dan Li (JIRA)" <ji...@apache.org> on 2012/06/27 01:17:44 UTC
[jira] [Created] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Dan Li created PIG-2769:
---------------------------
Summary: a simple logic causes very long compiling time on pig 0.10.0
Key: PIG-2769
URL: https://issues.apache.org/jira/browse/PIG-2769
Project: Pig
Issue Type: Bug
Components: build
Affects Versions: 0.10.0
Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
Reporter: Dan Li
Fix For: 0.10.0
Attachments: case1.tar
We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
A = load 'A.txt' using PigStorage() AS (m: int);
B = FOREACH A {
days_str = (chararray)
(m == 1 ? 31:
(m == 2 ? 28:
(m == 3 ? 31:
(m == 4 ? 30:
(m == 5 ? 31:
(m == 6 ? 30:
(m == 7 ? 31:
(m == 8 ? 31:
(m == 9 ? 30:
(m == 10 ? 31:
(m == 11 ? 30:31)))))))))));
GENERATE
days_str as days_str;
}
store B into 'B';
and here's a simple input file example: A.txt
1
2
3
The pig version we used in the test
Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13410620#comment-13410620 ]
Daniel Dai commented on PIG-2769:
---------------------------------
What is revision 12316246? Where did you get this?
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Dan Li (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13411717#comment-13411717 ]
Dan Li commented on PIG-2769:
-----------------------------
Hi, Daniel,
I'm little bit confused. is this problem fixed or not?
Thanks.
Dan
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Dan Li (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401785#comment-13401785 ]
Dan Li commented on PIG-2769:
-----------------------------
It's worth pointing out that Pig 0.9.2 also runs quickly; we only see the degradation with Pig 0.10.0.
The degradation in performance seems to have a knee as 4 or 5 conditionals works as expected but as presented, the script takes about 6 minutes at the GRUNT> prompt after hitting enter; before any Hadoop execution.
-Clay
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.10.0
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13411811#comment-13411811 ]
Daniel Dai commented on PIG-2769:
---------------------------------
No, it is not fixed. 5 min to compile a plan is not acceptable. I am not saying a particular version works, just to post what I observe. Sorry for the confusion. We need to fix it.
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401790#comment-13401790 ]
Jonathan Coveney commented on PIG-2769:
---------------------------------------
My guess is that this has to do with recursive backtracking.
from QueryParser.g
{code}
foreach_statement : ( ( alias EQUAL )? FOREACH rel LEFT_CURLY ) => foreach_complex_statement
| foreach_simple_statement
;
{code}
The fact that it works fine up until some n and then dies is typical of when these things die. It could be some interaction with another recursive backtracking rule that is blowing up.
The ideal solution is to get rid of recursive backtracking in the parser...
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.10.0
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thejas M Nair updated PIG-2769:
-------------------------------
Assignee: Timothy Chen
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Assignee: Timothy Chen
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13469592#comment-13469592 ]
Thejas M Nair commented on PIG-2769:
------------------------------------
I have assigned it to you. I have also added you to contributors list, now you should be able to assign jiras to yourself.
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Assignee: Timothy Chen
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Timothy Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Timothy Chen updated PIG-2769:
------------------------------
Fix Version/s: (was: 0.11)
0.12
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Assignee: Timothy Chen
> Fix For: 0.12
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Timothy Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13481538#comment-13481538 ]
Timothy Chen commented on PIG-2769:
-----------------------------------
I decided to leave this issue open to grab for now since this issue is mostly in the ANTLR generated code and I am still learning about ANTLR.
It does seems that it's recursively calling foreach_complex_statement pretty excessively, but I don't have enough knowledge to deduce the grammer so it still works.
I did verify that the AST generated in 0.9.2 and 0.10-SNAPSHOT generated is exactly the same if that helps.
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.12
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Timothy Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13469587#comment-13469587 ]
Timothy Chen commented on PIG-2769:
-----------------------------------
I'd like to look at this for my first bug fix for pig, as I've already glanced through the parsing and query plan code. Can't find a way to assign this to myself via Jira though, probably need someone else to do so?
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Timothy Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Timothy Chen updated PIG-2769:
------------------------------
Assignee: (was: Timothy Chen)
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.12
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2769:
----------------------------
Fix Version/s: (was: 0.10.0)
0.11
It takes me 5 min to compile the logical plan.
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Dan Li (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13411968#comment-13411968 ]
Dan Li commented on PIG-2769:
-----------------------------
Thanks for the clarification, and looking forward to the fix.
Dan
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Dan Li (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13410628#comment-13410628 ]
Dan Li commented on PIG-2769:
-----------------------------
>From your comment on 27/Jun/12 18:43, is the number [ 12316246 ] the revision number?
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Dan Li (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dan Li updated PIG-2769:
------------------------
Attachment: case1.tar
example code and data file
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.10.0
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2769) a simple logic causes very long
compiling time on pig 0.10.0
Posted by "Dan Li (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13410611#comment-13410611 ]
Dan Li commented on PIG-2769:
-----------------------------
Hi, Daniel,
I tried to check out the revision 0.10.0 [ 12316246 ] , but got "No such revision 12316246" error. The command I used is following
svn co -r 12316246 http://svn.apache.org/repos/asf/pig/branches/branch-0.10/
Thanks.
Dan
> a simple logic causes very long compiling time on pig 0.10.0
> ------------------------------------------------------------
>
> Key: PIG-2769
> URL: https://issues.apache.org/jira/browse/PIG-2769
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.10.0
> Environment: Apache Pig version 0.10.0-SNAPSHOT (rexported)
> Reporter: Dan Li
> Fix For: 0.11
>
> Attachments: case1.tar
>
>
> We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.
> A = load 'A.txt' using PigStorage() AS (m: int);
> B = FOREACH A {
> days_str = (chararray)
> (m == 1 ? 31:
> (m == 2 ? 28:
> (m == 3 ? 31:
> (m == 4 ? 30:
> (m == 5 ? 31:
> (m == 6 ? 30:
> (m == 7 ? 31:
> (m == 8 ? 31:
> (m == 9 ? 30:
> (m == 10 ? 31:
> (m == 11 ? 30:31)))))))))));
> GENERATE
> days_str as days_str;
> }
> store B into 'B';
> and here's a simple input file example: A.txt
> 1
> 2
> 3
> The pig version we used in the test
> Apache Pig version 0.10.0-SNAPSHOT (rexported)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira