You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2009/07/16 03:35:14 UTC
[jira] Created: (PIG-888) Pig do not pass udf to the backend in
some situation
Pig do not pass udf to the backend in some situation
----------------------------------------------------
Key: PIG-888
URL: https://issues.apache.org/jira/browse/PIG-888
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.3.0
Reporter: Daniel Dai
Fix For: 0.4.0
If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
A = load '1.txt' using udf1();
B = load '2.txt';
C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-888:
---------------------------
Status: Patch Available (was: Open)
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732289#action_12732289 ]
Olga Natkovich commented on PIG-888:
------------------------------------
+1
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732224#action_12732224 ]
Daniel Dai commented on PIG-888:
--------------------------------
javac warning is caused by unchecked cast to a template class. By convention, we do not suppress this warning in Pig.
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732152#action_12732152 ]
Hadoop QA commented on PIG-888:
-------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12413624/PIG-888-2.patch
against trunk revision 793750.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 255 javac compiler warnings (more than the trunk's current 254 warnings).
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/130/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/130/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/130/console
This message is automatically generated.
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-888:
---------------------------
Status: In Progress (was: Patch Available)
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731816#action_12731816 ]
Hadoop QA commented on PIG-888:
-------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12413622/PIG-888-1.patch
against trunk revision 793750.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 255 javac compiler warnings (more than the trunk's current 254 warnings).
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/128/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/128/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/128/console
This message is automatically generated.
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-888:
---------------------------
Status: Patch Available (was: In Progress)
Resubmit for Hudson pick up the new patch.
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-888:
---------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732296#action_12732296 ]
Daniel Dai commented on PIG-888:
--------------------------------
Patch committed.
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai reassigned PIG-888:
------------------------------
Assignee: Daniel Dai
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-888:
---------------------------
Attachment: PIG-888-2.patch
New patch include unit test.
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732492#action_12732492 ]
Hudson commented on PIG-888:
----------------------------
Integrated in Pig-trunk #506 (See [http://hudson.zones.apache.org/hudson/job/Pig-trunk/506/])
: Pig do not pass udf to the backend in some situation
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch, PIG-888-2.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-888) Pig do not pass udf to the backend in
some situation
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-888:
---------------------------
Attachment: PIG-888-1.patch
The problem is that we didn't copy udf properly when we merge mrplan of different inputs in visitGlobalRearrange. Another related fix is that we should also deserialize import_list in PigInputFormat (as we did in https://issues.apache.org/jira/browse/PIG-883). I put these two fixes together in the patch.
> Pig do not pass udf to the backend in some situation
> ----------------------------------------------------
>
> Key: PIG-888
> URL: https://issues.apache.org/jira/browse/PIG-888
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.3.0
> Reporter: Daniel Dai
> Fix For: 0.4.0
>
> Attachments: PIG-888-1.patch
>
>
> If we use udf and do not use register, in some situation backend will complain that it cannot resolve class. For example, the following script do not work.
> A = load '1.txt' using udf1();
> B = load '2.txt';
> C = join A by $0, B by $0;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.