You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2010/03/29 00:53:27 UTC

[jira] Created: (PIG-1335) UDFFinder should find LoadFunc used by POCast

UDFFinder should find LoadFunc used by POCast
---------------------------------------------

                 Key: PIG-1335
                 URL: https://issues.apache.org/jira/browse/PIG-1335
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: 0.7.0
            Reporter: Daniel Dai
            Assignee: Daniel Dai
         Attachments: PIG-1335-1.patch

UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:

{code}
a = load '1.txt' using CustomLoader() as (a0, a1, a2);
b = group a by a0;
c = foreach b generate flatten(a);
d = order c by a0;
e = foreach d generate(a1+a2);  -- use lineage
dump e;
{code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1335) UDFFinder should find LoadFunc used by POCast

Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851519#action_12851519 ] 

Richard Ding commented on PIG-1335:
-----------------------------------

+1

> UDFFinder should find LoadFunc used by POCast
> ---------------------------------------------
>
>                 Key: PIG-1335
>                 URL: https://issues.apache.org/jira/browse/PIG-1335
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: PIG-1335-1.patch
>
>
> UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:
> {code}
> a = load '1.txt' using CustomLoader() as (a0, a1, a2);
> b = group a by a0;
> c = foreach b generate flatten(a);
> d = order c by a0;
> e = foreach d generate(a1+a2);  -- use lineage
> dump e;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1335) UDFFinder should find LoadFunc used by POCast

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1335:
----------------------------

    Status: Patch Available  (was: Open)

> UDFFinder should find LoadFunc used by POCast
> ---------------------------------------------
>
>                 Key: PIG-1335
>                 URL: https://issues.apache.org/jira/browse/PIG-1335
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: PIG-1335-1.patch
>
>
> UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:
> {code}
> a = load '1.txt' using CustomLoader() as (a0, a1, a2);
> b = group a by a0;
> c = foreach b generate flatten(a);
> d = order c by a0;
> e = foreach d generate(a1+a2);  -- use lineage
> dump e;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1335) UDFFinder should find LoadFunc used by POCast

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1335:
----------------------------

    Fix Version/s: 0.7.0

> UDFFinder should find LoadFunc used by POCast
> ---------------------------------------------
>
>                 Key: PIG-1335
>                 URL: https://issues.apache.org/jira/browse/PIG-1335
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.7.0
>
>         Attachments: PIG-1335-1.patch
>
>
> UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:
> {code}
> a = load '1.txt' using CustomLoader() as (a0, a1, a2);
> b = group a by a0;
> c = foreach b generate flatten(a);
> d = order c by a0;
> e = foreach d generate(a1+a2);  -- use lineage
> dump e;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1335) UDFFinder should find LoadFunc used by POCast

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1335:
----------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Patch committed to both trunk and 0.7 branch.

> UDFFinder should find LoadFunc used by POCast
> ---------------------------------------------
>
>                 Key: PIG-1335
>                 URL: https://issues.apache.org/jira/browse/PIG-1335
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: PIG-1335-1.patch
>
>
> UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:
> {code}
> a = load '1.txt' using CustomLoader() as (a0, a1, a2);
> b = group a by a0;
> c = foreach b generate flatten(a);
> d = order c by a0;
> e = foreach d generate(a1+a2);  -- use lineage
> dump e;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (PIG-1335) UDFFinder should find LoadFunc used by POCast

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai closed PIG-1335.
---------------------------


> UDFFinder should find LoadFunc used by POCast
> ---------------------------------------------
>
>                 Key: PIG-1335
>                 URL: https://issues.apache.org/jira/browse/PIG-1335
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.7.0
>
>         Attachments: PIG-1335-1.patch
>
>
> UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:
> {code}
> a = load '1.txt' using CustomLoader() as (a0, a1, a2);
> b = group a by a0;
> c = foreach b generate flatten(a);
> d = order c by a0;
> e = foreach d generate(a1+a2);  -- use lineage
> dump e;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1335) UDFFinder should find LoadFunc used by POCast

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1335:
----------------------------

    Attachment: PIG-1335-1.patch

> UDFFinder should find LoadFunc used by POCast
> ---------------------------------------------
>
>                 Key: PIG-1335
>                 URL: https://issues.apache.org/jira/browse/PIG-1335
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: PIG-1335-1.patch
>
>
> UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:
> {code}
> a = load '1.txt' using CustomLoader() as (a0, a1, a2);
> b = group a by a0;
> c = foreach b generate flatten(a);
> d = order c by a0;
> e = foreach d generate(a1+a2);  -- use lineage
> dump e;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1335) UDFFinder should find LoadFunc used by POCast

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12850822#action_12850822 ] 

Hadoop QA commented on PIG-1335:
--------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12440020/PIG-1335-1.patch
  against trunk revision 928384.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    -1 release audit.  The applied patch generated 530 release audit warnings (more than the trunk's current 529 warnings).

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/254/testReport/
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/254/artifact/trunk/patchprocess/releaseAuditDiffWarnings.txt
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/254/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/254/console

This message is automatically generated.

> UDFFinder should find LoadFunc used by POCast
> ---------------------------------------------
>
>                 Key: PIG-1335
>                 URL: https://issues.apache.org/jira/browse/PIG-1335
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: PIG-1335-1.patch
>
>
> UDFFinder doesn't look into POCast so it will miss LoadFunc used by POCast for lineage. We could see "class not found" exception in some cases. Here is a sample script:
> {code}
> a = load '1.txt' using CustomLoader() as (a0, a1, a2);
> b = group a by a0;
> c = foreach b generate flatten(a);
> d = order c by a0;
> e = foreach d generate(a1+a2);  -- use lineage
> dump e;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.