You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Alan Gates (JIRA)" <ji...@apache.org> on 2008/07/22 17:23:33 UTC

[jira] Created: (PIG-329) Queries with multiple, unconnected loads fail

Queries with multiple, unconnected loads fail
---------------------------------------------

                 Key: PIG-329
                 URL: https://issues.apache.org/jira/browse/PIG-329
             Project: Pig
          Issue Type: Bug
    Affects Versions: types_branch
            Reporter: Alan Gates
             Fix For: types_branch


testMultipleStore and testStoreWithMultipleMRJobs in TestStoreOld fail:

Testcase: testMultipleStore took 7.222 sec
    Caused an ERROR
Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
java.io.IOException: Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
    at org.apache.pig.PigServer.compileLp(PigServer.java:551)
    at org.apache.pig.PigServer.execute(PigServer.java:487)
    at org.apache.pig.PigServer.store(PigServer.java:331)
    at org.apache.pig.PigServer.store(PigServer.java:317)
    at org.apache.pig.PigServer.store(PigServer.java:302)
    at org.apache.pig.test.TestStoreOld.testMultipleStore(TestStoreOld.java:64)
Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
    ... 21 more
Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
    at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
    at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
    at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
    at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
    at org.apache.pig.PigServer.compileLp(PigServer.java:518)
    ... 20 more
Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
    at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
    at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
    at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
    at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
    at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
    at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
    ... 24 more

Testcase: testStoreWithMultipleMRJobs took 0.124 sec
    Caused an ERROR
Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
java.io.IOException: Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
    at org.apache.pig.PigServer.compileLp(PigServer.java:551)
    at org.apache.pig.PigServer.execute(PigServer.java:487)
    at org.apache.pig.PigServer.store(PigServer.java:331)
    at org.apache.pig.PigServer.store(PigServer.java:317)
    at org.apache.pig.PigServer.store(PigServer.java:302)
    at org.apache.pig.test.TestStoreOld.testStoreWithMultipleMRJobs(TestStoreOld.java:85)
Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
    ... 21 more
Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
    at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
    at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
    at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
    at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
    at org.apache.pig.PigServer.compileLp(PigServer.java:518)
    ... 20 more
Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
    at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
    at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
    at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
    at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
    at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
    at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
    ... 24 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-329) Queries with multiple, unconnected loads fail

Posted by "Pi Song (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12616005#action_12616005 ] 

Pi Song commented on PIG-329:
-----------------------------


The usage of SUM in the test is wrong. That's why the error message complains about type problem.

Here is the new error message.
{noformat}
Testcase: testMultipleStore took 30.544 sec
        Caused an ERROR
Unable to open iterator for alias: C [Job terminated with anomalous status FAILED]
java.io.IOException: Unable to open iterator for alias: C [Job terminated with anomalous status FAILED]
        at org.apache.pig.PigServer.openIterator(PigServer.java:281)
        at org.apache.pig.test.TestStoreOld.testMultipleStore(TestStoreOld.java:66)
Caused by: java.io.IOException: Job terminated with anomalous status FAILED

Testcase: testStoreWithMultipleMRJobs took 0.262 sec
        Caused an ERROR
Unable to store for alias: D [The output file(s): /tmp/temp1052178065/tmp-26634357 already exists]
java.io.IOException: Unable to store for alias: D [The output file(s): /tmp/temp1052178065/tmp-26634357 already exists]
        at org.apache.pig.PigServer.compileLp(PigServer.java:547)
        at org.apache.pig.PigServer.execute(PigServer.java:483)
        at org.apache.pig.PigServer.store(PigServer.java:327)
        at org.apache.pig.PigServer.store(PigServer.java:313)
        at org.apache.pig.PigServer.store(PigServer.java:298)
        at org.apache.pig.test.TestStoreOld.testStoreWithMultipleMRJobs(TestStoreOld.java:85)
Caused by: org.apache.pig.backend.executionengine.ExecException: The output file(s): /tmp/temp1052178065/tmp-26634357 already exists
{noformat}


> Queries with multiple, unconnected loads fail
> ---------------------------------------------
>
>                 Key: PIG-329
>                 URL: https://issues.apache.org/jira/browse/PIG-329
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Alan Gates
>             Fix For: types_branch
>
>
> testMultipleStore and testStoreWithMultipleMRJobs in TestStoreOld fail:
> Testcase: testMultipleStore took 7.222 sec
>     Caused an ERROR
> Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testMultipleStore(TestStoreOld.java:64)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more
> Testcase: testStoreWithMultipleMRJobs took 0.124 sec
>     Caused an ERROR
> Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testStoreWithMultipleMRJobs(TestStoreOld.java:85)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (PIG-329) Queries with multiple, unconnected loads fail

Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shravan Matthur Narayanamurthy updated PIG-329:
-----------------------------------------------

    Attachment: 329.patch

> Queries with multiple, unconnected loads fail
> ---------------------------------------------
>
>                 Key: PIG-329
>                 URL: https://issues.apache.org/jira/browse/PIG-329
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Alan Gates
>            Assignee: Shravan Matthur Narayanamurthy
>             Fix For: types_branch
>
>         Attachments: 329.patch
>
>
> testMultipleStore and testStoreWithMultipleMRJobs in TestStoreOld fail:
> Testcase: testMultipleStore took 7.222 sec
>     Caused an ERROR
> Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testMultipleStore(TestStoreOld.java:64)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more
> Testcase: testStoreWithMultipleMRJobs took 0.124 sec
>     Caused an ERROR
> Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testStoreWithMultipleMRJobs(TestStoreOld.java:85)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (PIG-329) Queries with multiple, unconnected loads fail

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich updated PIG-329:
-------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

thanks shravan for contributing

> Queries with multiple, unconnected loads fail
> ---------------------------------------------
>
>                 Key: PIG-329
>                 URL: https://issues.apache.org/jira/browse/PIG-329
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Alan Gates
>            Assignee: Shravan Matthur Narayanamurthy
>             Fix For: types_branch
>
>         Attachments: 329.patch
>
>
> testMultipleStore and testStoreWithMultipleMRJobs in TestStoreOld fail:
> Testcase: testMultipleStore took 7.222 sec
>     Caused an ERROR
> Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testMultipleStore(TestStoreOld.java:64)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more
> Testcase: testStoreWithMultipleMRJobs took 0.124 sec
>     Caused an ERROR
> Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testStoreWithMultipleMRJobs(TestStoreOld.java:85)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (PIG-329) Queries with multiple, unconnected loads fail

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich reassigned PIG-329:
----------------------------------

    Assignee: Shravan Matthur Narayanamurthy

> Queries with multiple, unconnected loads fail
> ---------------------------------------------
>
>                 Key: PIG-329
>                 URL: https://issues.apache.org/jira/browse/PIG-329
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Alan Gates
>            Assignee: Shravan Matthur Narayanamurthy
>             Fix For: types_branch
>
>
> testMultipleStore and testStoreWithMultipleMRJobs in TestStoreOld fail:
> Testcase: testMultipleStore took 7.222 sec
>     Caused an ERROR
> Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testMultipleStore(TestStoreOld.java:64)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more
> Testcase: testStoreWithMultipleMRJobs took 0.124 sec
>     Caused an ERROR
> Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testStoreWithMultipleMRJobs(TestStoreOld.java:85)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (PIG-329) Queries with multiple, unconnected loads fail

Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shravan Matthur Narayanamurthy updated PIG-329:
-----------------------------------------------

    Status: Patch Available  (was: Open)

There was a problem with FileLocalizer's random number generator being initialized with the same seed. Fixed that by doing a randomize the FileLocalizer's RNG before every compile in both launchers.

> Queries with multiple, unconnected loads fail
> ---------------------------------------------
>
>                 Key: PIG-329
>                 URL: https://issues.apache.org/jira/browse/PIG-329
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Alan Gates
>            Assignee: Shravan Matthur Narayanamurthy
>             Fix For: types_branch
>
>         Attachments: 329.patch
>
>
> testMultipleStore and testStoreWithMultipleMRJobs in TestStoreOld fail:
> Testcase: testMultipleStore took 7.222 sec
>     Caused an ERROR
> Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: B [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testMultipleStore(TestStoreOld.java:64)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more
> Testcase: testStoreWithMultipleMRJobs took 0.124 sec
>     Caused an ERROR
> Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}Severe problem found
> java.io.IOException: Unable to store for alias: D [Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null}}}
>     at org.apache.pig.PigServer.compileLp(PigServer.java:551)
>     at org.apache.pig.PigServer.execute(PigServer.java:487)
>     at org.apache.pig.PigServer.store(PigServer.java:331)
>     at org.apache.pig.PigServer.store(PigServer.java:317)
>     at org.apache.pig.PigServer.store(PigServer.java:302)
>     at org.apache.pig.test.TestStoreOld.testStoreWithMultipleMRJobs(TestStoreOld.java:85)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type
>     ... 21 more
> Caused by: org.apache.pig.impl.plan.PlanValidationException: An unexpected exception caused the validation to stop
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:104)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:40)
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingValidator.validate(TypeCheckingValidator.java:30)
>     at org.apache.pig.impl.logicalLayer.validators.LogicalPlanValidationExecutor.validate(LogicalPlanValidationExecutor.java:79)
>     at org.apache.pig.PigServer.compileLp(PigServer.java:518)
>     ... 20 more
> Caused by: org.apache.pig.impl.plan.VisitorException: Problem resolving LOForEach schema org.apache.pig.builtin.SUM does not work with inputs of type {{A: {null
>     at org.apache.pig.impl.logicalLayer.validators.TypeCheckingVisitor.visit(TypeCheckingVisitor.java:2205)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
>     at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
>     at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
>     at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
>     at org.apache.pig.impl.plan.PlanValidator.validateSkipCollectException(PlanValidator.java:101)
>     ... 24 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.