You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Gianmarco De Francisci Morales (JIRA)" <ji...@apache.org> on 2010/08/07 15:48:15 UTC

[jira] Created: (PIG-1539) TestAccumulator fails on trunk

TestAccumulator fails on trunk
------------------------------

                 Key: PIG-1539
                 URL: https://issues.apache.org/jira/browse/PIG-1539
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: 0.8.0, 0.9.0
            Reporter: Gianmarco De Francisci Morales
            Priority: Minor


TestAccumulator fails systematically on trunk.
I have already tried 5 times with no success.
Once I got successful testing exit result but I still got errors in the log.

Here the error.

Testcase: testAccumWithBuildin took 17.202 sec
        Caused an ERROR
Unable to open iterator for alias D
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias D
        at org.apache.pig.PigServer.openIterator(PigServer.java:728)
        at org.apache.pig.test.TestAccumulator.testAccumWithBuildin(TestAccumulator.java:495)
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2088: Unable to get results for: hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957:org.apache.pig.impl.io.InterStorage
        at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:99)
        at org.apache.pig.PigServer.openIterator(PigServer.java:716)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigFileInputFormat.listStatus(PigFileInputFormat.java:37)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
        at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:153)
        at org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:115)
        at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:92)

Caused by this
INFO mapred.TaskInProgress: Error from attempt_20100807152543110_0002_r_000000_0: org.apache.pig.backend.executionengine.ExecException: ERROR 2078: Caught error from UDF: org.apache.pig.test.utils.AccumulatorBagCount [exec() should not be called.]
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:262)
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:283)
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:355)
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:291)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.runPipeline(PigMapReduce.java:435)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:403)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:383)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:251)
        at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
        at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
        at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.io.IOException: exec() should not be called.
        at org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:56)
        at org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:28)
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:229)
        ... 11 more



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-1539) TestAccumulator fails on trunk

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896322#action_12896322 ] 

Daniel Dai commented on PIG-1539:
---------------------------------

Hi, Gianmarco, 
I saw this error initially, but when I do an "ant clean" and rerun the test, the error go away. Can you try it?

> TestAccumulator fails on trunk
> ------------------------------
>
>                 Key: PIG-1539
>                 URL: https://issues.apache.org/jira/browse/PIG-1539
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Gianmarco De Francisci Morales
>            Priority: Minor
>
> TestAccumulator fails systematically on trunk.
> I have already tried 5 times with no success.
> Once I got successful testing exit result but I still got errors in the log.
> Here the error.
> Testcase: testAccumWithBuildin took 17.202 sec
>         Caused an ERROR
> Unable to open iterator for alias D
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias D
>         at org.apache.pig.PigServer.openIterator(PigServer.java:728)
>         at org.apache.pig.test.TestAccumulator.testAccumWithBuildin(TestAccumulator.java:495)
> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2088: Unable to get results for: hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957:org.apache.pig.impl.io.InterStorage
>         at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:99)
>         at org.apache.pig.PigServer.openIterator(PigServer.java:716)
> Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957
>         at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigFileInputFormat.listStatus(PigFileInputFormat.java:37)
>         at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
>         at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:153)
>         at org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:115)
>         at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:92)
> Caused by this
> INFO mapred.TaskInProgress: Error from attempt_20100807152543110_0002_r_000000_0: org.apache.pig.backend.executionengine.ExecException: ERROR 2078: Caught error from UDF: org.apache.pig.test.utils.AccumulatorBagCount [exec() should not be called.]
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:262)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:283)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:355)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:291)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.runPipeline(PigMapReduce.java:435)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:403)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:383)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:251)
>         at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
>         at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
>         at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.io.IOException: exec() should not be called.
>         at org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:56)
>         at org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:28)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:229)
>         ... 11 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (PIG-1539) TestAccumulator fails on trunk

Posted by "Gianmarco De Francisci Morales (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gianmarco De Francisci Morales resolved PIG-1539.
-------------------------------------------------

    Resolution: Fixed

Thanks Daniel.
It worked. I assume there are temp files that need to be cleaned up when testing with MiniCluster.
It might be worth opening a separate Jira for this.

> TestAccumulator fails on trunk
> ------------------------------
>
>                 Key: PIG-1539
>                 URL: https://issues.apache.org/jira/browse/PIG-1539
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Gianmarco De Francisci Morales
>            Priority: Minor
>
> TestAccumulator fails systematically on trunk.
> I have already tried 5 times with no success.
> Once I got successful testing exit result but I still got errors in the log.
> Here the error.
> Testcase: testAccumWithBuildin took 17.202 sec
>         Caused an ERROR
> Unable to open iterator for alias D
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias D
>         at org.apache.pig.PigServer.openIterator(PigServer.java:728)
>         at org.apache.pig.test.TestAccumulator.testAccumWithBuildin(TestAccumulator.java:495)
> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2088: Unable to get results for: hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957:org.apache.pig.impl.io.InterStorage
>         at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:99)
>         at org.apache.pig.PigServer.openIterator(PigServer.java:716)
> Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:37780/tmp/temp1145144453/tmp-630741957
>         at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigFileInputFormat.listStatus(PigFileInputFormat.java:37)
>         at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
>         at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:153)
>         at org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:115)
>         at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:92)
> Caused by this
> INFO mapred.TaskInProgress: Error from attempt_20100807152543110_0002_r_000000_0: org.apache.pig.backend.executionengine.ExecException: ERROR 2078: Caught error from UDF: org.apache.pig.test.utils.AccumulatorBagCount [exec() should not be called.]
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:262)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:283)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:355)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:291)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.runPipeline(PigMapReduce.java:435)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:403)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:383)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:251)
>         at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
>         at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
>         at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.io.IOException: exec() should not be called.
>         at org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:56)
>         at org.apache.pig.test.utils.AccumulatorBagCount.exec(AccumulatorBagCount.java:28)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:229)
>         ... 11 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.