You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "Vladimir Sitnikov (Jira)" <ji...@apache.org> on 2020/01/11 13:03:00 UTC

[jira] [Commented] (CALCITE-3660) PigRelBuilderStyleTest#testImplWithJoin fails with FrontendException: ERROR 1066: Unable to open iterator for alias t

    [ https://issues.apache.org/jira/browse/CALCITE-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013478#comment-17013478 ] 

Vladimir Sitnikov commented on CALCITE-3660:
--------------------------------------------

+1: https://github.com/apache/calcite/runs/384765819#step:5:966

> PigRelBuilderStyleTest#testImplWithJoin fails with FrontendException: ERROR 1066: Unable to open iterator for alias t
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: CALCITE-3660
>                 URL: https://issues.apache.org/jira/browse/CALCITE-3660
>             Project: Calcite
>          Issue Type: Bug
>          Components: pig-adapter
>    Affects Versions: 1.21.0
>            Reporter: Vladimir Sitnikov
>            Priority: Major
>
> Sample:
> https://github.com/vlsi/calcite/runs/369966426#step:5:1116
> {noformat}
> org.apache.calcite.test.PigRelBuilderStyleTest > testImplWithJoin() FAILED
>     org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias t
>         at org.apache.pig.PigServer.openIterator(PigServer.java:1019)
>         at org.apache.pig.pigunit.PigTest.getAliasFromCache(PigTest.java:224)
>         at org.apache.pig.pigunit.PigTest.getActualResults(PigTest.java:319)
>         at org.apache.pig.pigunit.PigTest.assertOutput(PigTest.java:385)
>         at org.apache.pig.pigunit.PigTest.assertOutputAnyOrder(PigTest.java:371)
>         at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(PigRelBuilderStyleTest.java:263)
>         at org.apache.calcite.test.PigRelBuilderStyleTest.testImplWithJoin(PigRelBuilderStyleTest.java:181)
>         Caused by:
>         java.io.IOException: Job terminated with anomalous status FAILED
>             at org.apache.pig.PigServer.openIterator(PigServer.java:1011)
>             ... 6 more
> {noformat}
> There's exception as well:
> {noformat}
> org.apache.calcite.test.PigRelBuilderStyleTest > testImplWithGroupByCountDistinct() STANDARD_OUT
>     2020-01-01 15:18:31,596 [LocalJobRunner Map Task Executor #0] WARN  - SchemaTupleBackend has already been initialized
>     STORE t INTO 'myoutput';
>     --> none
>     2020-01-01 15:18:31,734 [ForkJoinPool-1-worker-3] WARN  - SchemaTupleBackend has already been initialized
>     2020-01-01 15:18:31,758 [Thread-47] WARN  - job_local79466183_0002
>     java.lang.Exception: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Local Rearrange[tuple]{chararray}(false) - scope-24 Operator Key: scope-24): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Filter[bag] - scope-8 Operator Key: scope-8): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
>     	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
>     	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
>     Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Local Rearrange[tuple]{chararray}(false) - scope-24 Operator Key: scope-24): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Filter[bag] - scope-8 Operator Key: scope-8): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:314)
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNextTuple(POLocalRearrange.java:287)
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POUnion.getNextTuple(POUnion.java:167)
>     	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:280)
>     	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:275)
>     	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:65)
>     	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
>     	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>     	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>     	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
>     	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
>     	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>     	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
>     	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
>     	at java.base/java.lang.Thread.run(Thread.java:834)
>     Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Filter[bag] - scope-8 Operator Key: scope-8): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:314)
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNextTuple(POFilter.java:90)
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:305)
>     	... 14 more
>     Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNextTuple(POForEach.java:329)
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:305)
>     	... 16 more
>     Caused by: java.lang.RuntimeException: initialize was not called! Even when SchemaTuple feature is not set, it should be called.
>     	at org.apache.pig.data.SchemaTupleBackend.newSchemaTupleFactory(SchemaTupleBackend.java:301)
>     	at org.apache.pig.data.SchemaTupleFactory.getInstance(SchemaTupleFactory.java:119)
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:350)
>     	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNextTuple(POForEach.java:321)
>     	... 17 more
>     2020-01-01 15:18:31,853 [JobControl] WARN  - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
>     2020-01-01 15:18:31,865 [JobControl] WARN  - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
>     2020-01-01 15:18:31,929 [ForkJoinPool-1-worker-1] WARN  - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
>     2020-01-01 15:18:31,933 [ForkJoinPool-1-worker-1] ERROR - 1 map reduce job(s) failed!
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)