You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Eli Levine <el...@gmail.com> on 2017/05/26 18:54:53 UTC

Intermittent failures using PigTest

Greetings, Pig community. I am using PigUnit (PigTest.java) in a unit
test in Apache Calcite [1] and have observed intermittent test
failures [2]. Happens somewhat often on Travis-CI builds. PigUnit
executes scripts locally and AFAIK the cause is file permissions but
it's difficult to tell for certain because reproducing locally is rare
and inconsistent.

Anyone experience anything like this?

Pig version is 0.16.0.

Here is the stack trace of the exception that occurs when it happens
(not very helpful):

Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.925
sec <<< FAILURE! - in org.apache.calcite.test.PigRelBuilderStyleTest
testImplWithGroupByCountDistinct(org.apache.calcite.test.PigRelBuilderStyleTest)
 Time elapsed: 0.676 sec  <<< ERROR!
java.lang.RuntimeException:
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
to open iterator for alias t
at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(PigRelBuilderStyleTest.java:253)
at org.apache.calcite.test.PigRelBuilderStyleTest.testImplWithGroupByCountDistinct(PigRelBuilderStyleTest.java:149)
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: Unable
to open iterator for alias t
at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(PigRelBuilderStyleTest.java:251)
at org.apache.calcite.test.PigRelBuilderStyleTest.testImplWithGroupByCountDistinct(PigRelBuilderStyleTest.java:149)
Caused by: java.io.IOException: Job terminated with anomalous status FAILED
at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(PigRelBuilderStyleTest.java:251)
at org.apache.calcite.test.PigRelBuilderStyleTest.testImplWithGroupByCountDistinct(PigRelBuilderStyleTest.java:149)

[1] https://github.com/apache/calcite/blob/master/pig/src/test/java/org/apache/calcite/test/PigRelBuilderStyleTest.java#L257
[2] https://issues.apache.org/jira/browse/CALCITE-1561?focusedCommentId=15901638&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15901638

Thanks!

Eli

Re: Intermittent failures using PigTest

Posted by Rohini Palaniswamy <ro...@gmail.com>.
It would help if you have the stacktrace for the job failure.

Regards,
Rohini

On Fri, May 26, 2017 at 11:54 AM, Eli Levine <el...@gmail.com> wrote:

> Greetings, Pig community. I am using PigUnit (PigTest.java) in a unit
> test in Apache Calcite [1] and have observed intermittent test
> failures [2]. Happens somewhat often on Travis-CI builds. PigUnit
> executes scripts locally and AFAIK the cause is file permissions but
> it's difficult to tell for certain because reproducing locally is rare
> and inconsistent.
>
> Anyone experience anything like this?
>
> Pig version is 0.16.0.
>
> Here is the stack trace of the exception that occurs when it happens
> (not very helpful):
>
> Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.925
> sec <<< FAILURE! - in org.apache.calcite.test.PigRelBuilderStyleTest
> testImplWithGroupByCountDistinct(org.apache.calcite.test.
> PigRelBuilderStyleTest)
>  Time elapsed: 0.676 sec  <<< ERROR!
> java.lang.RuntimeException:
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
> to open iterator for alias t
> at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(
> PigRelBuilderStyleTest.java:253)
> at org.apache.calcite.test.PigRelBuilderStyleTest.
> testImplWithGroupByCountDistinct(PigRelBuilderStyleTest.java:149)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: Unable
> to open iterator for alias t
> at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(
> PigRelBuilderStyleTest.java:251)
> at org.apache.calcite.test.PigRelBuilderStyleTest.
> testImplWithGroupByCountDistinct(PigRelBuilderStyleTest.java:149)
> Caused by: java.io.IOException: Job terminated with anomalous status FAILED
> at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(
> PigRelBuilderStyleTest.java:251)
> at org.apache.calcite.test.PigRelBuilderStyleTest.
> testImplWithGroupByCountDistinct(PigRelBuilderStyleTest.java:149)
>
> [1] https://github.com/apache/calcite/blob/master/pig/src/
> test/java/org/apache/calcite/test/PigRelBuilderStyleTest.java#L257
> [2] https://issues.apache.org/jira/browse/CALCITE-1561?
> focusedCommentId=15901638&page=com.atlassian.jira.
> plugin.system.issuetabpanels:comment-tabpanel#comment-15901638
>
> Thanks!
>
> Eli
>