[jira] [Commented] (BIGTOP-3426) Flink smoke test fails with fedora-31 and debian-10 on arm64

["Yuqi Gu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212073#comment-17212073 ] 

Yuqi Gu commented on BIGTOP-3426:
---------------------------------

Re-run the Flink smoke tests on Arm64:

{code:java}
Successfully started process 'Gradle Test Executor 2'

org.apache.bigtop.itest.hadoop.flink.TestFlink STANDARD_ERROR
    20/10/10 06:15:28 INFO lang.Object: hadoop fs -rm -r /flink
    20/10/10 06:15:31 INFO lang.Object: hadoop fs -mkdir /flink
    20/10/10 06:15:33 INFO lang.Object: hadoop fs -put test.data /flink/

org.apache.bigtop.itest.hadoop.flink.TestFlink > testCheckRestfulAPI STANDARD_ERROR
    20/10/10 06:15:36 INFO lang.Object: awk '{if(/jobmanager.rpc.address:/) print $2}' < /etc/flink/conf/flink-conf.yaml
    20/10/10 06:15:36 INFO lang.Object: awk '{if(/jobmanager.web.port:/) print $2}' < /etc/flink/conf/flink-conf.yaml
    20/10/10 06:15:36 INFO lang.Object: curl http://db9f113217f2.bigtop.apache.org:8081/config

org.apache.bigtop.itest.hadoop.flink.TestFlink > testWordCountBatch STANDARD_ERROR
    20/10/10 06:15:36 INFO lang.Object: hdfs getconf -confKey fs.defaultFS
    20/10/10 06:15:37 INFO lang.Object: flink run $FLINK_HOME/examples/batch/WordCount.jar --input hdfs://db9f113217f2.bigtop.apache.org:8020/flink/test.data --output hdfs://db9f113217f2.bigtop.apache.org:8020/tmp/result.txt
    20/10/10 06:16:04 INFO lang.Object: hadoop fs -cat /tmp/result.txt

org.apache.bigtop.itest.hadoop.flink.TestFlink STANDARD_ERROR
    20/10/10 06:16:06 INFO lang.Object: hadoop fs -rm -r /flink

Gradle Test Executor 2 finished executing tests.

> Task :bigtop-tests:smoke-tests:flink:test
Finished generating test XML results (0.015 secs) into: /bigtop-home/bigtop-tests/smoke-tests/flink/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.028 secs) into: /bigtop-home/bigtop-tests/smoke-tests/flink/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:flink:test (Thread[Execution worker for ':' Thread 63,5,main]) completed. Took 42.024 secs.

BUILD SUCCESSFUL in 2m 37s

{code}

The dependency components:

{code:java}
components: [bigtop-utils, hdfs, zookeeper, flink]
{code}

[~sekikn], Could you please give me the permission to trigger the build/smoke tests on our Bigtop CI or to modify the configuration of the CI jobs, thanks.


> Flink smoke test fails with fedora-31 and debian-10 on arm64
> ------------------------------------------------------------
>
>                 Key: BIGTOP-3426
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3426
>             Project: Bigtop
>          Issue Type: Bug
>          Components: flink
>            Reporter: Kengo Seki
>            Assignee: Yuqi Gu
>            Priority: Major
>
> Flink's smoke test fails with the following error only on these environments for some reason.
> https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=hdfs.flink@flink,OS=debian-10-arm64-deploy/178/console
> https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=hdfs.flink@flink,OS=fedora-31-aarch64-deploy/174/console
> {code}
> org.apache.bigtop.itest.hadoop.flink.TestFlink > testWordCountBatch STANDARD_ERROR
>     20/09/29 22:03:23 INFO lang.Object: hdfs getconf -confKey fs.defaultFS
>     20/09/29 22:03:25 INFO lang.Object: flink run $FLINK_HOME/examples/batch/WordCount.jar --input hdfs://ff0b31a0d110.bigtop.apache.org:8020/flink/test.data --output hdfs://ff0b31a0d110.bigtop.apache.org:8020/tmp/result.txt
>     20/09/29 22:04:56 INFO lang.Object: hadoop fs -cat /tmp/result.txt
> org.apache.bigtop.itest.hadoop.flink.TestFlink > testWordCountBatch FAILED
>     org.junit.ComparisonFailure: Incorrect output expected:<[black 5
>     blue 11
>     green 11
>     white 5
>     yellow 11]> but was:<[]>
>         at org.junit.Assert.assertEquals(Assert.java:115)
>         at org.junit.Assert$assertEquals.callStatic(Unknown Source)
>         at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
>         at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:196)
>         at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:224)
>         at org.apache.bigtop.itest.hadoop.flink.TestFlink.testWordCountBatch(TestFlink.groovy:87)
> org.apache.bigtop.itest.hadoop.flink.TestFlink STANDARD_ERROR
>     20/09/29 22:05:01 INFO lang.Object: hadoop fs -rm -r /flink
> Gradle Test Executor 2 finished executing tests.
> > Task :bigtop-tests:smoke-tests:flink:test
> 2 tests completed, 1 failed
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)