Daily Flink ARM Cron Job Test Result - SUCCESS

[in...@openlabtesting.org]

Build succeeded.

- flink-build-and-test-arm64-core-and-tests https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-build-and-test-arm64-core-and-tests/083d86c/ : SUCCESS in 58m 53s
- flink-end-to-end-test-checkpoints-and-sticky https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-end-to-end-test-checkpoints-and-sticky/1fd4474/ : SUCCESS in 3h 52m 04s
- flink-end-to-end-test-heavy-and-ha https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-end-to-end-test-heavy-and-ha/2e71c04/ : SUCCESS in 4h 14m 44s
- flink-end-to-end-test-misc-hadoopfree-and-misc https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-end-to-end-test-misc-hadoopfree-and-misc/9645706/ : SUCCESS in 1h 28m 04s

Re: Daily Flink ARM Cron Job Test Result - SUCCESS

[OpenLab Administrator <in...@openlabtesting.org>]

Hi all,
    Flink on ARM cron job is running on OpenLab now. It'll send out the
test result once a day. I'd like to explain what and how the job runs.

*- flink-build-and-test-arm64-core-and-tests *
    This job runs `mvn verify` for the [core] and [test] modules following
what Flink Travis job contains basing on JAVA 1.8 and Scala 2.11. It
includes:

flink-annotations
flink-test-utils-parent/flink-test-utils
flink-state-backends/flink-statebackend-rocksdb
flink-clients
flink-core
flink-java
flink-optimizer
flink-runtime
flink-runtime-web
flink-scala
flink-streaming-java
flink-streaming-scala
flink-metrics
flink-metrics/flink-metrics-core
flink-scala-shell
flink-tests

What's hacked:
 1. Frocksdb is built locally to support ARM.
 2. `-fn` flag is added to `mvn verify` to ensure all cases are tested.
Know issue:
 1. org.apache.flink.test.runtime.NettyEpollITCase.testNettyEpoll failed
due to
`liborg_apache_flink_shaded_netty4_netty_transport_native_epoll_aarch_64.so`
is missing.
          *Solution*: I'm now working on Netty ARM support. [
https://github.com/netty/netty/issues/8279] Once it's done, we can bump
flink-shaded-netty-4 to a new version.

*- flink-end-to-end-test-checkpoints-and-sticky*
    This job runs e2e test in `tools/travis/splits/split_checkpoint.sh` and
`tools/travis/splits/split_sticky.sh` basing on JAVA 1.8 and Hadoop 2.8.3
What's hacked:
 1. Frocksdb is built locally to support ARM.
 2. docker and minikube setup step is skipped.
Know issue:
 None

*- flink-end-to-end-test-heavy-and-ha*
    This job runs e2e test in `tools/travis/splits/split_heavy.sh` and
`tools/travis/splits/split_ha.sh` basing on JAVA 1.8 and Hadoop 2.8.3
What's hacked:
 1. Frocksdb is built locally to support ARM.
 2. docker and minikube setup step is skipped.
Know issue:
 None

*- flink-end-to-end-test-misc-hadoopfree-and-misc*
    This job runs e2e test in `tools/travis/splits/split_misc.sh` and
`tools/travis/splits/split_misc_hadoopfree.sh` basing on JAVA 1.8 and
Hadoop 2.8.3
What's hacked:
 1. Frocksdb is built locally to support ARM.
 2. docker and minikube setup step is skipped.
 3. prometheus ARM package is downloade instead of X84
[https://issues.apache.org/jira/browse/FLINK-14086]
 4. elasticsearch xpack.ml function is disabled if the version is great
than 6.0  [https://issues.apache.org/jira/browse/FLINK-14126]
Know issue:
 None


Following what Travis contains, the things are still missing:
1. Test on JAVA 11
2. Test on Scala 2.12
3. Test on Hadoop 2.4.1
4. `mvn verify` with more modules. Like [python] [libraries] [connectors]
[kafka/gelly] [blink_planner]
5. container e2e test. This is blocked by docker/k8s setup step. [
https://issues.apache.org/jira/browse/FLINK-14241]


I'll add them one by one later. Any question is welcome.

Thanks
WangXiyuan

<in...@openlabtesting.org> 于2019年11月20日周三 上午8:15写道：

> Build succeeded.
>
> - flink-build-and-test-arm64-core-and-tests
> https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-build-and-test-arm64-core-and-tests/083d86c/
> : SUCCESS in 58m 53s
> - flink-end-to-end-test-checkpoints-and-sticky
> https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-end-to-end-test-checkpoints-and-sticky/1fd4474/
> : SUCCESS in 3h 52m 04s
> - flink-end-to-end-test-heavy-and-ha
> https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-end-to-end-test-heavy-and-ha/2e71c04/
> : SUCCESS in 4h 14m 44s
> - flink-end-to-end-test-misc-hadoopfree-and-misc
> https://logs.openlabtesting.org/logs/periodic-20-flink-mail/github.com/apache/flink/master/flink-end-to-end-test-misc-hadoopfree-and-misc/9645706/
> : SUCCESS in 1h 28m 04s
>