[jira] [Commented] (HADOOP-16358) Add an ARM CI for Hadoop

["Zhenyu Zheng (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904887#comment-16904887 ] 

Zhenyu Zheng commented on HADOOP-16358:
---------------------------------------

Hi All,

I would like to pushing this forward again and update some of our progress.

To be clear again, our goal is to make Big Data related projects more capable to be running on ARM platforms, Openlab is just one possible tool that we are using, we are willing to donate ARM resources.

We have now a running job for building Hadoop trunk on ARM in OpenLab http://status.openlabtesting.org/builds?job_name=hadoop-build-arm64
we discovered some problem and made some work-arounds to made the build successful, and we are try to pushing some of the fix like:
https://issues.apache.org/jira/browse/HADOOP-13363

We are also tring to run full tests in our platform and yet we are still debuging.

As for the mainainers for ARM related stuff, we will have a team doing it for upstream.

> Add an ARM CI for Hadoop
> ------------------------
>
>                 Key: HADOOP-16358
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16358
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Zhenyu Zheng
>            Priority: Major
>
> Now the CI of Hadoop is handled by jenkins. While the tests are running under x86 ARCH, the ARM arch has not being considered. This leads an problem that we don't have a way to test every pull request that if it'll break the Hadoop deployment on ARM or not.
> We should add a CI system that support ARM arch. Using it, Hadoop can officially support arm release in the future. Here I'd like to introduce OpenLab to the community. [OpenLab|https://openlabtesting.org/] is a open source CI system that can test any open source software on either x86 or arm ARCH, it's mainly used by github projects. Now some [projects|https://github.com/theopenlab/openlab-zuul-jobs/blob/master/zuul.d/jobs.yaml] has integrated it already. Such as containerd (a graduated CNCF project, the arm build will be triggerd in every PR, [https://github.com/containerd/containerd/pulls]), terraform and so on.
> OpenLab uses the open source CI software [Zuul |https://github.com/openstack-infra/zuul] for CI system. Zuul is used by OpenStack community as well. integrating with OpneLab is quite easy using its github app. All config info is open source as well.
> If apache Hadoop community has interested with it, we can help for the integration.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org