You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "iwasakims (via GitHub)" <gi...@apache.org> on 2024/04/09 07:19:08 UTC
[PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]
iwasakims opened a new pull request, #1250:
URL: https://github.com/apache/bigtop/pull/1250
https://issues.apache.org/jira/browse/BIGTOP-4076
We need newer version of g++ for rebuilding [@parcel/watcher](https://github.com/parcel-bundler/watcher) for aarch64. I added software collection resources to toolchain for this. Since scl is enabled on only CentOS 7 aarch64, other platforms should not be affected by this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims merged PR #1250:
URL: https://github.com/apache/bigtop/pull/1250
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]
Posted by "yoda-mon (via GitHub)" <gi...@apache.org>.
yoda-mon commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2069937733
@iwasakims
Thank you, after clearing cache, the build was successfully finished.
```sh
docker image rm bigtop/slaves:trunk-centos-7-aarch64
docker image rm bigtop/puppet:trunk-centos-7-aarch64
./gradlew -Pprefix=trunk -POS=centos-7 bigtop-slaves
...
BUILD SUCCESSFUL in 29h 30m 5s
```
```sh
./gradlew -POS=centos-7 -Pdocker-run-option="--privileged" bigtop-utils-pkg-ind bigtop-jsvc-pkg-ind bigtop-groovy-pkg-ind flink-pkg-ind
...
BUILD SUCCESSFUL in 54m 14s
```
And then, smoke tests have passed.
```sh
./gradlew -POS=centos-7 -Pdocker-run-option="--privileged" hadoop-ind repo-ind
cd provisioner/docker
./docker-hadoop.sh -d -dcp \
-C config_centos-7.yaml \
--create 3 \
--enable-local-repo \
--repo file:///bigtop-home/output \
--disable-gpg-check \
--stack yarn,hdfs,flink \
--smoke-tests flink
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]
Posted by "yoda-mon (via GitHub)" <gi...@apache.org>.
yoda-mon commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2059429031
When I simply tryied to build flink on an arm server with the following
```sh
./gradlew -POS=centos-7 -Pdocker-run-option="--privileged" bigtop-utils-pkg-ind bigtop-jsvc-pkg-ind bigtop-groovy-pkg-ind flink-pkg-ind
```
I saw
```gradle
> Task :flink-rpm FAILED
++ sed -e 's/[&\\/]/\\&/g; s/$/\\/' -e '$s/\\$//'
+ repl_to='cd \/bigtop \&\& husky install build\/flink\/rpm\/BUILD\/flink-1.16.2\/flink-runtime-web\/web-dashboard\/.husky'
+ sed -i 's/cd ..\/.. \&\& husky install flink-runtime-web\/web-dashboard\/.husky/cd \/bigtop \&\& husky install build\/flink\/rpm\/BUILD\/flink-1.16.2\/flink-runtime-web\/web-dashboard\/.husky/' flink-runtime-web/web-dashboard/package.json
+ scl enable devtoolset-9 -- mvn install -Drat.skip=true -DskipTests -Dhadoop.version=3.3.6
/bigtop/build/flink/rpm//SOURCES/do-component-build: line 45: scl: command not found
error: Bad exit status from /var/tmp/rpm-tmp.2fUp2V (%build)
Bad exit status from /var/tmp/rpm-tmp.2fUp2V (%build)
```
We might have to install `scl-utils` to `bigtop-slave`, or I missed some options.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2069974695
Thanks, @yoda-mon. I'm merging this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2044641801
smoke-tests of flink passed on CentOS 7 aarch64.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2060075222
Hmm, I can find scl in my local image. The scl-utils is installed as dependency of devtoolset-9.
```
[root@82798ae56e05 /]# rpm -q --whatrequires scl-utils
devtoolset-9-runtime-9.1-0.el7.aarch64
```
Could you try rebuilding docker image? @yoda-mon
```
$ docker image rm bigtop/slaves:trunk-centos-7-aarch64
$ docker image rm bigtop/puppet:trunk-centos-7-aarch64
$ ./gradlew -Pprefix=trunk -POS=centos-7 bigtop-slaves
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org