You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "iwasakims (via GitHub)" <gi...@apache.org> on 2024/04/09 07:19:08 UTC

[PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]

iwasakims opened a new pull request, #1250:
URL: https://github.com/apache/bigtop/pull/1250

   https://issues.apache.org/jira/browse/BIGTOP-4076
   
   We need newer version of g++ for rebuilding [@parcel/watcher](https://github.com/parcel-bundler/watcher) for aarch64. I added software collection resources to toolchain for this. Since scl is enabled on only CentOS 7 aarch64, other platforms should not be affected by this PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]

Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims merged PR #1250:
URL: https://github.com/apache/bigtop/pull/1250


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]

Posted by "yoda-mon (via GitHub)" <gi...@apache.org>.
yoda-mon commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2069937733

   @iwasakims 
   Thank you, after clearing cache, the build was successfully finished.
   
   ```sh
   docker image rm bigtop/slaves:trunk-centos-7-aarch64
   docker image rm bigtop/puppet:trunk-centos-7-aarch64
   ./gradlew -Pprefix=trunk -POS=centos-7 bigtop-slaves
   
   ...
   
   BUILD SUCCESSFUL in 29h 30m 5s
   ```
   ```sh
   ./gradlew -POS=centos-7 -Pdocker-run-option="--privileged"  bigtop-utils-pkg-ind bigtop-jsvc-pkg-ind bigtop-groovy-pkg-ind flink-pkg-ind
   
   ...
   
   BUILD SUCCESSFUL in 54m 14s
   ```
   
   And then, smoke tests have passed.
   
   ```sh
   ./gradlew -POS=centos-7 -Pdocker-run-option="--privileged"  hadoop-ind repo-ind
   cd provisioner/docker
   ./docker-hadoop.sh -d -dcp \
     -C config_centos-7.yaml \
     --create 3 \
     --enable-local-repo \
     --repo file:///bigtop-home/output \
     --disable-gpg-check \
     --stack yarn,hdfs,flink \
     --smoke-tests flink
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]

Posted by "yoda-mon (via GitHub)" <gi...@apache.org>.
yoda-mon commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2059429031

   When I simply tryied to build flink on an arm server with the following
   
   ```sh
   ./gradlew -POS=centos-7 -Pdocker-run-option="--privileged"  bigtop-utils-pkg-ind bigtop-jsvc-pkg-ind bigtop-groovy-pkg-ind flink-pkg-ind
   ```
   
   I saw
   
   ```gradle
   > Task :flink-rpm FAILED
   ++ sed -e 's/[&\\/]/\\&/g; s/$/\\/' -e '$s/\\$//'
   + repl_to='cd \/bigtop \&\& husky install build\/flink\/rpm\/BUILD\/flink-1.16.2\/flink-runtime-web\/web-dashboard\/.husky'
   + sed -i 's/cd ..\/.. \&\& husky install flink-runtime-web\/web-dashboard\/.husky/cd \/bigtop \&\& husky install build\/flink\/rpm\/BUILD\/flink-1.16.2\/flink-runtime-web\/web-dashboard\/.husky/' flink-runtime-web/web-dashboard/package.json
   + scl enable devtoolset-9 -- mvn install -Drat.skip=true -DskipTests -Dhadoop.version=3.3.6
   /bigtop/build/flink/rpm//SOURCES/do-component-build: line 45: scl: command not found
   error: Bad exit status from /var/tmp/rpm-tmp.2fUp2V (%build)
       Bad exit status from /var/tmp/rpm-tmp.2fUp2V (%build)
   ```
   
   We might  have to install `scl-utils` to `bigtop-slave`, or I missed some options.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]

Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2069974695

   Thanks, @yoda-mon. I'm merging this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]

Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2044641801

   smoke-tests of flink passed on CentOS 7 aarch64.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] BIGTOP-4076. Fix compilation failure of Flink on centos 7 aarch64. [bigtop]

Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1250:
URL: https://github.com/apache/bigtop/pull/1250#issuecomment-2060075222

   Hmm, I can find scl in my local image. The scl-utils is installed as dependency of devtoolset-9.
   
   ```
   [root@82798ae56e05 /]# rpm -q --whatrequires scl-utils
   devtoolset-9-runtime-9.1-0.el7.aarch64
   ```
   
   Could you try rebuilding docker image? @yoda-mon 
   
   ```
   $ docker image rm bigtop/slaves:trunk-centos-7-aarch64
   $ docker image rm bigtop/puppet:trunk-centos-7-aarch64
   $ ./gradlew -Pprefix=trunk -POS=centos-7 bigtop-slaves
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org