You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2022/06/21 12:27:44 UTC
[GitHub] [bigtop] guyuqi commented on pull request #916: BIGTOP-3706. Bump Hadoop to 3.3.3.
guyuqi commented on PR #916:
URL: https://github.com/apache/bigtop/pull/916#issuecomment-1161682112
Thanks for working on this. LGTM.
Build Arm64 debian-10 docker images (protocbuf-3.7.1) based on PR: https://github.com/apache/bigtop/pull/915.
Verified Hadoop-3.3.3 build within built docker image above.
Also run the smoke tests.
```
index ad77d34a..d7bcdf8e 100644
--- a/provisioner/docker/config_debian-10.yaml
+++ b/provisioner/docker/config_debian-10.yaml
@@ -20,5 +20,5 @@ docker:
repo: "http://repos.bigtop.apache.org/releases/3.0.0/debian/10/$(ARCH)"
distro: debian
components: [hdfs, yarn, mapreduce]
-enable_local_repo: false
+enable_local_repo: true
smoke_test_components: [hdfs, yarn, mapreduce]
```
Smoke tests:
```
./docker-hadoop.sh -C config_debian-10.yaml -c 3 -s -d
Environment check...
Check docker:
Docker version 20.10.15, build fd82621
Check docker-compose:
Docker Compose version v2.6.0
Check ruby:
ruby 2.7.0p0 (2019-12-25 revision 647ee6f091) [aarch64-linux-gnu]
No cluster exists!
[+] Running 4/4
⠿ Network 20220621_163341_r8800_default Created 0.1s
⠿ Container 20220621_163341_r8800-bigtop-3 Started 2.2s
⠿ Container 20220621_163341_r8800-bigtop-1 Started 2.2s
⠿ Container 20220621_163341_r8800-bigtop-2 Started 2.2s
......
...
.
Successfully started process 'Gradle Test Executor 4'
org.apache.bigtop.itest.hadoop.mapreduce.TestHadoopExamples STANDARD_ERROR
22/06/21 08:50:01 INFO lang.Object: Failed to unpack jar resources. Attemting to use bigtop sources
22/06/21 08:50:01 INFO lang.Object: MAKING DIRECTORIES ..................... examples examples-output
Gradle Test Executor 4 finished executing tests.
> Task :bigtop-tests:smoke-tests:mapreduce:test
Finished generating test XML results (0.002 secs) into: /bigtop-home/bigtop-tests/smoke-tests/mapreduce/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.017 secs) into: /bigtop-home/bigtop-tests/smoke-tests/mapreduce/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:mapreduce:test (Thread[Execution worker for ':' Thread 58,5,main]) completed. Took 6 mins 2.258 secs.
BUILD SUCCESSFUL in 19m 29s
41 actionable tasks: 14 executed, 27 up-to-date
Stopped 1 worker daemon(s).
+ rm -rf buildSrc/build/test-results/binary
+ rm -rf /bigtop-home/.gradle
```
Let me take the tests on Fedora-35/Rockylinux-8 before merging this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org