You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Kengo Seki (Jira)" <ji...@apache.org> on 2020/10/30 05:47:00 UTC
[jira] [Commented] (BIGTOP-3430) QFS smoke test fails on Fedora
31/arm64
[ https://issues.apache.org/jira/browse/BIGTOP-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223422#comment-17223422 ]
Kengo Seki commented on BIGTOP-3430:
------------------------------------
Hmm, I couldn't reproduce this on fedora31/arm64 locally.
{code}
(After building hadoop and qfs locally)
[fedora@ip-172-30-1-95 bigtop]$ cat /etc/redhat-release
Fedora release 31 (Thirty One)
[fedora@ip-172-30-1-95 bigtop]$ lscpu | head -1
Architecture: aarch64
[fedora@ip-172-30-1-95 bigtop]$ git status
On branch master
Your branch is up to date with 'origin/master'.
nothing to commit, working tree clean
[fedora@ip-172-30-1-95 bigtop]$ cd provisioner/docker
[fedora@ip-172-30-1-95 docker]$ ./docker-hadoop.sh -d -C config_fedora-31.yaml --disable-gpg-check --enable-local-repo --repo file:///bigtop-home/output --stack 'hdfs, yarn, mapreduce, qfs' --smoke-tests qfs -c 1
(snip)
Notice: /Stage[main]/Qfs::Common/Hadoop::Create_storage_dir[/data/1/qfs]/Exec[mkdir /data/1/qfs]/returns: executed successfully
Notice: /Stage[main]/Qfs::Common/Hadoop::Create_storage_dir[/data/2/qfs]/Exec[mkdir /data/2/qfs]/returns: executed successfully
Notice: /Stage[main]/Qfs::Metaserver/File[/data/1/qfs/metaserver]/ensure: created
Notice: /Stage[main]/Qfs::Metaserver/File[/data/1/qfs/metaserver/transaction_logs]/ensure: created
Notice: /Stage[main]/Qfs::Metaserver/File[/data/1/qfs/metaserver/checkpoint]/ensure: created
Notice: /Stage[main]/Qfs::Metaserver/Exec[mkfs]/returns: executed successfully
Notice: /Stage[main]/Qfs::Metaserver/Service[qfs-metaserver]/ensure: ensure changed 'stopped' to 'running'
Notice: /Stage[main]/Qfs::Chunkserver/File[/data/1/qfs/chunkserver]/ensure: created
Notice: /Stage[main]/Qfs::Chunkserver/File[/data/2/qfs/chunkserver]/ensure: created
Notice: /Stage[main]/Qfs::Chunkserver/File[/data/1/qfs/chunkserver/chunks]/ensure: created
Notice: /Stage[main]/Qfs::Chunkserver/File[/data/2/qfs/chunkserver/chunks]/ensure: created
Notice: /Stage[main]/Qfs::Chunkserver/Service[qfs-chunkserver]/ensure: ensure changed 'stopped' to 'running'
Notice: Applied catalog in 296.54 seconds
(snip)
Successfully started process 'Gradle Test Executor 2'
org.apache.bigtop.itest.hadoop.mapreduce.TestHadoopExamples STANDARD_ERROR
20/10/30 02:08:32 INFO lang.Object: Failed to unpack jar resources. Attemting to use bigtop sources
20/10/30 02:08:32 INFO lang.Object: MAKING DIRECTORIES ..................... examples examples-output
Gradle Test Executor 2 finished executing tests.
> Task :bigtop-tests:smoke-tests:qfs:test
Finished generating test XML results (0.008 secs) into: /bigtop-home/bigtop-tests/smoke-tests/qfs/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.017 secs) into: /bigtop-home/bigtop-tests/smoke-tests/qfs/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:qfs:test (Thread[Execution worker for ':',5,main]) completed. Took 2 mins 50.031 secs.
BUILD SUCCESSFUL in 3m 46s
40 actionable tasks: 6 executed, 34 up-to-date
Stopped 1 worker daemon(s).
+ rm -rf buildSrc/build/test-results/binary
+ rm -rf /bigtop-home/.gradle
[fedora@ip-172-30-1-95 docker]$
{code}
> QFS smoke test fails on Fedora 31/arm64
> ---------------------------------------
>
> Key: BIGTOP-3430
> URL: https://issues.apache.org/jira/browse/BIGTOP-3430
> Project: Bigtop
> Issue Type: Bug
> Components: qfs, tests
> Reporter: Kengo Seki
> Priority: Major
>
> QFS smoke test is failing with the following error repeatedly. It looks like a different problem from BIGTOP-3429.
> [https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=hdfs.yarn.qfs@qfs,OS=fedora-31-aarch64-deploy/182/console]
> [https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=hdfs.yarn.qfs@qfs,OS=fedora-31-aarch64-deploy/175/console]
> [https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=hdfs.yarn.qfs@qfs,OS=fedora-31-aarch64-deploy/174/console]
> [https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=hdfs.yarn.qfs@qfs,OS=fedora-31-aarch64-deploy/173/console]
> {code:java}
> > Task :bigtop-tests:smoke-tests:qfs:test
> org.apache.bigtop.itest.hadoop.mapreduce.TestHadoopExamples STANDARD_ERROR
> 20/09/30 05:27:12 INFO lang.Object: Failed to unpack jar resources. Attemting to use bigtop sources
> 20/09/30 05:27:12 INFO lang.Object: MAKING DIRECTORIES ..................... examples examples-output
> The message received from the daemon indicates that the daemon has disappeared.
> Build request sent: Build{id=0877f227-e06a-4a9c-9281-6f907b433384, currentDir=/bigtop-home}
> Attempting to read last messages from the daemon log...
> Daemon pid: 2822
> log file: /root/.gradle/daemon/5.6.4/daemon-2822.out.log
> ----- Last 20 lines from daemon log file - daemon-2822.out.log -----
> :bigtop-tests:smoke-tests:qfs:processTestResources (Thread[Execution worker for ':' Thread 4,5,main]) started.
> file or directory '/bigtop-home/bigtop-tests/smoke-tests/qfs/src/test/resources', not found
> Skipping task ':bigtop-tests:smoke-tests:qfs:processTestResources' as it has no source files and no previous output files.
> :bigtop-tests:smoke-tests:qfs:processTestResources (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.006 secs.
> :bigtop-tests:smoke-tests:qfs:testClasses (Thread[Execution worker for ':' Thread 4,5,main]) started.
> Skipping task ':bigtop-tests:smoke-tests:qfs:testClasses' as it has no actions.
> :bigtop-tests:smoke-tests:qfs:testClasses (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.0 secs.
> :bigtop-tests:smoke-tests:qfs:test (Thread[Execution worker for ':' Thread 4,5,main]) started.
> Caching disabled for task ':bigtop-tests:smoke-tests:qfs:test' because:
> Build cache is disabled
> Task ':bigtop-tests:smoke-tests:qfs:test' is not up-to-date because:
> No history is available.
> Starting process 'Gradle Test Executor 2'. Working directory: /bigtop-home/bigtop-tests/smoke-tests/qfs Command: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/bin/java -Dawt.toolkit=sun.awt.X11.XToolkit -Dfile.encoding.pkg=sun.io -Dfile.separator=/ -Djava.awt.graphicsenv=sun.awt.X11GraphicsEnvironment -Djava.awt.printerjob=sun.print.PSPrinterJob -Djava.class.path=/root/.gradle/wrapper/dists/gradle-5.6.4-bin/c9880aa85176bf8c458862eb99f7e0a9/gradle-5.6.4/lib/gradle-launcher-5.6.4.jar -Djava.class.version=52.0 -Djava.endorsed.dirs=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/endorsed -Djava.ext.dirs=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/ext:/usr/java/packages/lib/ext -Djava.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre -Djava.library.path=/usr/java/packages/lib/aarch64:/lib:/usr/lib -Djava.runtime.name=OpenJDK Runtime Environment -Djava.runtime.version=1.8.0_265-b01 -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Djava.specification.name=Java Platform API Specification -Djava.specification.vendor=Oracle Corporation -Djava.specification.version=1.8 -Djava.vendor=Red Hat, Inc -Djava.vendor.url=https://www.redhat.com/ -Djava.vendor.url.bug=https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=java-1.8.0-openjdk&version=31 -Djava.version=1.8.0_265 -Djava.vm.info=mixed mode -Djava.vm.name=OpenJDK 64-Bit Server VM -Djava.vm.specification.name=Java Virtual Machine Specification -Djava.vm.specification.vendor=Oracle Corporation -Djava.vm.specification.version=1.8 -Djava.vm.vendor=Red Hat, Inc -Djava.vm.version=25.265-b01 -Dlibrary.jansi.path=/root/.gradle/native/jansi/1.17.1/linux64 -Dline.separator=
> -Dorg.gradle.appname=gradlew -Dorg.gradle.native=false -Dos.arch=aarch64 -Dos.name=Linux -Dos.version=4.9.0-8-arm64 -Dpath.separator=: -Dsun.arch.data.model=64 -Dsun.boot.class.path=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/resources.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/rt.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/jsse.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/jce.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/charsets.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/jfr.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/classes -Dsun.boot.library.path=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.265.b01-1.fc31.aarch64/jre/lib/aarch64 -Dsun.cpu.endian=little -Dsun.cpu.isalist -Dsun.io.unicode.encoding=UnicodeLittle -Dsun.java.command=org.gradle.launcher.daemon.bootstrap.GradleDaemon 5.6.4 -Dsun.java.launcher=SUN_STANDARD -Dsun.jnu.encoding=ANSI_X3.4-1968 -Dsun.management.compiler=HotSpot 64-Bit Tiered Compilers -Dsun.os.patch.level=unknown -Duser.dir=/bigtop-home -Duser.home=/root -Duser.name=root -Duser.timezone -Xmx512m -Dfile.encoding=ANSI_X3.4-1968 -Djava.io.tmpdir=/tmp -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /root/.gradle/caches/5.6.4/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 2'
> Successfully started process 'Gradle Test Executor 2'
> Gradle Test Executor 2 started executing tests.
> org.apache.bigtop.itest.hadoop.mapreduce.TestHadoopExamples STANDARD_ERROR
> 20/09/30 05:27:12 INFO lang.Object: Failed to unpack jar resources. Attemting to use bigtop sources
> 20/09/30 05:27:12 INFO lang.Object: MAKING DIRECTORIES ..................... examples examples-output
> ----- End of the daemon log -----
> FAILURE: Build failed with an exception.
> * What went wrong:
> Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)