You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Kengo Seki (Jira)" <ji...@apache.org> on 2020/11/07 01:20:00 UTC
[jira] [Commented] (BIGTOP-3428) Kibana's smoke test fails on some
distros
[ https://issues.apache.org/jira/browse/BIGTOP-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227679#comment-17227679 ]
Kengo Seki commented on BIGTOP-3428:
------------------------------------
I tried to reproduce it using m6g.large EC2 instance. After building elasticsearch and kibana and adding them to the local repository, I ran kibana's smoke test as follows:
{code}
admin@ip-172-30-1-167:~/bigtop$ facter architecture
aarch64
admin@ip-172-30-1-167:~/bigtop$ facter operatingsystem
Debian
admin@ip-172-30-1-167:~/bigtop$ facter operatingsystemmajrelease
9
admin@ip-172-30-1-167:~/bigtop$ cd provisioner/docker
admin@ip-172-30-1-167:~/bigtop/provisioner/docker$ ./docker-hadoop.sh -d -C config_debian-9.yaml --disable-gpg-check --enable-local-repo --repo file:///bigtop-home/output/apt --stack 'elasticsearch, kibana' --smoke-tests kibana -c 1
(snip)
Notice: /Stage[main]/Elasticsearch::Server/Service[elasticsearch]/ensure: ensure changed 'stopped' to 'running'
Notice: /Stage[main]/Kibana::Client/Package[kibana]/ensure: created
Notice: /Stage[main]/Kibana::Client/File[/usr/lib/kibana/config/kibana.yml]/content: content changed '{md5}c904a506ebae712e0a74ebb476eb548e' to '{md5}66a095697515463d54482d01607aefda'
Notice: /Stage[main]/Kibana::Client/File[/usr/lib/kibana/config/kibana.example.org.crt]/ensure: defined content as '{md5}62f2fc67ee4bdccc58335b5534a111df'
Notice: /Stage[main]/Kibana::Client/File[/usr/lib/kibana/config/kibana.example.org.key]/ensure: defined content as '{md5}d9f8d77b0c19faf62f70c11cb0970f99'
Notice: /Stage[main]/Kibana::Client/File[/usr/lib/kibana/bin/start-kibana]/ensure: defined content as '{md5}c77813ce32662ce6c33b306f89599bc2'
Notice: Applied catalog in 64.86 seconds
(snip)
===== START TO RUN SMOKE TESTS: kibana =====
(snip)
> Task :bigtop-tests:smoke-tests:kibana:test
Caching disabled for task ':bigtop-tests:smoke-tests:kibana:test' because:
Build cache is disabled
Task ':bigtop-tests:smoke-tests:kibana:test' is not up-to-date because:
No history is available.
Starting process 'Gradle Test Executor 2'. Working directory: /bigtop-home/bigtop-tests/smoke-tests/kibana Command: /usr/lib/jvm/java-8-openjdk-arm64/bin/java -Dawt.toolkit=sun.awt.X11.XToolkit -Dfile.encoding.pkg=sun.io -Dfile.separator=/ -Djava.awt.graphicsenv=sun.awt.X11GraphicsEnvironment -Djava.awt.printerjob=sun.print.PSPrinterJob -Djava.class.path=/root/.gradle/wrapper/dists/gradle-5.6.4-bin/c9880aa85176bf8c458862eb99f7e0a9/gradle-5.6.4/lib/gradle-launcher-5.6.4.jar -Djava.class.version=52.0 -Djava.endorsed.dirs=/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/endorsed -Djava.ext.dirs=/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/ext:/usr/java/packages/lib/ext -Djava.home=/usr/lib/jvm/java-8-openjdk-arm64/jre -Djava.library.path=/usr/java/packages/lib/aarch64:/usr/lib/aarch64-linux-gnu/jni:/lib/aarch64-linux-gnu:/usr/lib/aarch64-linux-gnu:/usr/lib/jni:/lib:/usr/lib -Djava.runtime.name=OpenJDK Runtime Environment -Djava.runtime.version=1.8.0_272-8u272-b10-0+deb9u1-b10 -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Djava.specification.name=Java Platform API Specification -Djava.specification.vendor=Oracle Corporation -Djava.specification.version=1.8 -Djava.vendor=Oracle Corporation -Djava.vendor.url=http://java.oracle.com/ -Djava.vendor.url.bug=http://bugreport.sun.com/bugreport/ -Djava.version=1.8.0_272 -Djava.vm.info=mixed mode -Djava.vm.name=OpenJDK 64-Bit Server VM -Djava.vm.specification.name=Java Virtual Machine Specification -Djava.vm.specification.vendor=Oracle Corporation -Djava.vm.specification.version=1.8 -Djava.vm.vendor=Oracle Corporation -Djava.vm.version=25.272-b10 -Dlibrary.jansi.path=/root/.gradle/native/jansi/1.17.1/linux64 -Dline.separator=
-Dorg.gradle.appname=gradlew -Dorg.gradle.native=false -Dos.arch=aarch64 -Dos.name=Linux -Dos.version=4.9.0-14-arm64 -Dpath.separator=: -Dsun.arch.data.model=64 -Dsun.boot.class.path=/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/resources.jar:/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/rt.jar:/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/jsse.jar:/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/jce.jar:/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/charsets.jar:/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/jfr.jar:/usr/lib/jvm/java-8-openjdk-arm64/jre/classes -Dsun.boot.library.path=/usr/lib/jvm/java-8-openjdk-arm64/jre/lib/aarch64 -Dsun.cpu.endian=little -Dsun.cpu.isalist -Dsun.io.unicode.encoding=UnicodeLittle -Dsun.java.command=org.gradle.launcher.daemon.bootstrap.GradleDaemon 5.6.4 -Dsun.java.launcher=SUN_STANDARD -Dsun.jnu.encoding=ANSI_X3.4-1968 -Dsun.management.compiler=HotSpot 64-Bit Tiered Compilers -Dsun.os.patch.level=unknown -Duser.dir=/bigtop-home -Duser.home=/root -Duser.name=root -Duser.timezone -Xmx512m -Dfile.encoding=ANSI_X3.4-1968 -Djava.io.tmpdir=/tmp -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /root/.gradle/caches/5.6.4/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 2'
Successfully started process 'Gradle Test Executor 2'
{code}
But the test stopped here and never returned.
Once I sent some requests from outside of that process, the test resumed and succeeded.
{code}
(from other terminal)
admin@ip-172-30-1-167:~$ for i in $(seq 1 100); do docker exec -it 20201107_010818_r23827_bigtop_1 curl -i localhost:5601; done
HTTP/1.1 302 Found
location: https://0:5601/
kbn-name: kibana
kbn-version: 5.4.1
cache-control: no-cache
content-length: 0
Date: Sat, 07 Nov 2020 01:14:03 GMT
Connection: keep-alive
(snip)
{code}
{code}
(continued)
> Task :bigtop-tests:smoke-tests:kibana:test
Finished generating test XML results (0.016 secs) into: /bigtop-home/bigtop-tests/smoke-tests/kibana/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.024 secs) into: /bigtop-home/bigtop-tests/smoke-tests/kibana/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:kibana:test (Thread[Daemon worker,5,main]) completed. Took 3 mins 25.57 secs.
BUILD SUCCESSFUL in 4m 34s
40 actionable tasks: 6 executed, 34 up-to-date
Stopped 1 worker daemon(s).
+ rm -rf buildSrc/build/test-results/binary
+ rm -rf /bigtop-home/.gradle
{code}
I suspected Bigtop's test framework of buffering output and blocking until it receives enough size of data to flush it, and tried some modification, but it didn't work yet.
> Kibana's smoke test fails on some distros
> -----------------------------------------
>
> Key: BIGTOP-3428
> URL: https://issues.apache.org/jira/browse/BIGTOP-3428
> Project: Bigtop
> Issue Type: Bug
> Reporter: Kengo Seki
> Assignee: Yuqi Gu
> Priority: Major
> Fix For: 1.5.0
>
>
> Kibana's smoke test is failing as follows. Is request to Kibana too early?
> https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=elasticsearch.kibana@kibana,OS=debian-10-arm64-deploy/175/console
> https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=elasticsearch.kibana@kibana,OS=debian-9-arm64-deploy/175/console
> https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=elasticsearch.kibana@kibana,OS=fedora-31-aarch64-deploy/175/console
> https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/COMPONENTS=elasticsearch.kibana@kibana,OS=ubuntu-18.04-arm64-deploy/175/console
> {code}
> > Task :bigtop-tests:smoke-tests:kibana:test
> TestKibanaSmoke > KibanaWebTest STANDARD_OUT
> Failed command: /usr/lib/kibana/bin/start-kibana;sleep 10;curl -i localhost:5601;
> error code: 7
> stdout: [{"type":"log","@timestamp":"2020-09-30T00:36:04Z","tags":["status","plugin:kibana@5.4.1","info"],"pid":5515,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}]
> stderr: [ % Total % Received % Xferd Average Speed Time Time Time Current, Dload Upload Total Spent Left Speed,
> 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to localhost port 5601: Connection refused]
> Gradle Test Executor 2 finished executing tests.
> > Task :bigtop-tests:smoke-tests:kibana:test FAILED
> TestKibanaSmoke > KibanaWebTest FAILED
> java.lang.AssertionError: Kibana start failed
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert$assertTrue.callStatic(Unknown Source)
> at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
> at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:196)
> at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:216)
> at TestKibanaSmoke.KibanaWebTest(TestKibanaSmoke.groovy:49)
> 1 test completed, 1 failed
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)