You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Tony Reix (JIRA)" <ji...@apache.org> on 2015/02/11 18:04:12 UTC
[jira] [Commented] (FLUME-2621) Maven is lost with Flume test
failure with IBM JVM
[ https://issues.apache.org/jira/browse/FLUME-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14316536#comment-14316536 ]
Tony Reix commented on FLUME-2621:
----------------------------------
I have the same issue (Tests run: 0 for TestSpillableMemoryChanne) with OpenJDK on RHEL 7.1 on PPC64LE .
Extract from the log:
Forking command line: /bin/sh -c cd /home/tony/FLUME/flume/flume-ng-channels/flume-spillable-memory-channel && /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.75-2.5.4.4.ael7b.ppc64le/jre/bin/java -jar /home/tony/FLUME/flume/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefirebooter4125392200504727768.jar /home/tony/FLUME/flume/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefire4818640560245175177tmp /home/tony/FLUME/flume/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefire_1056200986231499568557tmp
Running org.apache.flume.channel.TestSpillableMemoryChannel
Results :
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
^^^^^^^^^^^^
Contents of: ./flume-ng-channels/flume-spillable-memory-channel/target/surefire-reports/org.apache.flume.channel.TestSpillableMemoryChannel-output.txt
log4j:WARN No appenders could be found for logger (org.apache.flume.channel.file.FileChannel).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Attempting to shutdown background worker.
Attempting to shutdown background worker.
Attempting to shutdown background worker.
Attempting to shutdown background worker.
Attempting to shutdown background worker.
Attempting to shutdown background worker.
src : [ 2317 ms ].
sink : [ 4191 ms ].
main : [ 4221 ms ].
Max Queue size 357524
Attempting to shutdown background worker.
src : [ 41 ms ].
sink : [ 7 ms ].
src : [ 996 ms ].
sink : [ 7 ms ].
src1 : [ 2 ms ].
sink1 : [ 2 ms ]. { items = 5000, attempts = 5 }
src2 : [ 2 ms ].
sink2 : [ 1 ms ]. { items = 2500, attempts = 5 }
sink3 : [ 1 ms ]. { items = 2500, attempts = 3 }
Attempting to shutdown background worker.
sink6 : [ 453 sec ]. { items = 125000, attempts = 1250 }
sink7 : [ 529 sec ]. { items = 125000, attempts = 1250 }
src4 : [ 640 sec ].
sink3 : [ 662 sec ]. { items = 125000, attempts = 1250 }
src5 : [ 718 sec ].
src6 : [ 755 sec ].
sink0 : [ 764 sec ]. { items = 125000, attempts = 1250 }
src3 : [ 767 sec ].
sink2 : [ 789 sec ]. { items = 125000, attempts = 1250 }
src2 : [ 791 sec ].
src0 : [ 808 sec ].
sink1 : [ 850 sec ]. { items = 125000, attempts = 1250 }
src1 : [ 857 sec ].
No other .txt file is available :
$ find . -name "*Spillable*" | grep -v java | grep -v class
./flume-ng-channels/flume-spillable-memory-channel/target/surefire-reports/org.apache.flume.channel.TestSpillableMemoryChannel-output.txt
> Maven is lost with Flume test failure with IBM JVM
> --------------------------------------------------
>
> Key: FLUME-2621
> URL: https://issues.apache.org/jira/browse/FLUME-2621
> Project: Flume
> Issue Type: Bug
> Components: Test
> Affects Versions: v1.5.0
> Environment: RHEL 7.1 beta on x86_64 - IBM JVM
> # uname -a
> Linux soe01x 3.10.0-224.el7.x86_64 #1 SMP Mon Jan 19 16:18:15 EST 2015 x86_64 x86_64 x86_64 GNU/Linux
> Reporter: Tony Reix
> Attachments: mvn.Test.IBMJVM.res.TestSpillableMemoryChannel, mvn.Test.IBMJVM.res.TestSpillableMemoryChannel-output.txt
>
>
> Test org.apache.flume.channel.TestSpillableMemoryChannel works fine with OpenJDK, but not with IBM JVM.
> With IBM JVM, the test never ends, but it says (in org.apache.flume.channel.TestSpillableMemoryChannel-output.txt): "org.apache.flume.ChannelFullException: The channel has reached it's capacity. This might be the result of a sink on the channel having too low of batch size, a downstream system running slower than normal, or that the channel capacity is just too low. [channel=spillChannel-61d16662-9887-47df-b13e-99193a6d8078]"
> and file: "org.apache.flume.channel.TestSpillableMemoryChannel.txt" says:
> Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 192.271 sec
> However, stil with IBM JVM, Maven says (ZERO test run):
> Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
> So, there are 2 issues:
> - something wrong either with Flume test which blocks or with Maven which does not handle the hang of the test
> - some Flume code does not work fine with IBM JVM. I have NO idea what could be the root cause, though it works fine with OpenJDK.
> - With OpenJDK :
> Forking command line: /bin/sh -c cd /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel && /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.75-2.5.4.2.el7_0.x86_64/jre/bin/java -jar /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefirebooter5707794865867668252.jar /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefire455959252081693840tmp /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefire_1057455257334314321243tmp
> Running org.apache.flume.channel.TestSpillableMemoryChannel
> Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 192.271 sec
> - With IBM JVM :
> Forking command line: /bin/sh -c cd /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel && /usr/lib/jvm/ibm-java-x86_64-71/jre/bin/java -jar /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefirebooter4589769951623909325.jar /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefire5083149365720360524tmp /home/tony/FLUME/IBMSOE-flume-FromGit-20150210/flume-ng-channels/flume-spillable-memory-channel/target/surefire/surefire_1058311834274967712787tmp
> Running org.apache.flume.channel.TestSpillableMemoryChannel
> Results :
> Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
> OpenJDK version:
> # java -version
> java version "1.7.0_75"
> OpenJDK Runtime Environment (rhel-2.5.4.2.el7_0-x86_64 u75-b13)
> OpenJDK 64-Bit Server VM (build 24.75-b04, mixed mode)
> IBM JVM version:
> # java -version
> java version "1.7.0"
> Java(TM) SE Runtime Environment (build pxa6470_27sr2-20141026_01(SR2))
> IBM J9 VM (build 2.7, JRE 1.7.0 Linux amd64-64 Compressed References 20141017_217728 (JIT enabled, AOT enabled)
> J9VM - R27_Java727_SR2_20141017_1632_B217728
> JIT - tr.r13.java_20141003_74587.01
> GC - R27_Java727_SR2_20141017_1632_B217728_CMPRSS
> J9CL - 20141017_217728)
> JCL - 20141004_01 based on Oracle 7u71-b13
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)