You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ratis.apache.org by "Clay B. (JIRA)" <ji...@apache.org> on 2019/01/31 23:23:00 UTC
[jira] [Updated] (RATIS-479) Load Generator Broken?
[ https://issues.apache.org/jira/browse/RATIS-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Clay B. updated RATIS-479:
--------------------------
Description:
Hi Josh, as mentioned in RATIS-463, it seems like RATIS-456 was working when applied as a patch during its merge but now breaks for my testing with the following perhaps due to the move to thirdparty?
Server processes are started via:
{code:java}
vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_server.sh |tail -3 | head -n2
cd /home/vagrant/incubator-ratis/
java -jar `find ./ -name 'ratis-examples*-SNAPSHOT.jar'` filestore server --storage $storage --id $id --peers $peers 2>&1 | tee ~/server_${id}.log
vagrant@ratis-server:~$ grep 'Exception in thread' server*.log
server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformatio{code}
The loadgen is started via:
{code:java}
vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_load_gen.sh |tail -3 | head -n2
cd /home/vagrant/incubator-ratis
./ratis-examples/src/main/bin/client.sh filestore loadgen --size 1048576 --numFiles 100 --peers $peers 2>&1 | tee ~/loadgen.log
vagrant@ratis-server:~$ grep 'Exception in thread' load*.log
loadgen.log:Exception in thread "main" java.util.concurrent.CompletionException: java.lang.NoClassDefFoundError: org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9
server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformation
{code}
I do see that these classes are present though:
{{ExitUtils}}:
{code:java}
incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/util/ExitUtils' | grep -B1 ExitUtils
/data/incubator-ratis/ratis-common/target/ratis-common-0.4.0-SNAPSHOT-tests.jar
org/apache/ratis/util/ExitUtils.class
org/apache/ratis/util/ExitUtils$States.class
org/apache/ratis/util/ExitUtils$ExitException.class
--
/data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
org/apache/ratis/util/ExitUtils.class
org/apache/ratis/util/ExitUtils$States.class
org/apache/ratis/util/ExitUtils$ExitException.class{code}
And {{DelayedStream}}:
{code:java}
incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream' | grep -B1 DelayedStream
/data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$12.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$5.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$2.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$3.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$4.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$2.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$3.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$10.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$7.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$1.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$4.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$1.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$14.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$5.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$13.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$6.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$11.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$8.class
{code}
was:
Hi Josh, as mentioned in RATIS-463, it seems like RATIS-456 was working when applied as a patch but now breaks for my testing with the following:
Server processes are started via:
{code:java}
vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_server.sh |tail -3 | head -n2
cd /home/vagrant/incubator-ratis/
java -jar `find ./ -name 'ratis-examples*-SNAPSHOT.jar'` filestore server --storage $storage --id $id --peers $peers 2>&1 | tee ~/server_${id}.log
vagrant@ratis-server:~$ grep 'Exception in thread' server*.log
server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformatio{code}
The loadgen is started via:
{code:java}
vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_load_gen.sh |tail -3 | head -n2
cd /home/vagrant/incubator-ratis
./ratis-examples/src/main/bin/client.sh filestore loadgen --size 1048576 --numFiles 100 --peers $peers 2>&1 | tee ~/loadgen.log
vagrant@ratis-server:~$ grep 'Exception in thread' load*.log
loadgen.log:Exception in thread "main" java.util.concurrent.CompletionException: java.lang.NoClassDefFoundError: org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9
server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformation
{code}
I do see that these classes are present though:
{\{ExitUtils}}:
{code:java}
incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/util/ExitUtils' | grep -B1 ExitUtils
/data/incubator-ratis/ratis-common/target/ratis-common-0.4.0-SNAPSHOT-tests.jar
org/apache/ratis/util/ExitUtils.class
org/apache/ratis/util/ExitUtils$States.class
org/apache/ratis/util/ExitUtils$ExitException.class
--
/data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
org/apache/ratis/util/ExitUtils.class
org/apache/ratis/util/ExitUtils$States.class
org/apache/ratis/util/ExitUtils$ExitException.class{code}
And \{{DelayedStream}}:
{code:java}
incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream' | grep -B1 DelayedStream
/data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$12.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$5.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$2.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$3.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$4.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$2.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$3.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$10.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$7.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$1.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$4.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$1.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$14.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$5.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$13.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$6.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$11.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$8.class
{code}
> Load Generator Broken?
> ----------------------
>
> Key: RATIS-479
> URL: https://issues.apache.org/jira/browse/RATIS-479
> Project: Ratis
> Issue Type: Bug
> Reporter: Clay B.
> Assignee: Josh Elser
> Priority: Minor
>
> Hi Josh, as mentioned in RATIS-463, it seems like RATIS-456 was working when applied as a patch during its merge but now breaks for my testing with the following perhaps due to the move to thirdparty?
> Server processes are started via:
> {code:java}
> vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_server.sh |tail -3 | head -n2
> cd /home/vagrant/incubator-ratis/
> java -jar `find ./ -name 'ratis-examples*-SNAPSHOT.jar'` filestore server --storage $storage --id $id --peers $peers 2>&1 | tee ~/server_${id}.log
> vagrant@ratis-server:~$ grep 'Exception in thread' server*.log
> server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
> server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
> server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformatio{code}
> The loadgen is started via:
> {code:java}
> vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_load_gen.sh |tail -3 | head -n2
> cd /home/vagrant/incubator-ratis
> ./ratis-examples/src/main/bin/client.sh filestore loadgen --size 1048576 --numFiles 100 --peers $peers 2>&1 | tee ~/loadgen.log
> vagrant@ratis-server:~$ grep 'Exception in thread' load*.log
> loadgen.log:Exception in thread "main" java.util.concurrent.CompletionException: java.lang.NoClassDefFoundError: org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9
> server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
> server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
> server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformation
> {code}
> I do see that these classes are present though:
> {{ExitUtils}}:
> {code:java}
> incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/util/ExitUtils' | grep -B1 ExitUtils
> /data/incubator-ratis/ratis-common/target/ratis-common-0.4.0-SNAPSHOT-tests.jar
> org/apache/ratis/util/ExitUtils.class
> org/apache/ratis/util/ExitUtils$States.class
> org/apache/ratis/util/ExitUtils$ExitException.class
> --
> /data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
> org/apache/ratis/util/ExitUtils.class
> org/apache/ratis/util/ExitUtils$States.class
> org/apache/ratis/util/ExitUtils$ExitException.class{code}
> And {{DelayedStream}}:
> {code:java}
> incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream' | grep -B1 DelayedStream
> /data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$12.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$5.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$2.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$3.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$4.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$2.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$3.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$10.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$7.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$1.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$4.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$1.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$14.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$5.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$13.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$6.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$11.class
> org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$8.class
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)