Re: Leveldb on Solaris?

[jlindwall <jl...@yahoo.com>]

There still seems to be leveldb issues on Solaris under activemq 5.11.1. I'm
using Solaris 5.11.  I had 3 activemq nodes running using leveldb
replication.  I connected a client that listened for messages, but I did not
send any messages at all.

I then used "kil -9" to kill the master node.  The client failed to
reconnect even htough I used a failover url.  In the node2 activemq.log I
see the following, as it attempted to become the new master:

2015-07-22 17:57:19,334 | INFO  | Attaching to master:
tcp://172.10.10.10:61619 |
org.apache.activemq.leveldb.replicated.SlaveLevelDBStore |
hawtdispatch-DEFAULT-1
2015-07-22 17:57:19,338 | WARN  | Unexpected session error:
java.net.ConnectException: Connection refused |
org.apache.activemq.leveldb.replicated.SlaveLevelDBStore |
hawtdispatch-DEFAULT-1
2015-07-22 17:57:20,044 | INFO  | Not enough cluster members have reported
their update positions yet. |
org.apache.activemq.leveldb.replicated.MasterElector | main-EventThread
2015-07-22 17:57:20,059 | INFO  | Slave stopped |
org.apache.activemq.leveldb.replicated.MasterElector | ActiveMQ
BrokerService[xifin] Task-3
2015-07-22 17:57:20,061 | INFO  | Not enough cluster members have reported
their update positions yet. |
org.apache.activemq.leveldb.replicated.MasterElector | ActiveMQ
BrokerService[xifin] Task-3
2015-07-22 17:57:20,068 | INFO  | Not enough cluster members have reported
their update positions yet. |
org.apache.activemq.leveldb.replicated.MasterElector | main-EventThread
2015-07-22 17:57:20,087 | INFO  | Promoted to master |
org.apache.activemq.leveldb.replicated.MasterElector | main-EventThread
2015-07-22 17:57:20,124 | INFO  | Using the pure java LevelDB
implementation. | org.apache.activemq.leveldb.LevelDBClient | ActiveMQ
BrokerService[xifin] Task-3
2015-07-22 17:57:20,380 | INFO  | No IOExceptionHandler registered, ignoring
IO exception | org.apache.activemq.broker.BrokerService | LevelDB
IOException handler.
java.io.IOException: org.iq80.snappy.CorruptionException: Invalid copy
offset for opcode starting at 8
    at
org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)[activemq-client-5.11.1.jar:5.11.1]
    at
org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:552)[activemq-leveldb-store-5.11.1.jar:5.11.1]
    at
org.apache.activemq.leveldb.LevelDBClient.replay_init(LevelDBClient.scala:667)[activemq-leveldb-store-5.11.1.jar:5.11.1]
    at
org.apache.activemq.leveldb.LevelDBClient.start(LevelDBClient.scala:558)[activemq-leveldb-store-5.11.1.jar:5.11.1]
    at
org.apache.activemq.leveldb.DBManager.start(DBManager.scala:648)[activemq-leveldb-store-5.11.1.jar:5.11.1]
    at
org.apache.activemq.leveldb.LevelDBStore.doStart(LevelDBStore.scala:312)[activemq-leveldb-store-5.11.1.jar:5.11.1]
    at
org.apache.activemq.leveldb.replicated.MasterLevelDBStore.doStart(MasterLevelDBStore.scala:110)[activemq-leveldb-store-5.11.1.jar:5.11.1]
    at
org.apache.activemq.util.ServiceSupport.start(ServiceSupport.java:55)[activemq-client-5.11.1.jar:5.11.1]
    at
org.apache.activemq.leveldb.replicated.ElectingLevelDBStore$$anonfun$start_master$1.apply$mcV$sp(ElectingLevelDBStore.scala:230)[activemq-leveldb-store-5.11.1.jar:5.11.1]
    at
org.fusesource.hawtdispatch.package$$anon$4.run(hawtdispatch.scala:330)[hawtdispatch-scala-2.11-1.21.jar:1.21]
    at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7.0_60]
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7.0_60]
    at java.lang.Thread.run(Thread.java:745)[:1.7.0_60]
2015-07-22 17:57:20,400 | INFO  | Stopped
LevelDB[/home/jlindwall/servers/activemq-replicated-leveldb-cluster/node2/data/LevelDB]
| org.apache.activemq.leveldb.LevelDBStore | LevelDB IOException handler.

Anybody successfully using leveldb on solaris?

Thanks!



--
View this message in context: http://activemq.2283324.n4.nabble.com/Leveldb-on-Solaris-tp4677824p4699723.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Leveldb on Solaris?

[jlindwall <jl...@yahoo.com>]

I have reported this issue in jira:
https://issues.apache.org/jira/browse/AMQ-5900

I'm surprised at my struggle to identify a reliable HA solution for
activemq. Not sure if the issue is Solaris or issues in my config or
something else.

1. master/slave fail-over was a bust due to
https://issues.apache.org/jira/browse/AMQ-5897
2. leveldb replication fails as described above
3. JDBC persistence seems to be my only option. It appears to work properly
in the face of a master failure at least. I need to measure performance now
to see if it will be acceptable.







--
View this message in context: http://activemq.2283324.n4.nabble.com/Leveldb-on-Solaris-tp4677824p4699767.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.