You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Sanjeev Kulkarni <sa...@locomatix.com> on 2012/03/28 23:57:23 UTC
Running multiple sstable loaders
Hey guys,
We have a fresh 4 node 0.8.10 cluster that we want to pump lots of data into.
The data resides on 5 data machines that are different from Cassandra
nodes. Each of these data nodes has 7 disks where the data resides.
In order to get maximum load performance, we are assigning 7 ips to
each data node on the same interface(eth2:0, eth2:1, ...). I also make
multiple copies of cassandra conf directory(/etc/cassandra). Each
cassandra conf is identical except for listen and rpc address. We then
start multiple simultaneous sstable loaders each pointing to different
config. We do this on all data nodes.
What we are seeing is the first sstableloader on each machine starts
loading. However the rest fail with connection refused error. They log
this message 8 times and then bail out. Any idea what could be wrong?
Thanks!
Sent from my iPhone
Re: Running multiple sstable loaders
Posted by aaron morton <aa...@thelastpickle.com>.
The Cassandra server will only be bound to one ipaddress.
Cheers
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 29/03/2012, at 1:40 PM, Sanjeev Kulkarni wrote:
> Hi,
>
> Here is the stack trace that we get from sstableloader
>
> org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
> at org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:229)
> at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:104)
> at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:61)
> Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
> at org.apache.thrift.transport.TSocket.open(TSocket.java:183)
> at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)
> at org.apache.cassandra.tools.BulkLoader$ExternalClient.createThriftClient(BulkLoader.java:249)
> at org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:197)
> ... 2 more
> Caused by: java.net.ConnectException: Connection refused
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> at java.net.Socket.connect(Socket.java:529)
> at org.apache.thrift.transport.TSocket.open(TSocket.java:178)
>
>
> Thanks!
>
> On Wed, Mar 28, 2012 at 2:57 PM, Sanjeev Kulkarni <sa...@locomatix.com> wrote:
> Hey guys,
> We have a fresh 4 node 0.8.10 cluster that we want to pump lots of data into.
> The data resides on 5 data machines that are different from Cassandra
> nodes. Each of these data nodes has 7 disks where the data resides.
> In order to get maximum load performance, we are assigning 7 ips to
> each data node on the same interface(eth2:0, eth2:1, ...). I also make
> multiple copies of cassandra conf directory(/etc/cassandra). Each
> cassandra conf is identical except for listen and rpc address. We then
> start multiple simultaneous sstable loaders each pointing to different
> config. We do this on all data nodes.
> What we are seeing is the first sstableloader on each machine starts
> loading. However the rest fail with connection refused error. They log
> this message 8 times and then bail out. Any idea what could be wrong?
> Thanks!
>
>
> Sent from my iPhone
>
Re: Running multiple sstable loaders
Posted by Sanjeev Kulkarni <sa...@locomatix.com>.
Hi,
Here is the stack trace that we get from sstableloader
org.apache.thrift.transport.TTransportException: java.net.ConnectException:
Connection refused
java.lang.RuntimeException:
org.apache.thrift.transport.TTransportException: java.net.ConnectException:
Connection refused
at
org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:229)
at
org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:104)
at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:61)
Caused by: org.apache.thrift.transport.TTransportException:
java.net.ConnectException: Connection refused
at org.apache.thrift.transport.TSocket.open(TSocket.java:183)
at
org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)
at
org.apache.cassandra.tools.BulkLoader$ExternalClient.createThriftClient(BulkLoader.java:249)
at
org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:197)
... 2 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at org.apache.thrift.transport.TSocket.open(TSocket.java:178)
Thanks!
On Wed, Mar 28, 2012 at 2:57 PM, Sanjeev Kulkarni <sa...@locomatix.com>wrote:
> Hey guys,
> We have a fresh 4 node 0.8.10 cluster that we want to pump lots of data
> into.
> The data resides on 5 data machines that are different from Cassandra
> nodes. Each of these data nodes has 7 disks where the data resides.
> In order to get maximum load performance, we are assigning 7 ips to
> each data node on the same interface(eth2:0, eth2:1, ...). I also make
> multiple copies of cassandra conf directory(/etc/cassandra). Each
> cassandra conf is identical except for listen and rpc address. We then
> start multiple simultaneous sstable loaders each pointing to different
> config. We do this on all data nodes.
> What we are seeing is the first sstableloader on each machine starts
> loading. However the rest fail with connection refused error. They log
> this message 8 times and then bail out. Any idea what could be wrong?
> Thanks!
>
>
> Sent from my iPhone
>