You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by S C <as...@outlook.com> on 2013/06/25 05:35:56 UTC
copy data between clusters
I have a scenario here. I have a cluster A and cluster B running on cassandra 1.1. I need to copy data from Cluster A to Cluster B. Cluster A has few keyspaces that I need to copy over to Cluster B. What are my options?
Thanks,SC
Re: copy data between clusters
Posted by Arthur Zubarev <Ar...@Aol.com>.
This is the best reference I have seen so far http://www.datastax.com/dev/blog/bulk-loading But I must tell it is not updated to match the most recent changes in C*. I suggest you read thru comments, too.
From: S C
Sent: Tuesday, June 25, 2013 10:23 PM
To: user@cassandra.apache.org
Subject: RE: copy data between clusters
Is there any configuration reference that help me?
Thanks,
SC
--------------------------------------------------------------------------------
From: Arthur.Zubarev@Aol.com
To: user@cassandra.apache.org
Subject: Re: copy data between clusters
Date: Tue, 25 Jun 2013 20:30:23 -0400
Hello SC,
whilst most of the sstableloader errors stem from incorrect setups I suspect this time you merely have a connectivity issue e.g. a firewall blocking traffic.
From: S C
Sent: Tuesday, June 25, 2013 5:28 PM
To: user@cassandra.apache.org
Subject: RE: copy data between clusters
Bob and Arthur - thanks for your inputs.
I tried sstableloader but ran into below issue. Anything to do with the configuration to run sstableloader?
sstableloader -d 10.225.64.2,10.225.64.3 service/context
INFO 14:43:49,937 Opening service/context/service-context-hf-50 (164863 bytes)
DEBUG 14:43:50,063 INDEX LOAD TIME for service/context/service-context-hf-50: 128 ms.
INFO 14:43:50,063 Opening service/context/service-context-hf-49 (7688939 bytes)
DEBUG 14:43:50,076 INDEX LOAD TIME for service/context/service-context-hf-49: 13 ms.
INFO 14:43:50,076 Opening service/context/service-context-hf-51 (6703 bytes)
DEBUG 14:43:50,078 INDEX LOAD TIME for service/context/service-context-hf-51: 2 ms.
Streaming revelant part of service/context/service-context-hf-50-Data.db service/context/service-context-hf-49-Data.db service/context/service-context-hf-51-Data.db to [/10.225.64.2, /10.225.64.3]
INFO 14:43:50,124 Stream context metadata [service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%], 3 sstables.
DEBUG 14:43:50,124 Adding file service/context/service-context-hf-50-Data.db to be streamed.
DEBUG 14:43:50,124 Adding file service/context/service-context-hf-49-Data.db to be streamed.
DEBUG 14:43:50,124 Adding file service/context/service-context-hf-51-Data.db to be streamed.
INFO 14:43:50,136 Streaming to /10.225.64.2
DEBUG 14:43:50,144 Files are service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%
INFO 14:43:50,159 Stream context metadata [service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%], 3 sstables.
DEBUG 14:43:50,159 Adding file service/context/service-context-hf-50-Data.db to be streamed.
DEBUG 14:43:50,159 Adding file service/context/service-context-hf-49-Data.db to be streamed.
DEBUG 14:43:50,160 Adding file service/context/service-context-hf-51-Data.db to be streamed.
INFO 14:43:50,160 Streaming to /10.225.64.3
DEBUG 14:43:50,160 Files are service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:43:50,225 Failed attempt 1 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
WARN 14:43:50,241 Failed attempt 1 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:43:54,227 Failed attempt 2 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
WARN 14:43:54,244 Failed attempt 2 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:44:02,229 Failed attempt 3 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
WARN 14:44:02,309 Failed attempt 3 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]DEBUG 14:44:18,231 closing with status false
Streaming session to /10.225.64.3 failed
ERROR 14:44:18,236 Error in ThreadPoolExecutor
java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
Exception in thread "Streaming to /10.225.64.3:1" java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
DEBUG 14:44:18,311 closing with status false
Streaming session to /10.225.64.2 failed
ERROR 14:44:18,311 Error in ThreadPoolExecutor
java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
Exception in thread "Streaming to /10.225.64.2:1" java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]Streaming to the following hosts failed:
[/10.225.64.3, /10.225.64.2]
Thanks,
SC
> Date: Tue, 25 Jun 2013 11:20:03 -0700
> Subject: Re: copy data between clusters
> From: rcoli@eventbrite.com
> To: user@cassandra.apache.org
>
> On Mon, Jun 24, 2013 at 8:35 PM, S C <as...@outlook.com> wrote:
> > I have a scenario here. I have a cluster A and cluster B running on
> > cassandra 1.1. I need to copy data from Cluster A to Cluster B. Cluster A
> > has few keyspaces that I need to copy over to Cluster B. What are my
> > options?
>
> http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
>
> =Rob
RE: copy data between clusters
Posted by S C <as...@outlook.com>.
Is there any configuration reference that help me?
Thanks,SC
From: Arthur.Zubarev@Aol.com
To: user@cassandra.apache.org
Subject: Re: copy data between clusters
Date: Tue, 25 Jun 2013 20:30:23 -0400
Hello SC,
whilst most of the sstableloader errors stem from incorrect setups I
suspect this time you merely have a connectivity issue e.g. a firewall blocking
traffic.
From: S C
Sent: Tuesday, June 25, 2013 5:28 PM
To: user@cassandra.apache.org
Subject: RE: copy data between clusters
Bob and Arthur - thanks for your inputs.
I tried sstableloader but ran into below issue. Anything to do with the
configuration to run sstableloader?
sstableloader -d 10.225.64.2,10.225.64.3 service/context
INFO 14:43:49,937 Opening service/context/service-context-hf-50 (164863
bytes)
DEBUG 14:43:50,063 INDEX LOAD TIME for
service/context/service-context-hf-50: 128 ms.
INFO 14:43:50,063 Opening service/context/service-context-hf-49 (7688939
bytes)
DEBUG 14:43:50,076 INDEX LOAD TIME for
service/context/service-context-hf-49: 13 ms.
INFO 14:43:50,076 Opening service/context/service-context-hf-51 (6703
bytes)
DEBUG 14:43:50,078 INDEX LOAD TIME for
service/context/service-context-hf-51: 2 ms.
Streaming revelant part of service/context/service-context-hf-50-Data.db
service/context/service-context-hf-49-Data.db
service/context/service-context-hf-51-Data.db to [/10.225.64.2,
/10.225.64.3]
INFO 14:43:50,124 Stream context metadata
[service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 -
0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939
- 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 -
0%], 3 sstables.
DEBUG 14:43:50,124 Adding file
service/context/service-context-hf-50-Data.db to be streamed.
DEBUG 14:43:50,124 Adding file
service/context/service-context-hf-49-Data.db to be streamed.
DEBUG 14:43:50,124 Adding file
service/context/service-context-hf-51-Data.db to be streamed.
INFO 14:43:50,136 Streaming to /10.225.64.2
DEBUG 14:43:50,144 Files are service/context/service-context-hf-49-Data.db
sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db
sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db
sections=1 progress=0/164863 - 0%
INFO 14:43:50,159 Stream context metadata
[service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 -
0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939
- 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 -
0%], 3 sstables.
DEBUG 14:43:50,159 Adding file
service/context/service-context-hf-50-Data.db to be streamed.
DEBUG 14:43:50,159 Adding file
service/context/service-context-hf-49-Data.db to be streamed.
DEBUG 14:43:50,160 Adding file
service/context/service-context-hf-51-Data.db to be streamed.
INFO 14:43:50,160 Streaming to /10.225.64.3
DEBUG 14:43:50,160 Files are service/context/service-context-hf-49-Data.db
sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db
sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db
sections=1 progress=0/164863 - 0%
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s
(avg: 0MB/s)] WARN 14:43:50,225 Failed attempt 1 to connect to /10.225.64.3 to
stream service/context/service-context-hf-49-Data.db sections=1
progress=0/7688939 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid
argument or cannot assign requested address)
WARN 14:43:50,241 Failed attempt 1 to connect to /10.225.64.2 to stream
service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 -
0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot
assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s
(avg: 0MB/s)] WARN 14:43:54,227 Failed attempt 2 to connect to /10.225.64.3 to
stream service/context/service-context-hf-49-Data.db sections=1
progress=0/7688939 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid
argument or cannot assign requested address)
WARN 14:43:54,244 Failed attempt 2 to connect to /10.225.64.2 to stream
service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 -
0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot
assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s
(avg: 0MB/s)] WARN 14:44:02,229 Failed attempt 3 to connect to /10.225.64.3 to
stream service/context/service-context-hf-49-Data.db sections=1
progress=0/7688939 - 0%. Retrying in 16000 ms. (java.net.SocketException:
Invalid argument or cannot assign requested address)
WARN 14:44:02,309 Failed attempt 3 to connect to /10.225.64.2 to stream
service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 -
0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot
assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s
(avg: 0MB/s)]DEBUG 14:44:18,231 closing with status false
Streaming session to /10.225.64.3 failed
ERROR 14:44:18,236 Error in ThreadPoolExecutor
java.lang.RuntimeException: java.net.SocketException: Invalid argument or
cannot assign requested address
at
org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at
java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign
requested address
at
java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at
java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at
java.net.Socket.connect(Socket.java:529)
at
java.net.Socket.connect(Socket.java:478)
at
java.net.Socket.<init>(Socket.java:375)
at
java.net.Socket.<init>(Socket.java:276)
at
org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at
org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at
org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
Exception in thread "Streaming to /10.225.64.3:1"
java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot
assign requested address
at
org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at
java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign
requested address
at
java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at
java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at
java.net.Socket.connect(Socket.java:529)
at
java.net.Socket.connect(Socket.java:478)
at
java.net.Socket.<init>(Socket.java:375)
at
java.net.Socket.<init>(Socket.java:276)
at
org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at
org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at
org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
DEBUG 14:44:18,311 closing with status false
Streaming session to /10.225.64.2 failed
ERROR 14:44:18,311 Error in ThreadPoolExecutor
java.lang.RuntimeException: java.net.SocketException: Invalid argument or
cannot assign requested address
at
org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at
java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign
requested address
at
java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at
java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at
java.net.Socket.connect(Socket.java:529)
at
java.net.Socket.connect(Socket.java:478)
at
java.net.Socket.<init>(Socket.java:375)
at
java.net.Socket.<init>(Socket.java:276)
at
org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at
org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at
org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
Exception in thread "Streaming to /10.225.64.2:1"
java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot
assign requested address
at
org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at
java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign
requested address
at
java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at
java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at
java.net.Socket.connect(Socket.java:529)
at
java.net.Socket.connect(Socket.java:478)
at
java.net.Socket.<init>(Socket.java:375)
at
java.net.Socket.<init>(Socket.java:276)
at
org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at
org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at
org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s
(avg: 0MB/s)]Streaming to the following hosts failed:
[/10.225.64.3, /10.225.64.2]
Thanks,
SC
> Date: Tue, 25 Jun 2013 11:20:03 -0700
> Subject: Re: copy data
between clusters
> From: rcoli@eventbrite.com
> To:
user@cassandra.apache.org
>
> On Mon, Jun 24, 2013 at 8:35 PM, S C
<as...@outlook.com> wrote:
> > I have a scenario here. I have a
cluster A and cluster B running on
> > cassandra 1.1. I need to copy
data from Cluster A to Cluster B. Cluster A
> > has few keyspaces that
I need to copy over to Cluster B. What are my
> > options?
>
>
http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
>
> =Rob
Re: copy data between clusters
Posted by Arthur Zubarev <Ar...@Aol.com>.
Hello SC,
whilst most of the sstableloader errors stem from incorrect setups I suspect this time you merely have a connectivity issue e.g. a firewall blocking traffic.
From: S C
Sent: Tuesday, June 25, 2013 5:28 PM
To: user@cassandra.apache.org
Subject: RE: copy data between clusters
Bob and Arthur - thanks for your inputs.
I tried sstableloader but ran into below issue. Anything to do with the configuration to run sstableloader?
sstableloader -d 10.225.64.2,10.225.64.3 service/context
INFO 14:43:49,937 Opening service/context/service-context-hf-50 (164863 bytes)
DEBUG 14:43:50,063 INDEX LOAD TIME for service/context/service-context-hf-50: 128 ms.
INFO 14:43:50,063 Opening service/context/service-context-hf-49 (7688939 bytes)
DEBUG 14:43:50,076 INDEX LOAD TIME for service/context/service-context-hf-49: 13 ms.
INFO 14:43:50,076 Opening service/context/service-context-hf-51 (6703 bytes)
DEBUG 14:43:50,078 INDEX LOAD TIME for service/context/service-context-hf-51: 2 ms.
Streaming revelant part of service/context/service-context-hf-50-Data.db service/context/service-context-hf-49-Data.db service/context/service-context-hf-51-Data.db to [/10.225.64.2, /10.225.64.3]
INFO 14:43:50,124 Stream context metadata [service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%], 3 sstables.
DEBUG 14:43:50,124 Adding file service/context/service-context-hf-50-Data.db to be streamed.
DEBUG 14:43:50,124 Adding file service/context/service-context-hf-49-Data.db to be streamed.
DEBUG 14:43:50,124 Adding file service/context/service-context-hf-51-Data.db to be streamed.
INFO 14:43:50,136 Streaming to /10.225.64.2
DEBUG 14:43:50,144 Files are service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%
INFO 14:43:50,159 Stream context metadata [service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%], 3 sstables.
DEBUG 14:43:50,159 Adding file service/context/service-context-hf-50-Data.db to be streamed.
DEBUG 14:43:50,159 Adding file service/context/service-context-hf-49-Data.db to be streamed.
DEBUG 14:43:50,160 Adding file service/context/service-context-hf-51-Data.db to be streamed.
INFO 14:43:50,160 Streaming to /10.225.64.3
DEBUG 14:43:50,160 Files are service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:43:50,225 Failed attempt 1 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
WARN 14:43:50,241 Failed attempt 1 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:43:54,227 Failed attempt 2 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
WARN 14:43:54,244 Failed attempt 2 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:44:02,229 Failed attempt 3 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
WARN 14:44:02,309 Failed attempt 3 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]DEBUG 14:44:18,231 closing with status false
Streaming session to /10.225.64.3 failed
ERROR 14:44:18,236 Error in ThreadPoolExecutor
java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
Exception in thread "Streaming to /10.225.64.3:1" java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
DEBUG 14:44:18,311 closing with status false
Streaming session to /10.225.64.2 failed
ERROR 14:44:18,311 Error in ThreadPoolExecutor
java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
Exception in thread "Streaming to /10.225.64.2:1" java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address
at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.SocketException: Invalid argument or cannot assign requested address
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:529)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.<init>(Socket.java:375)
at java.net.Socket.<init>(Socket.java:276)
at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96)
at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245)
at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
... 3 more
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]Streaming to the following hosts failed:
[/10.225.64.3, /10.225.64.2]
Thanks,
SC
> Date: Tue, 25 Jun 2013 11:20:03 -0700
> Subject: Re: copy data between clusters
> From: rcoli@eventbrite.com
> To: user@cassandra.apache.org
>
> On Mon, Jun 24, 2013 at 8:35 PM, S C <as...@outlook.com> wrote:
> > I have a scenario here. I have a cluster A and cluster B running on
> > cassandra 1.1. I need to copy data from Cluster A to Cluster B. Cluster A
> > has few keyspaces that I need to copy over to Cluster B. What are my
> > options?
>
> http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
>
> =Rob
RE: copy data between clusters
Posted by S C <as...@outlook.com>.
Bob and Arthur - thanks for your inputs.
I tried sstableloader but ran into below issue. Anything to do with the configuration to run sstableloader?
sstableloader -d 10.225.64.2,10.225.64.3 service/context INFO 14:43:49,937 Opening service/context/service-context-hf-50 (164863 bytes)DEBUG 14:43:50,063 INDEX LOAD TIME for service/context/service-context-hf-50: 128 ms. INFO 14:43:50,063 Opening service/context/service-context-hf-49 (7688939 bytes)DEBUG 14:43:50,076 INDEX LOAD TIME for service/context/service-context-hf-49: 13 ms. INFO 14:43:50,076 Opening service/context/service-context-hf-51 (6703 bytes)DEBUG 14:43:50,078 INDEX LOAD TIME for service/context/service-context-hf-51: 2 ms.Streaming revelant part of service/context/service-context-hf-50-Data.db service/context/service-context-hf-49-Data.db service/context/service-context-hf-51-Data.db to [/10.225.64.2, /10.225.64.3] INFO 14:43:50,124 Stream context metadata [service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%], 3 sstables.DEBUG 14:43:50,124 Adding file service/context/service-context-hf-50-Data.db to be streamed.DEBUG 14:43:50,124 Adding file service/context/service-context-hf-49-Data.db to be streamed.DEBUG 14:43:50,124 Adding file service/context/service-context-hf-51-Data.db to be streamed. INFO 14:43:50,136 Streaming to /10.225.64.2DEBUG 14:43:50,144 Files are service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0% INFO 14:43:50,159 Stream context metadata [service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%, service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%, service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%], 3 sstables.DEBUG 14:43:50,159 Adding file service/context/service-context-hf-50-Data.db to be streamed.DEBUG 14:43:50,159 Adding file service/context/service-context-hf-49-Data.db to be streamed.DEBUG 14:43:50,160 Adding file service/context/service-context-hf-51-Data.db to be streamed. INFO 14:43:50,160 Streaming to /10.225.64.3DEBUG 14:43:50,160 Files are service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%,service/context/service-context-hf-51-Data.db sections=1 progress=0/6703 - 0%,service/context/service-context-hf-50-Data.db sections=1 progress=0/164863 - 0%
progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:43:50,225 Failed attempt 1 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 14:43:50,241 Failed attempt 1 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:43:54,227 Failed attempt 2 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 14:43:54,244 Failed attempt 2 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 14:44:02,229 Failed attempt 3 to connect to /10.225.64.3 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 14:44:02,309 Failed attempt 3 to connect to /10.225.64.2 to stream service/context/service-context-hf-49-Data.db sections=1 progress=0/7688939 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address)progress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]DEBUG 14:44:18,231 closing with status falseStreaming session to /10.225.64.3 failedERROR 14:44:18,236 Error in ThreadPoolExecutorjava.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662)Caused by: java.net.SocketException: Invalid argument or cannot assign requested address at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at java.net.Socket.connect(Socket.java:478) at java.net.Socket.<init>(Socket.java:375) at java.net.Socket.<init>(Socket.java:276) at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96) at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245) at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) ... 3 moreException in thread "Streaming to /10.225.64.3:1" java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662)Caused by: java.net.SocketException: Invalid argument or cannot assign requested address at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at java.net.Socket.connect(Socket.java:478) at java.net.Socket.<init>(Socket.java:375) at java.net.Socket.<init>(Socket.java:276) at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96) at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245) at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) ... 3 moreDEBUG 14:44:18,311 closing with status falseStreaming session to /10.225.64.2 failedERROR 14:44:18,311 Error in ThreadPoolExecutorjava.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662)Caused by: java.net.SocketException: Invalid argument or cannot assign requested address at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at java.net.Socket.connect(Socket.java:478) at java.net.Socket.<init>(Socket.java:375) at java.net.Socket.<init>(Socket.java:276) at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96) at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245) at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) ... 3 moreException in thread "Streaming to /10.225.64.2:1" java.lang.RuntimeException: java.net.SocketException: Invalid argument or cannot assign requested address at org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:636) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662)Caused by: java.net.SocketException: Invalid argument or cannot assign requested address at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at java.net.Socket.connect(Socket.java:478) at java.net.Socket.<init>(Socket.java:375) at java.net.Socket.<init>(Socket.java:276) at org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:96) at org.apache.cassandra.streaming.FileStreamTask.connectAttempt(FileStreamTask.java:245) at org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) ... 3 moreprogress: [/10.225.64.2 0/3 (0)] [/10.225.64.3 0/3 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]Streaming to the following hosts failed:[/10.225.64.3, /10.225.64.2]
Thanks,SC
> Date: Tue, 25 Jun 2013 11:20:03 -0700
> Subject: Re: copy data between clusters
> From: rcoli@eventbrite.com
> To: user@cassandra.apache.org
>
> On Mon, Jun 24, 2013 at 8:35 PM, S C <as...@outlook.com> wrote:
> > I have a scenario here. I have a cluster A and cluster B running on
> > cassandra 1.1. I need to copy data from Cluster A to Cluster B. Cluster A
> > has few keyspaces that I need to copy over to Cluster B. What are my
> > options?
>
> http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
>
> =Rob
Re: copy data between clusters
Posted by Robert Coli <rc...@eventbrite.com>.
On Mon, Jun 24, 2013 at 8:35 PM, S C <as...@outlook.com> wrote:
> I have a scenario here. I have a cluster A and cluster B running on
> cassandra 1.1. I need to copy data from Cluster A to Cluster B. Cluster A
> has few keyspaces that I need to copy over to Cluster B. What are my
> options?
http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
=Rob
Re: copy data between clusters
Posted by Arthur Zubarev <ar...@aol.com>.
On 06/24/2013 11:35 PM, S C wrote:
> I have a scenario here. I have a cluster A and cluster B running on
> cassandra 1.1. I need to copy data from Cluster A to Cluster B.
> Cluster A has few keyspaces that I need to copy over to Cluster B.
> What are my options?
>
> Thanks,
> SC
I am thinking of SSTABLELOADER (bulk insert) which would stream your KS
sstables to the target cluster nodes.
--
Regards,
Arthur