You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Jeff Zhang <zj...@gmail.com> on 2010/03/26 10:17:06 UTC
Cassandra cluster can not been installed in different subnet ?
Hi all,
I have 6 different machines, 4 are in one subnet and the other two are in
another subnet. The following is the ip address of the 6 machines.
10.148.219.12
10.148.219.15
10.148.219.11
10.148.219.71
10.148.224.199
10.148.224.194
I make the same configuration on each machine, and finally found that only
the first 4 machines are in the ring by using command
*bin/nodeprobe -host 10.148.219.12 ring*
It looks like the other two machines in different subnet can not been
gossiped. Anyone has ideas? How can I solve this problem ?
--
Best Regards
Jeff Zhang
Re: Cassandra cluster can not been installed in different subnet ?
Posted by Jeff Zhang <zj...@gmail.com>.
This is the log, it seems everything is fine:
INFO [main] 2010-02-23 16:18:24,740 SystemTable.java (line 137) Saved Token
not found. Using 32282591296642763138586882639145887056
INFO [main] 2010-02-23 16:18:24,855 StorageService.java (line 281) Starting
up server gossip
INFO [main] 2010-02-23 16:18:24,992 StorageService.java (line 303) Starting
in bootstrap mode (first, sleeping to get load information)
INFO [main] 2010-02-23 16:21:27,852 RecoveryManager.java (line 64)
Replaying /var/lib/cassandra/commitlog/CommitLog-1266959904759.log
INFO [main] 2010-02-23 16:21:27,962 ColumnFamilyStore.java (line 393)
LocationInfo has reached its threshold; switching in a fresh Memtable
INFO [main] 2010-02-23 16:21:27,962 ColumnFamilyStore.java (line 1035)
Enqueuing flush of Memtable(LocationInfo)@1858155990
INFO [FLUSH-SORTER-POOL:1] 2010-02-23 16:21:27,965 Memtable.java (line 183)
Sorting Memtable(LocationInfo)@1858155990
INFO [FLUSH-WRITER-POOL:1] 2010-02-23 16:21:27,970 Memtable.java (line 192)
Writing Memtable(LocationInfo)@1858155990
INFO [FLUSH-WRITER-POOL:1] 2010-02-23 16:21:28,128 Memtable.java (line 209)
Completed flushing /var/lib/cassandra/data/system/LocationInfo-1-Data.db
INFO [main] 2010-02-23 16:21:28,159 RecoveryManager.java (line 67) Log
replay complete
INFO [main] 2010-02-23 16:21:28,233 SystemTable.java (line 159) Saved Token
found: 32282591296642763138586882639145887056
INFO [main] 2010-02-23 16:21:28,236 StorageService.java (line 281) Starting
up server gossip
INFO [main] 2010-02-23 16:21:28,275 StorageService.java (line 303) Starting
in bootstrap mode (first, sleeping to get load information)
INFO [main] 2010-02-23 16:23:01,102 SSTableReader.java (line 169) Sampling
index for /var/lib/cassandra/data/system/LocationInfo-1-Data.db
INFO [main] 2010-02-23 16:23:01,120 RecoveryManager.java (line 64)
Replaying /var/lib/cassandra/commitlog/CommitLog-1266960087857.log
INFO [main] 2010-02-23 16:23:01,215 ColumnFamilyStore.java (line 393)
LocationInfo has reached its threshold; switching in a fresh Memtable
INFO [main] 2010-02-23 16:23:01,218 ColumnFamilyStore.java (line 1035)
Enqueuing flush of Memtable(LocationInfo)@809222561
INFO [FLUSH-SORTER-POOL:1] 2010-02-23 16:23:01,222 Memtable.java (line 183)
Sorting Memtable(LocationInfo)@809222561
INFO [FLUSH-WRITER-POOL:1] 2010-02-23 16:23:01,226 Memtable.java (line 192)
Writing Memtable(LocationInfo)@809222561
INFO [FLUSH-WRITER-POOL:1] 2010-02-23 16:23:01,338 Memtable.java (line 209)
Completed flushing /var/lib/cassandra/data/system/LocationInfo-2-Data.db
INFO [main] 2010-02-23 16:23:01,348 RecoveryManager.java (line 67) Log
replay complete
INFO [main] 2010-02-23 16:23:01,427 SystemTable.java (line 159) Saved Token
found: 32282591296642763138586882639145887056
INFO [main] 2010-02-23 16:23:01,430 StorageService.java (line 281) Starting
up server gossip
INFO [main] 2010-02-23 16:23:01,462 StorageService.java (line 303) Starting
in bootstrap mode (first, sleeping to get load information)
INFO [FLUSH-TIMER] 2010-02-23 17:23:01,640 ColumnFamilyStore.java (line
393) LocationInfo has reached its threshold; switching in a fresh Memtable
INFO [FLUSH-TIMER] 2010-02-23 17:23:01,646 ColumnFamilyStore.java (line
1035) Enqueuing flush of Memtable(LocationInfo)@995102461
INFO [FLUSH-SORTER-POOL:1] 2010-02-23 17:23:01,646 Memtable.java (line 183)
Sorting Memtable(LocationInfo)@995102461
INFO [FLUSH-WRITER-POOL:1] 2010-02-23 17:23:01,647 Memtable.java (line 192)
Writing Memtable(LocationInfo)@995102461
INFO [HINTED-HANDOFF-POOL:1] 2010-02-23 17:23:01,840 ColumnFamilyStore.java
(line 875) Compacting []
INFO [FLUSH-WRITER-POOL:1] 2010-02-23 17:23:01,862 Memtable.java (line 209)
Completed flushing /var/lib/cassandra/data/system/LocationInfo-3-Data.db
INFO [HINTED-HANDOFF-POOL:1] 2010-02-23 18:23:02,217 ColumnFamilyStore.java
(line 875) Compacting []
INFO [HINTED-HANDOFF-POOL:1] 2010-02-23 19:23:02,767 ColumnFamilyStore.java
(line 875) Compacting []
INFO [HINTED-HANDOFF-POOL:1] 2010-02-23 20:23:03,578 ColumnFamilyStore.java
(line 875) Compacting []
INFO [main] 2010-03-26 05:05:50,581 SSTableReader.java (line 169) Sampling
index for /var/lib/cassandra/data/system/LocationInfo-1-Data.db
INFO [main] 2010-03-26 05:05:50,654 SSTableReader.java (line 169) Sampling
index for /var/lib/cassandra/data/system/LocationInfo-2-Data.db
INFO [main] 2010-03-26 05:05:50,665 SSTableReader.java (line 169) Sampling
index for /var/lib/cassandra/data/system/LocationInfo-3-Data.db
INFO [main] 2010-03-26 05:05:50,698 RecoveryManager.java (line 64)
Replaying /var/lib/cassandra/commitlog/CommitLog-1266960181124.log
INFO [main] 2010-03-26 05:05:50,837 RecoveryManager.java (line 67) Log
replay complete
INFO [main] 2010-03-26 05:05:50,992 SystemTable.java (line 159) Saved Token
found: 32282591296642763138586882639145887056
INFO [main] 2010-03-26 05:05:51,040 StorageService.java (line 281) Starting
up server gossip
INFO [main] 2010-03-26 05:05:51,217 CassandraDaemon.java (line 141)
Cassandra starting up...
INFO [FLUSH-TIMER] 2010-03-26 06:05:51,115 ColumnFamilyStore.java (line
393) LocationInfo has reached its threshold; switching in a fresh Memtable
INFO [FLUSH-TIMER] 2010-03-26 06:05:51,119 ColumnFamilyStore.java (line
1035) Enqueuing flush of Memtable(LocationInfo)@818048143
INFO [FLUSH-SORTER-POOL:1] 2010-03-26 06:05:51,121 Memtable.java (line 183)
Sorting Memtable(LocationInfo)@818048143
INFO [FLUSH-WRITER-POOL:1] 2010-03-26 06:05:51,125 Memtable.java (line 192)
Writing Memtable(LocationInfo)@818048143
INFO [HINTED-HANDOFF-POOL:1] 2010-03-26 06:05:51,250 ColumnFamilyStore.java
(line 875) Compacting []
INFO [FLUSH-WRITER-POOL:1] 2010-03-26 06:05:51,315 Memtable.java (line 209)
Completed flushing /var/lib/cassandra/data/system/LocationInfo-4-Data.db
INFO [COMPACTION-POOL:1] 2010-03-26 06:05:51,318 ColumnFamilyStore.java
(line 875) Compacting
[org.apache.cassandra.io.SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-1-Data.db'),org.apache.cassandra.io.SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-2-Data.db'),org.apache.cassandra.io.SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-3-Data.db'),org.apache.cassandra.io.SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-4-Data.db')]
INFO [COMPACTION-POOL:1] 2010-03-26 06:05:51,509 ColumnFamilyStore.java
(line 943) Compacted to
/var/lib/cassandra/data/system/LocationInfo-5-Data.db. 1130/458 bytes for 2
keys. Time: 189ms.
INFO [SSTABLE-DELETER] 2010-03-26 06:05:56,661 SSTable.java (line 161)
Deleted /var/lib/cassandra/data/system/LocationInfo-2-Data.db
On Fri, Mar 26, 2010 at 8:23 PM, Jonathan Ellis <jb...@gmail.com> wrote:
> Different subnet isn't a problem from Cassandra's point of view, but
> it might be if your network is doing something funky.
>
> Did you check the logs on one of the machines that isn't in the ring?
>
> On Fri, Mar 26, 2010 at 4:17 AM, Jeff Zhang <zj...@gmail.com> wrote:
> > Hi all,
> >
> > I have 6 different machines, 4 are in one subnet and the other two are in
> > another subnet. The following is the ip address of the 6 machines.
> >
> > 10.148.219.12
> > 10.148.219.15
> > 10.148.219.11
> > 10.148.219.71
> > 10.148.224.199
> > 10.148.224.194
> >
> > I make the same configuration on each machine, and finally found that
> only
> > the first 4 machines are in the ring by using command
> > bin/nodeprobe -host 10.148.219.12 ring
> >
> > It looks like the other two machines in different subnet can not been
> > gossiped. Anyone has ideas? How can I solve this problem ?
> >
> >
> >
> > --
> > Best Regards
> >
> > Jeff Zhang
> >
>
--
Best Regards
Jeff Zhang
Re: Cassandra cluster can not been installed in different subnet ?
Posted by Jonathan Ellis <jb...@gmail.com>.
Different subnet isn't a problem from Cassandra's point of view, but
it might be if your network is doing something funky.
Did you check the logs on one of the machines that isn't in the ring?
On Fri, Mar 26, 2010 at 4:17 AM, Jeff Zhang <zj...@gmail.com> wrote:
> Hi all,
>
> I have 6 different machines, 4 are in one subnet and the other two are in
> another subnet. The following is the ip address of the 6 machines.
>
> 10.148.219.12
> 10.148.219.15
> 10.148.219.11
> 10.148.219.71
> 10.148.224.199
> 10.148.224.194
>
> I make the same configuration on each machine, and finally found that only
> the first 4 machines are in the ring by using command
> bin/nodeprobe -host 10.148.219.12 ring
>
> It looks like the other two machines in different subnet can not been
> gossiped. Anyone has ideas? How can I solve this problem ?
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>