You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Lucas Alvarez <lu...@gmail.com> on 2017/08/01 19:42:40 UTC
Cassandra failed to start when trying to move to multi-node
Hi, I'm trying to configure Cassandra as a cluster with two nodes. When
trying to simple start the first node just changing this parameters:
listen_address: 10.29.30.2
seed_provider: 10.29.30.2
rpc_address: 10.29.30.2
auto_bootstrap: false
I'm getting this message and then cassandra stop loading:
INFO [main] 2017-08-01 15:10:13,474 StorageService.java:2087 - Node /
10.29.32.141 state jump to NORMAL
DEBUG [main] 2017-08-01 15:10:13,479 StorageService.java:1336 - NORMAL
INFO [main] 2017-08-01 15:10:13,486 CassandraDaemon.java:689 - Waiting for
gossip to settle before accepting client requests...
DEBUG [PendingRangeCalculator:1] 2017-08-01 15:10:13,491
PendingRangeCalculatorService.java:66 - finished calculation for 3
keyspaces in 8ms
INFO [StorageServiceShutdownHook] 2017-08-01 15:10:17,848
Gossiper.java:1500 - Announcing shutdown
I have googled to death and I'm not able to find any solution nor
explanation.
Any help will be appreciated.
Thanks in advance.
Lucas
Re: Cassandra failed to start when trying to move to multi-node
Posted by Michael Shuler <mi...@pbandjelly.org>.
10.29.30.2 does not appear to be the IP of the node, if you got "Node
/10.29.32.141 state jump to NORMAL" as the first logged state change
from StorageService. Usually this first entry is the node's local IP
address. Later in the log, you'll see OutboundTcpConnection handshakes
and state change from the other nodes, once they start gossiping.
--
Michael
On 08/01/2017 02:42 PM, Lucas Alvarez wrote:
> Hi, I'm trying to configure Cassandra as a cluster with two nodes. When
> trying to simple start the first node just changing this parameters:
>
> listen_address: 10.29.30.2
> seed_provider: 10.29.30.2
> rpc_address: 10.29.30.2
> auto_bootstrap: false
>
> I'm getting this message and then cassandra stop loading:
>
> INFO [main] 2017-08-01 15:10:13,474 StorageService.java:2087 - Node
> /10.29.32.141 <http://10.29.32.141> state jump to NORMAL
> DEBUG [main] 2017-08-01 15:10:13,479 StorageService.java:1336 - NORMAL
> INFO [main] 2017-08-01 15:10:13,486 CassandraDaemon.java:689 - Waiting
> for gossip to settle before accepting client requests...
> DEBUG [PendingRangeCalculator:1] 2017-08-01 15:10:13,491
> PendingRangeCalculatorService.java:66 - finished calculation for 3
> keyspaces in 8ms
> INFO [StorageServiceShutdownHook] 2017-08-01 15:10:17,848
> Gossiper.java:1500 - Announcing shutdown
>
> I have googled to death and I'm not able to find any solution nor
> explanation.
> Any help will be appreciated.
>
> Thanks in advance.
>
> Lucas
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
For additional commands, e-mail: user-help@cassandra.apache.org
Re: Cassandra failed to start when trying to move to multi-node
Posted by Lucas Alvarez <lu...@gmail.com>.
Hi Guys,
Sincerely I can't believe the poor log description cassandra has. I'm
really annoyed of it. I'll be very grateful if someone can tell me what
I'm doing wrong.These are the system.log
DEBUG [MigrationStage:1] 2017-08-01 19:05:32,316 MigrationManager.java:559
- Gossiping my schema version 86afa796-d883-3932-aa73-6b017cef0d19
INFO [main] 2017-08-01 19:05:32,321 CassandraDaemon.java:689 - Waiting for
gossip to settle before accepting client requests...
INFO [StorageServiceShutdownHook] 2017-08-01 19:05:37,139
Gossiper.java:1500 - Announcing shutdown
DEBUG [StorageServiceShutdownHook] 2017-08-01 19:05:37,145
StorageService.java:2084 - Node /10.29.32.141 state shutdown, token
[-1123972637282389021, -1128298667864406016, -1171617287587824921,
-1215843289747623916, -1237937532710359480, -1345880644695771882,
-1349885349161311671, -1362145484087002762, -1440959214603770852,
-1512070380045849364, -15562558941953290, -1591004378839652311,
-1694940268226046775, -1864518086513990320, -1896042425201339911,
-1994292418109908520, -2003588030553215254, -2043188303385004470,
-2055903703812384971, -2109331550938473986, -2122939046043806143,
-2143152627026803975, -2185565512541871884, -2415386864109182287,
-2430846502581329454, -2470138951219298346, -2492107031933585878,
-2587773444277550225, -2637579687313334505, -2735172492291292485,
-2827584735019087585, -290431611581338475, -3071603742423637708,
-3095470153210902324, -3131544462929190835, -3135674413617886725,
-3150440806943715941, -3178396675409442894, -318497997504024006,
-3201019541810055282, -3258165039073354815, -3261780972325383197,
-3278940591444654530, -3345266284193299339, -3422326361881279245,
-3487586668918769359, -3718794461538622174, -3801631139742567423,
-3843670578950890216, -3898829803832756540, -3935407498402044613,
-4251851692152635043, -4415945217017668767, -4452225071746131035,
-453312989101992613, -4839451892769253701, -4973005214058730250,
-5053121942845257846, -5125285697334830036, -5221264363601323946,
-5262268255024886151, -5308112226622381003, -5340754668904733684,
-5355765644228414304, -5459951554417868743, -5469791190167080668,
-5527706442799493981, -559480126390194624, -5689197963457359544,
-5710004903145545370, -5710062375033871504, -58307316983765202,
-5855281765529735420, -5919381082238614185, -5942611986193812207,
-5967329331479625927, -6043267858375974505, -6087175412435843974,
-6094541573537230749, -6246887755069175918, -6280211006509663763,
-6315076974978783216, -6496176019797645480, -6647004211063512670,
-6880104183008897702, -6945857193189828758, -6999768735261214984,
-7158840023093635895, -7269185753501792655, -7323201607900629439,
-744809024780577313, -7649650761736084417, -7666412950471098887,
-7750430497460298689, -7756210366708927339, -7772309298440548768,
-7794625355497929618, -7814051108149202384, -7945368179631418161,
-7975820666185853623, -8121484732018222381, -815626395204134758,
-8188734319418852782, -8203139661838238638, -834506117667975763,
-8362422499286771777, -8426979645752596060, -8451255929616297204,
-8470204464683881322, -8478587847171371050, -8547549412865634230,
-8548035921147149972, -855526750771608018, -8688793174634127296,
-890032833656406846, -893190419569470168, -9051215292531123931,
-962827266461007569, -992770120048953975, 1157249903676150022,
1216324593091504942, 1312337923119780731, 1349448566688352375,
1369333885339882116, 1422138074730275595, 1444912153175734656,
1618884083254618295, 1650714171726687105, 1766820778600528592,
1827094503419133606, 1844353071833421671, 1846691290460555677,
1871123789771135573, 2001059651014325643, 205551488443047106,
2225900781613463715, 2235953372648717266, 224705851767608836,
22797385381515442, 2307318513561489489, 2515829181112560290,
2553364043852683755, 2651896619582180223, 2661175220973492595,
2708080120032361248, 2727648522528026014, 2731295026313523765,
2775444638430797813, 2838818340986386519, 2877910534714789924,
2924407888116243723, 3020357673071192148, 3097435134130345321,
3147758686908008129, 3243420657610994074, 3250920343344209253,
3277866773734103071, 3360948993344871080, 33715193809407712,
3399299329564806585, 3401626455895202317, 3502398306068447099,
3767304883331801067, 3774426950675899295, 3808180916121124450,
3808458941356873995, 3826803268498853584, 3864485432255730689,
3868616704793677452, 4112215614749137106, 4114694661896302657,
4186640741391099326, 4258288096841274725, 4261221646546445003,
426415935612277396, 4300203411069681689, 4465225791823721468,
4466468504386485494, 4506167237972845399, 4575257705631561911,
4700766086930901605, 4701868928277061736, 4794410065338314971,
4830352262513059936, 4941595487977074494, 4978148461725532210,
4988027989860100317, 4992483162624735456, 5005270899994630227,
5043195386233719595, 5070811491271577796, 5142888664069214922,
5262763252301787651, 5303355533952014988, 5357724928405091434,
5475138402136431120, 554552177710648199, 5676029841178228460,
5736545750793928834, 5740683747595890694, 5925516161374366119,
6325539555342531333, 6357582985139266394, 6400217122343960115,
6474060369305726565, 6547491929913303151, 6559772567796960500,
6561247022463110593, 6621151753506872565, 6662039629158919207,
6713858637760455811, 6751988524307641836, 6934203270970235594,
7042390114900064697, 7125878639626292365, 7158693599571628275,
7174179556792367795, 7178302670002903033, 7195418900006090721,
7276665549433439391, 7312699192980114750, 7340295785328472937,
7341146721656375708, 735832431766951276, 7434285810272085104,
7539649930471119820, 7599730928320343829, 7671767269976298451,
7678154641033771825, 7921897317708587063, 7946360927450325271,
7992064179664888221, 8007596913323880825, 8050859022557671023,
8137926892567351696, 826807539950087629, 8273174983945304215,
8335285679470661011, 8357503025304924744, 8451704382530717978,
8525103810099812322, 8554219960465655404, 8567428922692368703,
8600150647697144536, 8610537152298362563, 8620209924051181934,
8639678152040349448, 8642884911447609026, 8694521314822213924,
8775936008051835782, 8789742364127110116, 9033635072981469761,
9113641059980450476, 9195231007667478115, 948221131773571478,
983523894428605099]
INFO [StorageServiceShutdownHook] 2017-08-01 19:05:37,147
StorageService.java:2087 - Node /10.29.32.141 state jump to shutdown
DEBUG [PendingRangeCalculator:1] 2017-08-01 19:05:37,149
PendingRangeCalculatorService.java:66 - finished calculation for 3
keyspaces in 0ms
And this is the config file cassandra.yaml:
cluster_name: 'KongCluster'
num_tokens: 256
hinted_handoff_enabled: true
hinted_handoff_throttle_in_kb: 1024
max_hints_delivery_threads: 2
hints_flush_period_in_ms: 10000
max_hints_file_size_in_mb: 128
batchlog_replay_throttle_in_kb: 1024
authenticator: AllowAllAuthenticator
authorizer: AllowAllAuthorizer
role_manager: CassandraRoleManager
roles_validity_in_ms: 2000
permissions_validity_in_ms: 2000
credentials_validity_in_ms: 2000
partitioner: org.apache.cassandra.dht.Murmur3Partitioner
data_file_directories:
- /var/lib/cassandra/data
commitlog_directory: /var/lib/cassandra/commitlog
cdc_enabled: false
disk_failure_policy: stop
commit_failure_policy: stop
prepared_statements_cache_size_mb:
thrift_prepared_statements_cache_size_mb:
key_cache_size_in_mb:
key_cache_save_period: 14400
row_cache_size_in_mb: 0
row_cache_save_period: 0
counter_cache_size_in_mb:
counter_cache_save_period: 7200
saved_caches_directory: /var/lib/cassandra/saved_caches
commitlog_sync: periodic
commitlog_sync_period_in_ms: 10000
commitlog_segment_size_in_mb: 32
seed_provider:
- class_name: org.apache.cassandra.locator.SimpleSeedProvider
parameters:
- seeds: "10.29.32.141"
concurrent_reads: 32
concurrent_writes: 32
concurrent_counter_writes: 32
concurrent_materialized_view_writes: 32
memtable_allocation_type: heap_buffers
index_summary_capacity_in_mb:
index_summary_resize_interval_in_minutes: 60
trickle_fsync: false
trickle_fsync_interval_in_kb: 10240
storage_port: 7000
ssl_storage_port: 7001
listen_address: 10.29.32.141
start_native_transport: true
native_transport_port: 9042
start_rpc: true
rpc_address: 10.29.32.141
rpc_port: 9160
rpc_keepalive: true
rpc_server_type: sync
thrift_framed_transport_size_in_mb: 15
incremental_backups: false
snapshot_before_compaction: false
auto_snapshot: true
column_index_size_in_kb: 64
column_index_cache_size_in_kb: 2
compaction_throughput_mb_per_sec: 16
sstable_preemptive_open_interval_in_mb: 50
read_request_timeout_in_ms: 5000
range_request_timeout_in_ms: 10000
write_request_timeout_in_ms: 2000
counter_write_request_timeout_in_ms: 5000
cas_contention_timeout_in_ms: 1000
truncate_request_timeout_in_ms: 60000
request_timeout_in_ms: 10000
cross_node_timeout: false
endpoint_snitch: GossipingPropertyFileSnitch
dynamic_snitch_update_interval_in_ms: 100
dynamic_snitch_reset_interval_in_ms: 600000
dynamic_snitch_badness_threshold: 0.1
request_scheduler: org.apache.cassandra.scheduler.NoScheduler
server_encryption_options:
internode_encryption: none
keystore: conf/.keystore
keystore_password: cassandra
truststore: conf/.truststore
truststore_password: cassandra
client_encryption_options:
enabled: false
optional: false
keystore: conf/.keystore
keystore_password: cassandra
internode_compression: dc
inter_dc_tcp_nodelay: false
tracetype_query_ttl: 86400
tracetype_repair_ttl: 604800
enable_user_defined_functions: false
enable_scripted_user_defined_functions: false
windows_timer_interval: 1
transparent_data_encryption_options:
enabled: false
chunk_length_kb: 64
cipher: AES/CBC/PKCS5Padding
key_alias: testing:1
key_provider:
- class_name: org.apache.cassandra.security.JKSKeyProvider
parameters:
- keystore: conf/.keystore
keystore_password: cassandra
store_type: JCEKS
key_password: cassandra
tombstone_warn_threshold: 1000
tombstone_failure_threshold: 100000
batch_size_warn_threshold_in_kb: 5
batch_size_fail_threshold_in_kb: 50
unlogged_batch_across_partitions_warn_threshold: 10
compaction_large_partition_warning_threshold_mb: 100
gc_warn_threshold_in_ms: 1000
auto_bootstrap: false
Thanks in advance.
Lucas
2017-08-01 18:54 GMT-03:00 Lucas Alvarez <lu...@gmail.com>:
> I'm sorry the ip address of this node in the configuration was
> 10.29.32.141.
> num_tokens is set to 256
> initial_token is commented.
>
> The server has been just installed.
> Thanks for your help
>
> 2017-08-01 17:01 GMT-03:00 Nitan Kainth <ni...@bamlabs.com>:
>
>> If it is blank, you can use bootstrap: true.
>>
>> What is num_tokens and initial token values?
>>
>> On Aug 1, 2017, at 2:42 PM, Lucas Alvarez <lu...@gmail.com> wrote:
>>
>> Hi, I'm trying to configure Cassandra as a cluster with two nodes. When
>> trying to simple start the first node just changing this parameters:
>>
>> listen_address: 10.29.30.2
>> seed_provider: 10.29.30.2
>> rpc_address: 10.29.30.2
>> auto_bootstrap: false
>>
>> I'm getting this message and then cassandra stop loading:
>>
>> INFO [main] 2017-08-01 15:10:13,474 StorageService.java:2087 - Node /
>> 10.29.32.141 state jump to NORMAL
>> DEBUG [main] 2017-08-01 15:10:13,479 StorageService.java:1336 - NORMAL
>> INFO [main] 2017-08-01 15:10:13,486 CassandraDaemon.java:689 - Waiting
>> for gossip to settle before accepting client requests...
>> DEBUG [PendingRangeCalculator:1] 2017-08-01 15:10:13,491
>> PendingRangeCalculatorService.java:66 - finished calculation for 3
>> keyspaces in 8ms
>> INFO [StorageServiceShutdownHook] 2017-08-01 15:10:17,848
>> Gossiper.java:1500 - Announcing shutdown
>>
>> I have googled to death and I'm not able to find any solution nor
>> explanation.
>> Any help will be appreciated.
>>
>> Thanks in advance.
>>
>> Lucas
>>
>>
>>
>
Re: Cassandra failed to start when trying to move to multi-node
Posted by Nitan Kainth <ni...@sleepiqlabs.com>.
try with bootstrap true in that case. Start the seed node first. I think it
should work.
On Tue, Aug 1, 2017 at 4:54 PM, Lucas Alvarez <lu...@gmail.com> wrote:
> I'm sorry the ip address of this node in the configuration was
> 10.29.32.141.
> num_tokens is set to 256
> initial_token is commented.
>
> The server has been just installed.
> Thanks for your help
>
> 2017-08-01 17:01 GMT-03:00 Nitan Kainth <ni...@bamlabs.com>:
>
>> If it is blank, you can use bootstrap: true.
>>
>> What is num_tokens and initial token values?
>>
>> On Aug 1, 2017, at 2:42 PM, Lucas Alvarez <lu...@gmail.com> wrote:
>>
>> Hi, I'm trying to configure Cassandra as a cluster with two nodes. When
>> trying to simple start the first node just changing this parameters:
>>
>> listen_address: 10.29.30.2
>> seed_provider: 10.29.30.2
>> rpc_address: 10.29.30.2
>> auto_bootstrap: false
>>
>> I'm getting this message and then cassandra stop loading:
>>
>> INFO [main] 2017-08-01 15:10:13,474 StorageService.java:2087 - Node /
>> 10.29.32.141 state jump to NORMAL
>> DEBUG [main] 2017-08-01 15:10:13,479 StorageService.java:1336 - NORMAL
>> INFO [main] 2017-08-01 15:10:13,486 CassandraDaemon.java:689 - Waiting
>> for gossip to settle before accepting client requests...
>> DEBUG [PendingRangeCalculator:1] 2017-08-01 15:10:13,491
>> PendingRangeCalculatorService.java:66 - finished calculation for 3
>> keyspaces in 8ms
>> INFO [StorageServiceShutdownHook] 2017-08-01 15:10:17,848
>> Gossiper.java:1500 - Announcing shutdown
>>
>> I have googled to death and I'm not able to find any solution nor
>> explanation.
>> Any help will be appreciated.
>>
>> Thanks in advance.
>>
>> Lucas
>>
>>
>>
>
Re: Cassandra failed to start when trying to move to multi-node
Posted by Lucas Alvarez <lu...@gmail.com>.
I'm sorry the ip address of this node in the configuration was 10.29.32.141
.
num_tokens is set to 256
initial_token is commented.
The server has been just installed.
Thanks for your help
2017-08-01 17:01 GMT-03:00 Nitan Kainth <ni...@bamlabs.com>:
> If it is blank, you can use bootstrap: true.
>
> What is num_tokens and initial token values?
>
> On Aug 1, 2017, at 2:42 PM, Lucas Alvarez <lu...@gmail.com> wrote:
>
> Hi, I'm trying to configure Cassandra as a cluster with two nodes. When
> trying to simple start the first node just changing this parameters:
>
> listen_address: 10.29.30.2
> seed_provider: 10.29.30.2
> rpc_address: 10.29.30.2
> auto_bootstrap: false
>
> I'm getting this message and then cassandra stop loading:
>
> INFO [main] 2017-08-01 15:10:13,474 StorageService.java:2087 - Node /
> 10.29.32.141 state jump to NORMAL
> DEBUG [main] 2017-08-01 15:10:13,479 StorageService.java:1336 - NORMAL
> INFO [main] 2017-08-01 15:10:13,486 CassandraDaemon.java:689 - Waiting
> for gossip to settle before accepting client requests...
> DEBUG [PendingRangeCalculator:1] 2017-08-01 15:10:13,491
> PendingRangeCalculatorService.java:66 - finished calculation for 3
> keyspaces in 8ms
> INFO [StorageServiceShutdownHook] 2017-08-01 15:10:17,848
> Gossiper.java:1500 - Announcing shutdown
>
> I have googled to death and I'm not able to find any solution nor
> explanation.
> Any help will be appreciated.
>
> Thanks in advance.
>
> Lucas
>
>
>
Re: Cassandra failed to start when trying to move to multi-node
Posted by Nitan Kainth <ni...@bamlabs.com>.
If it is blank, you can use bootstrap: true.
What is num_tokens and initial token values?
> On Aug 1, 2017, at 2:42 PM, Lucas Alvarez <lu...@gmail.com> wrote:
>
> Hi, I'm trying to configure Cassandra as a cluster with two nodes. When trying to simple start the first node just changing this parameters:
>
> listen_address: 10.29.30.2
> seed_provider: 10.29.30.2
> rpc_address: 10.29.30.2
> auto_bootstrap: false
>
> I'm getting this message and then cassandra stop loading:
>
> INFO [main] 2017-08-01 15:10:13,474 StorageService.java:2087 - Node /10.29.32.141 <http://10.29.32.141/> state jump to NORMAL
> DEBUG [main] 2017-08-01 15:10:13,479 StorageService.java:1336 - NORMAL
> INFO [main] 2017-08-01 15:10:13,486 CassandraDaemon.java:689 - Waiting for gossip to settle before accepting client requests...
> DEBUG [PendingRangeCalculator:1] 2017-08-01 15:10:13,491 PendingRangeCalculatorService.java:66 - finished calculation for 3 keyspaces in 8ms
> INFO [StorageServiceShutdownHook] 2017-08-01 15:10:17,848 Gossiper.java:1500 - Announcing shutdown
>
> I have googled to death and I'm not able to find any solution nor explanation.
> Any help will be appreciated.
>
> Thanks in advance.
>
> Lucas