You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cassandra.apache.org by Jacob Rhoden <ja...@me.com> on 2014/11/18 11:46:21 UTC

Reads requiring response from both servers.

Hi Guys,

I was going to report a bug, but first figured I should check its not “working as expected”. Is it just me or is it wrong that the following query needs to talk to both nodes to build a response to this query? 


CREATE KEYSPACE mykeyspace WITH replication = {
  'class': 'SimpleStrategy',
  'replication_factor': '2'
};

CREATE TABLE organisation (
  uuid uuid,
  name text,
  ......
  url text,
  PRIMARY KEY (uuid)
) WITH
  bloom_filter_fp_chance=0.010000 AND
  caching='KEYS_ONLY' AND
  comment='' AND
  dclocal_read_repair_chance=0.000000 AND
  gc_grace_seconds=864000 AND
  index_interval=128 AND
  read_repair_chance=0.100000 AND
  replicate_on_write='true' AND
  populate_io_cache_on_flush='false' AND
  default_time_to_live=0 AND
  speculative_retry='99.0PERCENTILE' AND
  memtable_flush_period_in_ms=0 AND
  compaction={'class': 'SizeTieredCompactionStrategy'} AND
  compression={'sstable_compression': 'LZ4Compressor'};

So when I execute:

    select uuid,name from organisation limit 100;

We get the trace result listed below.

Why is this a bug? It seems that this behaviour of needing a response to both nodes only exists if you don’t query with a clustering key, or a key when RF=2. However you can change this behaviour, by, for example, changing the table from “primary key (uuid)” to “primary key ((a), uuid)” where the value of a always equals “a” ( so you can query 'where a=“a”’), at which point, cassandra decides it only needs results from one node.

 activity                                                                                        | timestamp    | source       | source_elapsed
-------------------------------------------------------------------------------------------------+--------------+--------------+----------------
                                                                              execute_cql3_query | 10:32:29,811 | 10.10.10.200 |              0
                                                             Message received from /10.10.10.200 | 10:32:29,810 | 10.100.10.10 |             37
 Executing seq scan across 0 sstables for (max(-9060818245110199813), max(-9025492630141156424)] | 10:32:29,811 | 10.100.10.10 |            427
                                 Parsing select uuid,name,higher_ed from organisation limit 100; | 10:32:29,811 | 10.10.10.200 |             55
                                                                    Scanned 0 rows and matched 0 | 10:32:29,811 | 10.100.10.10 |            464
                                                                             Preparing statement | 10:32:29,811 | 10.10.10.200 |            185
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,811 | 10.100.10.10 |            488
                                                                   Determining replicas to query | 10:32:29,811 | 10.10.10.200 |            293
                                                                Sending message to /10.10.10.200 | 10:32:29,811 | 10.100.10.10 |            663
 Executing seq scan across 0 sstables for [min(-9223372036854775808), max(-9221884455019925078)] | 10:32:29,813 | 10.10.10.200 |           1621
                                                             Message received from /10.10.10.200 | 10:32:29,813 | 10.100.10.10 |             14
                                                                    Scanned 0 rows and matched 0 | 10:32:29,813 | 10.10.10.200 |           1661
 Executing seq scan across 0 sstables for (max(-8977775151951991168), max(-8919942306154684527)] | 10:32:29,813 | 10.100.10.10 |            147
 Executing seq scan across 0 sstables for (max(-9221884455019925078), max(-9060818245110199813)] | 10:32:29,813 | 10.10.10.200 |           1869
                                                                    Scanned 0 rows and matched 0 | 10:32:29,813 | 10.100.10.10 |            177
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,813 | 10.10.10.200 |           1947
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,813 | 10.100.10.10 |            199
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,813 | 10.10.10.200 |           2001
                                                                Sending message to /10.10.10.200 | 10:32:29,813 | 10.100.10.10 |            254
                                                                    Scanned 2 rows and matched 2 | 10:32:29,813 | 10.10.10.200 |           2025
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,813 | 10.10.10.200 |           2178
                                                                Sending message to /10.100.10.10 | 10:32:29,813 | 10.10.10.200 |           2279
                                                             Message received from /10.100.10.10 | 10:32:29,815 | 10.10.10.200 |           4226
                                                             Message received from /10.10.10.200 | 10:32:29,815 | 10.100.10.10 |             15
                                                          Processing response from /10.100.10.10 | 10:32:29,815 | 10.10.10.200 |           4289
 Executing seq scan across 0 sstables for (max(-8830390916526037984), max(-8780812853188178937)] | 10:32:29,815 | 10.100.10.10 |            133
                                                                    Scanned 0 rows and matched 0 | 10:32:29,815 | 10.100.10.10 |            164
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,815 | 10.100.10.10 |            186
                                                                Sending message to /10.10.10.200 | 10:32:29,815 | 10.100.10.10 |            235
 Executing seq scan across 0 sstables for (max(-9025492630141156424), max(-9010052349921191842)] | 10:32:29,816 | 10.10.10.200 |           4421
                                                             Message received from /10.10.10.200 | 10:32:29,816 | 10.100.10.10 |             17
                                                                    Scanned 0 rows and matched 0 | 10:32:29,816 | 10.10.10.200 |           4443
 Executing seq scan across 0 sstables for (max(-9010052349921191842), max(-8977775151951991168)] | 10:32:29,816 | 10.10.10.200 |           4584
                                                                    Scanned 0 rows and matched 0 | 10:32:29,816 | 10.10.10.200 |           4612
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,816 | 10.10.10.200 |           4681
                                                                Sending message to /10.100.10.10 | 10:32:29,816 | 10.10.10.200 |           4776
                                                             Message received from /10.100.10.10 | 10:32:29,817 | 10.10.10.200 |           6113
 Executing seq scan across 0 sstables for (max(-8757338723496439795), max(-8685558021502792435)] | 10:32:29,817 | 10.100.10.10 |            151
                                                          Processing response from /10.100.10.10 | 10:32:29,817 | 10.10.10.200 |           6255
                                                                    Scanned 0 rows and matched 0 | 10:32:29,817 | 10.100.10.10 |            181
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,817 | 10.100.10.10 |            204
                                                                Sending message to /10.10.10.200 | 10:32:29,817 | 10.100.10.10 |            252
 Executing seq scan across 0 sstables for (max(-8919942306154684527), max(-8902981730960800077)] | 10:32:29,818 | 10.10.10.200 |           6432
                                                             Message received from /10.10.10.200 | 10:32:29,818 | 10.100.10.10 |             14
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,818 | 10.10.10.200 |           6505
 Executing seq scan across 0 sstables for (max(-8654767061031075798), max(-8629356072741758869)] | 10:32:29,818 | 10.100.10.10 |            179
                                                                    Scanned 1 rows and matched 1 | 10:32:29,818 | 10.10.10.200 |           6528
                                                                    Scanned 0 rows and matched 0 | 10:32:29,818 | 10.100.10.10 |            234
 Executing seq scan across 0 sstables for (max(-8902981730960800077), max(-8883931143477060358)] | 10:32:29,818 | 10.10.10.200 |           6642
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,818 | 10.100.10.10 |            257
                                                                    Scanned 0 rows and matched 0 | 10:32:29,818 | 10.10.10.200 |           6667
                                                                Sending message to /10.10.10.200 | 10:32:29,818 | 10.100.10.10 |            350
 Executing seq scan across 0 sstables for (max(-8883931143477060358), max(-8841176851439454433)] | 10:32:29,818 | 10.10.10.200 |           6772
                                                                    Scanned 0 rows and matched 0 | 10:32:29,818 | 10.10.10.200 |           6791
 Executing seq scan across 0 sstables for (max(-8841176851439454433), max(-8830390916526037984)] | 10:32:29,818 | 10.10.10.200 |           6911
                                                                    Scanned 0 rows and matched 0 | 10:32:29,818 | 10.10.10.200 |           6934
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,818 | 10.10.10.200 |           7109
                                                                Sending message to /10.100.10.10 | 10:32:29,818 | 10.10.10.200 |           7175
                                                             Message received from /10.100.10.10 | 10:32:29,819 | 10.10.10.200 |           8177
                                                          Processing response from /10.100.10.10 | 10:32:29,819 | 10.10.10.200 |           8260
 Executing seq scan across 0 sstables for (max(-8780812853188178937), max(-8757338723496439795)] | 10:32:29,820 | 10.10.10.200 |           8396
                                                             Message received from /10.10.10.200 | 10:32:29,820 | 10.100.10.10 |             14
                                                                    Scanned 0 rows and matched 0 | 10:32:29,820 | 10.10.10.200 |           8418
 Executing seq scan across 0 sstables for (max(-8625302473359077310), max(-8608339776430103953)] | 10:32:29,820 | 10.100.10.10 |            180
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,820 | 10.10.10.200 |           8489
                                                                    Scanned 0 rows and matched 0 | 10:32:29,820 | 10.100.10.10 |            209
                                                                Sending message to /10.100.10.10 | 10:32:29,820 | 10.10.10.200 |           8564
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,820 | 10.100.10.10 |            233
                                                                Sending message to /10.10.10.200 | 10:32:29,820 | 10.100.10.10 |            281
                                                             Message received from /10.100.10.10 | 10:32:29,821 | 10.10.10.200 |          10021
                                                             Message received from /10.10.10.200 | 10:32:29,821 | 10.100.10.10 |             16
                                                          Processing response from /10.100.10.10 | 10:32:29,821 | 10.10.10.200 |          10083
 Executing seq scan across 0 sstables for (max(-8594967025329766102), max(-8507642931132672117)] | 10:32:29,821 | 10.100.10.10 |            149
 Executing seq scan across 0 sstables for (max(-8685558021502792435), max(-8671452445284734389)] | 10:32:29,821 | 10.10.10.200 |          10207
                                                                    Scanned 0 rows and matched 0 | 10:32:29,821 | 10.10.10.200 |          10241
 Executing seq scan across 0 sstables for (max(-8671452445284734389), max(-8654767061031075798)] | 10:32:29,822 | 10.10.10.200 |          10437
                                                                    Scanned 0 rows and matched 0 | 10:32:29,822 | 10.100.10.10 |            177
                                                                    Scanned 0 rows and matched 0 | 10:32:29,822 | 10.10.10.200 |          10466
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,822 | 10.100.10.10 |            225
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,822 | 10.10.10.200 |          10536
                                                                Sending message to /10.10.10.200 | 10:32:29,822 | 10.100.10.10 |            273
                                                                Sending message to /10.100.10.10 | 10:32:29,822 | 10.10.10.200 |          10605
                                                             Message received from /10.100.10.10 | 10:32:29,823 | 10.10.10.200 |          11795
                                                             Message received from /10.10.10.200 | 10:32:29,823 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,823 | 10.10.10.200 |          11853
 Executing seq scan across 0 sstables for (max(-8507642931132672117), max(-8487343421519984028)] | 10:32:29,823 | 10.100.10.10 |            243
 Executing seq scan across 0 sstables for (max(-8629356072741758869), max(-8625302473359077310)] | 10:32:29,823 | 10.10.10.200 |          11966
                                                                    Scanned 0 rows and matched 0 | 10:32:29,823 | 10.10.10.200 |          11989
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,823 | 10.10.10.200 |          12057
                                                                Sending message to /10.100.10.10 | 10:32:29,823 | 10.10.10.200 |          12141
                                                                    Scanned 0 rows and matched 0 | 10:32:29,824 | 10.100.10.10 |            296
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,824 | 10.100.10.10 |            320
                                                                Sending message to /10.10.10.200 | 10:32:29,824 | 10.100.10.10 |            422
                                                             Message received from /10.100.10.10 | 10:32:29,825 | 10.10.10.200 |          13690
                                                             Message received from /10.10.10.200 | 10:32:29,825 | 10.100.10.10 |             17
                                                          Processing response from /10.100.10.10 | 10:32:29,825 | 10.10.10.200 |          13746
 Executing seq scan across 0 sstables for (max(-8487343421519984028), max(-8467214837461178487)] | 10:32:29,825 | 10.100.10.10 |            101
 Executing seq scan across 0 sstables for (max(-8608339776430103953), max(-8594967025329766102)] | 10:32:29,825 | 10.10.10.200 |          13866
                                                                    Scanned 0 rows and matched 0 | 10:32:29,825 | 10.100.10.10 |            132
                                                                    Scanned 0 rows and matched 0 | 10:32:29,825 | 10.10.10.200 |          13888
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,825 | 10.100.10.10 |            155
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,825 | 10.10.10.200 |          13956
                                                                Sending message to /10.10.10.200 | 10:32:29,825 | 10.100.10.10 |            229
                                                                Sending message to /10.100.10.10 | 10:32:29,825 | 10.10.10.200 |          14015
                                                             Message received from /10.100.10.10 | 10:32:29,826 | 10.10.10.200 |          14941
                                                             Message received from /10.10.10.200 | 10:32:29,826 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,826 | 10.10.10.200 |          15004
 Executing seq scan across 0 sstables for (max(-8467214837461178487), max(-8465100815144516734)] | 10:32:29,826 | 10.100.10.10 |            138
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,826 | 10.10.10.200 |          15076
                                                                    Scanned 0 rows and matched 0 | 10:32:29,826 | 10.100.10.10 |            168
                                                                Sending message to /10.100.10.10 | 10:32:29,826 | 10.10.10.200 |          15147
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,826 | 10.100.10.10 |            206
                                                                Sending message to /10.10.10.200 | 10:32:29,826 | 10.100.10.10 |            259
                                                             Message received from /10.10.10.200 | 10:32:29,827 | 10.100.10.10 |             17
 Executing seq scan across 0 sstables for (max(-8465100815144516734), max(-8335241792215354670)] | 10:32:29,827 | 10.100.10.10 |            100
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,827 | 10.100.10.10 |            227
                                                                    Scanned 1 rows and matched 1 | 10:32:29,827 | 10.100.10.10 |            256
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,827 | 10.100.10.10 |            280
                                                                Sending message to /10.10.10.200 | 10:32:29,827 | 10.100.10.10 |            330
                                                             Message received from /10.100.10.10 | 10:32:29,828 | 10.10.10.200 |          17073
                                                             Message received from /10.10.10.200 | 10:32:29,828 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,828 | 10.10.10.200 |          17210
 Executing seq scan across 0 sstables for (max(-8335241792215354670), max(-8333775776051211822)] | 10:32:29,828 | 10.100.10.10 |            100
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,828 | 10.10.10.200 |          17329
                                                                    Scanned 0 rows and matched 0 | 10:32:29,828 | 10.100.10.10 |            128
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,828 | 10.100.10.10 |            150
                                                                Sending message to /10.10.10.200 | 10:32:29,828 | 10.100.10.10 |            283
                                                                Sending message to /10.100.10.10 | 10:32:29,829 | 10.10.10.200 |          17399
                                                             Message received from /10.100.10.10 | 10:32:29,829 | 10.10.10.200 |          18122
                                                          Processing response from /10.100.10.10 | 10:32:29,829 | 10.10.10.200 |          18185
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,829 | 10.10.10.200 |          18257
                                                                Sending message to /10.100.10.10 | 10:32:29,829 | 10.10.10.200 |          18321
                                                             Message received from /10.100.10.10 | 10:32:29,830 | 10.10.10.200 |          19146
                                                             Message received from /10.10.10.200 | 10:32:29,830 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,830 | 10.10.10.200 |          19210
 Executing seq scan across 0 sstables for (max(-8309494113055762486), max(-8277862900179874293)] | 10:32:29,830 | 10.100.10.10 |            200
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,830 | 10.10.10.200 |          19282
                                                                    Scanned 0 rows and matched 0 | 10:32:29,830 | 10.100.10.10 |            230
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,830 | 10.100.10.10 |            253
                                                                Sending message to /10.100.10.10 | 10:32:29,831 | 10.10.10.200 |          19358
                                                             Message received from /10.100.10.10 | 10:32:29,832 | 10.10.10.200 |          20406
                                                          Processing response from /10.100.10.10 | 10:32:29,832 | 10.10.10.200 |          20470
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,832 | 10.10.10.200 |          20574
                                                                Sending message to /10.100.10.10 | 10:32:29,832 | 10.10.10.200 |          20642
                                                             Message received from /10.100.10.10 | 10:32:29,833 | 10.10.10.200 |          21449
                                                          Processing response from /10.100.10.10 | 10:32:29,833 | 10.10.10.200 |          21510
 Executing seq scan across 0 sstables for (max(-8333775776051211822), max(-8311183928577402560)] | 10:32:29,833 | 10.10.10.200 |          21757
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,833 | 10.10.10.200 |          21867
                                                                    Scanned 1 rows and matched 1 | 10:32:29,833 | 10.10.10.200 |          21916
 Executing seq scan across 0 sstables for (max(-8311183928577402560), max(-8309494113055762486)] | 10:32:29,833 | 10.10.10.200 |          22042
                                                                    Scanned 0 rows and matched 0 | 10:32:29,833 | 10.10.10.200 |          22066
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,833 | 10.10.10.200 |          22133
                                                                Sending message to /10.100.10.10 | 10:32:29,833 | 10.10.10.200 |          22217
                                                                Sending message to /10.10.10.200 | 10:32:29,844 | 10.100.10.10 |          14167
                                                             Message received from /10.10.10.200 | 10:32:29,845 | 10.100.10.10 |             21
 Executing seq scan across 0 sstables for (max(-8277862900179874293), max(-8256859055181200108)] | 10:32:29,845 | 10.100.10.10 |            201
                                                                    Scanned 0 rows and matched 0 | 10:32:29,845 | 10.100.10.10 |            237
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,845 | 10.100.10.10 |            260
                                                                Sending message to /10.10.10.200 | 10:32:29,845 | 10.100.10.10 |            311
                                                             Message received from /10.10.10.200 | 10:32:29,846 | 10.100.10.10 |             14
 Executing seq scan across 0 sstables for (max(-8256859055181200108), max(-8229797592717880212)] | 10:32:29,847 | 10.100.10.10 |            132
                                                                    Scanned 0 rows and matched 0 | 10:32:29,847 | 10.100.10.10 |            163
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,847 | 10.100.10.10 |            186
                                                                Sending message to /10.10.10.200 | 10:32:29,847 | 10.100.10.10 |            234
                                                             Message received from /10.10.10.200 | 10:32:29,848 | 10.100.10.10 |             14
 Executing seq scan across 0 sstables for (max(-8229797592717880212), max(-8227969566230422556)] | 10:32:29,848 | 10.100.10.10 |            101
                                                                    Scanned 0 rows and matched 0 | 10:32:29,848 | 10.100.10.10 |            130
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,848 | 10.100.10.10 |            152
                                                                Sending message to /10.10.10.200 | 10:32:29,848 | 10.100.10.10 |            217
                                                             Message received from /10.100.10.10 | 10:32:29,849 | 10.10.10.200 |          37434
                                                             Message received from /10.10.10.200 | 10:32:29,849 | 10.100.10.10 |             16
                                                          Processing response from /10.100.10.10 | 10:32:29,849 | 10.10.10.200 |          37603
 Executing seq scan across 0 sstables for (max(-8227969566230422556), max(-8130725196955245033)] | 10:32:29,849 | 10.100.10.10 |            102
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,849 | 10.10.10.200 |          37678
                                                              Read 1 live and 2 tombstoned cells | 10:32:29,849 | 10.100.10.10 |            213
                                                                Sending message to /10.100.10.10 | 10:32:29,849 | 10.10.10.200 |          37744
                                                                    Scanned 1 rows and matched 1 | 10:32:29,849 | 10.100.10.10 |            240
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,849 | 10.100.10.10 |            266
                                                                Sending message to /10.10.10.200 | 10:32:29,849 | 10.100.10.10 |            314
                                                             Message received from /10.100.10.10 | 10:32:29,850 | 10.10.10.200 |          38730
                                                             Message received from /10.10.10.200 | 10:32:29,850 | 10.100.10.10 |             13
                                                          Processing response from /10.100.10.10 | 10:32:29,850 | 10.10.10.200 |          38778
 Executing seq scan across 0 sstables for (max(-8110414280505754397), max(-8046262272889936711)] | 10:32:29,850 | 10.100.10.10 |            103
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,850 | 10.10.10.200 |          38836
                                                                    Scanned 0 rows and matched 0 | 10:32:29,850 | 10.100.10.10 |            131
                                                                Sending message to /10.100.10.10 | 10:32:29,850 | 10.10.10.200 |          38994
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,850 | 10.100.10.10 |            172
                                                                Sending message to /10.10.10.200 | 10:32:29,850 | 10.100.10.10 |            222
                                                             Message received from /10.100.10.10 | 10:32:29,851 | 10.10.10.200 |          39983
                                                             Message received from /10.10.10.200 | 10:32:29,851 | 10.100.10.10 |             17
                                                          Processing response from /10.100.10.10 | 10:32:29,851 | 10.10.10.200 |          40030
 Executing seq scan across 0 sstables for (max(-8032773447058681998), max(-7988241780681385880)] | 10:32:29,851 | 10.100.10.10 |            106
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,851 | 10.10.10.200 |          40086
                                                                    Scanned 0 rows and matched 0 | 10:32:29,851 | 10.100.10.10 |            135
                                                                Sending message to /10.100.10.10 | 10:32:29,851 | 10.10.10.200 |          40233
                                                             Message received from /10.100.10.10 | 10:32:29,852 | 10.10.10.200 |          41101
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,852 | 10.100.10.10 |            195
                                                          Processing response from /10.100.10.10 | 10:32:29,852 | 10.10.10.200 |          41146
                                                                Sending message to /10.10.10.200 | 10:32:29,852 | 10.100.10.10 |            241
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,852 | 10.10.10.200 |          41203
                                                                Sending message to /10.100.10.10 | 10:32:29,853 | 10.10.10.200 |          41286
                                                             Message received from /10.10.10.200 | 10:32:29,853 | 10.100.10.10 |             41
                                                             Message received from /10.100.10.10 | 10:32:29,853 | 10.10.10.200 |          42254
 Executing seq scan across 0 sstables for (max(-7988241780681385880), max(-7950020969011635010)] | 10:32:29,853 | 10.100.10.10 |            205
                                                          Processing response from /10.100.10.10 | 10:32:29,853 | 10.10.10.200 |          42299
                                                                    Scanned 0 rows and matched 0 | 10:32:29,853 | 10.100.10.10 |            235
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,853 | 10.100.10.10 |            257
                                                                Sending message to /10.10.10.200 | 10:32:29,853 | 10.100.10.10 |            324
 Executing seq scan across 0 sstables for (max(-8130725196955245033), max(-8110414280505754397)] | 10:32:29,854 | 10.10.10.200 |          42433
                                                             Message received from /10.10.10.200 | 10:32:29,854 | 10.100.10.10 |             14
                                                                    Scanned 0 rows and matched 0 | 10:32:29,854 | 10.10.10.200 |          42459
 Executing seq scan across 0 sstables for (max(-7950020969011635010), max(-7935483617822068961)] | 10:32:29,854 | 10.100.10.10 |            194
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,854 | 10.10.10.200 |          42511
                                                                    Scanned 0 rows and matched 0 | 10:32:29,854 | 10.100.10.10 |            225
                                                                Sending message to /10.100.10.10 | 10:32:29,854 | 10.10.10.200 |          42568
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,854 | 10.100.10.10 |            247
                                                                Sending message to /10.10.10.200 | 10:32:29,854 | 10.100.10.10 |            292
                                                             Message received from /10.100.10.10 | 10:32:29,855 | 10.10.10.200 |          43383
                                                          Processing response from /10.100.10.10 | 10:32:29,855 | 10.10.10.200 |          43430
 Executing seq scan across 0 sstables for (max(-8046262272889936711), max(-8035459207903552698)] | 10:32:29,855 | 10.10.10.200 |          43529
                                                                    Scanned 0 rows and matched 0 | 10:32:29,855 | 10.10.10.200 |          43548
 Executing seq scan across 0 sstables for (max(-8035459207903552698), max(-8032773447058681998)] | 10:32:29,855 | 10.10.10.200 |          43643
                                                                    Scanned 0 rows and matched 0 | 10:32:29,855 | 10.10.10.200 |          43659
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,855 | 10.10.10.200 |          43716
                                                                Sending message to /10.100.10.10 | 10:32:29,855 | 10.10.10.200 |          43822
                                                             Message received from /10.100.10.10 | 10:32:29,856 | 10.10.10.200 |          44878
                                                             Message received from /10.10.10.200 | 10:32:29,856 | 10.100.10.10 |             33
                                                          Processing response from /10.100.10.10 | 10:32:29,856 | 10.10.10.200 |          44923
 Executing seq scan across 0 sstables for (max(-7935483617822068961), max(-7854685858349928814)] | 10:32:29,856 | 10.100.10.10 |            386
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,856 | 10.10.10.200 |          44980
                                                                    Scanned 0 rows and matched 0 | 10:32:29,856 | 10.100.10.10 |            416
                                                                Sending message to /10.100.10.10 | 10:32:29,856 | 10.10.10.200 |          45030
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,856 | 10.100.10.10 |            438
                                                                Sending message to /10.10.10.200 | 10:32:29,856 | 10.100.10.10 |            484
                                                             Message received from /10.100.10.10 | 10:32:29,857 | 10.10.10.200 |          46218
                                                             Message received from /10.10.10.200 | 10:32:29,857 | 10.100.10.10 |             16
                                                          Processing response from /10.100.10.10 | 10:32:29,857 | 10.10.10.200 |          46263
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,857 | 10.10.10.200 |          46320
                                                                Sending message to /10.100.10.10 | 10:32:29,858 | 10.10.10.200 |          46652
 Executing seq scan across 0 sstables for (max(-7854685858349928814), max(-7845605970353024347)] | 10:32:29,858 | 10.100.10.10 |            133
                                                                    Scanned 0 rows and matched 0 | 10:32:29,858 | 10.100.10.10 |            161
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,858 | 10.100.10.10 |            184
                                                                Sending message to /10.10.10.200 | 10:32:29,858 | 10.100.10.10 |            231
                                                             Message received from /10.100.10.10 | 10:32:29,859 | 10.10.10.200 |          47645
                                                             Message received from /10.10.10.200 | 10:32:29,859 | 10.100.10.10 |             15
                                                          Processing response from /10.100.10.10 | 10:32:29,859 | 10.10.10.200 |          47691
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,859 | 10.10.10.200 |          47768
                                                                Sending message to /10.100.10.10 | 10:32:29,859 | 10.10.10.200 |          47909
                                                             Message received from /10.100.10.10 | 10:32:29,860 | 10.10.10.200 |          49277
 Executing seq scan across 0 sstables for (max(-7845605970353024347), max(-7705128883386343194)] | 10:32:29,860 | 10.100.10.10 |            781
                                                          Processing response from /10.100.10.10 | 10:32:29,860 | 10.10.10.200 |          49340
                                                                    Scanned 0 rows and matched 0 | 10:32:29,860 | 10.100.10.10 |            811
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,860 | 10.100.10.10 |            835
                                                                Sending message to /10.10.10.200 | 10:32:29,860 | 10.100.10.10 |            883
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,861 | 10.10.10.200 |          49402
                                                             Message received from /10.10.10.200 | 10:32:29,861 | 10.100.10.10 |             14
                                                                Sending message to /10.100.10.10 | 10:32:29,861 | 10.10.10.200 |          49642
 Executing seq scan across 0 sstables for (max(-7705128883386343194), max(-7679337357293157789)] | 10:32:29,861 | 10.100.10.10 |            101
                                                                    Scanned 0 rows and matched 0 | 10:32:29,861 | 10.100.10.10 |            130
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,861 | 10.100.10.10 |            152
                                                             Message received from /10.100.10.10 | 10:32:29,862 | 10.10.10.200 |          51039
                                                                Sending message to /10.10.10.200 | 10:32:29,862 | 10.100.10.10 |            222
                                                          Processing response from /10.100.10.10 | 10:32:29,862 | 10.10.10.200 |          51109
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,862 | 10.10.10.200 |          51166
                                                                Sending message to /10.100.10.10 | 10:32:29,863 | 10.10.10.200 |          51359
                                                             Message received from /10.100.10.10 | 10:32:29,864 | 10.10.10.200 |          52917
                                                             Message received from /10.10.10.200 | 10:32:29,864 | 10.100.10.10 |             28
                                                          Processing response from /10.100.10.10 | 10:32:29,864 | 10.10.10.200 |          52962
 Executing seq scan across 0 sstables for (max(-7663980379427863649), max(-7663672767441397745)] | 10:32:29,864 | 10.100.10.10 |            298
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,864 | 10.10.10.200 |          53049
                                                                    Scanned 0 rows and matched 0 | 10:32:29,864 | 10.100.10.10 |            330
                                                                Sending message to /10.100.10.10 | 10:32:29,864 | 10.10.10.200 |          53182
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,864 | 10.100.10.10 |            352
                                                                Sending message to /10.10.10.200 | 10:32:29,864 | 10.100.10.10 |            400
                                                             Message received from /10.10.10.200 | 10:32:29,865 | 10.100.10.10 |             14
                                                             Message received from /10.100.10.10 | 10:32:29,866 | 10.10.10.200 |          54841
 Executing seq scan across 0 sstables for (max(-7663672767441397745), max(-7641496274625021033)] | 10:32:29,866 | 10.100.10.10 |            422
                                                          Processing response from /10.100.10.10 | 10:32:29,866 | 10.10.10.200 |          54890
                                                                    Scanned 0 rows and matched 0 | 10:32:29,866 | 10.100.10.10 |            453
 Executing seq scan across 0 sstables for (max(-7679337357293157789), max(-7663980379427863649)] | 10:32:29,866 | 10.10.10.200 |          54995
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,866 | 10.100.10.10 |            476
                                                                    Scanned 0 rows and matched 0 | 10:32:29,866 | 10.10.10.200 |          55018
                                                                Sending message to /10.10.10.200 | 10:32:29,866 | 10.100.10.10 |            523
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,866 | 10.10.10.200 |          55171
                                                                Sending message to /10.100.10.10 | 10:32:29,866 | 10.10.10.200 |          55222
                                                             Message received from /10.10.10.200 | 10:32:29,867 | 10.100.10.10 |             14
                                                             Message received from /10.100.10.10 | 10:32:29,868 | 10.10.10.200 |          57169
 Executing seq scan across 0 sstables for (max(-7605048336063222868), max(-7568584027378893533)] | 10:32:29,868 | 10.100.10.10 |            440
                                                          Processing response from /10.100.10.10 | 10:32:29,868 | 10.10.10.200 |          57242
                                                                    Scanned 0 rows and matched 0 | 10:32:29,868 | 10.100.10.10 |            489
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,868 | 10.10.10.200 |          57305
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,868 | 10.100.10.10 |            513
                                                                Sending message to /10.10.10.200 | 10:32:29,868 | 10.100.10.10 |            620
                                                                Sending message to /10.100.10.10 | 10:32:29,869 | 10.10.10.200 |          57368
                                                             Message received from /10.10.10.200 | 10:32:29,869 | 10.100.10.10 |             16
                                                             Message received from /10.100.10.10 | 10:32:29,870 | 10.10.10.200 |          59042
 Executing seq scan across 0 sstables for (max(-7568584027378893533), max(-7486619690497254568)] | 10:32:29,870 | 10.100.10.10 |            238
                                                          Processing response from /10.100.10.10 | 10:32:29,870 | 10.10.10.200 |          59094
                                                                    Scanned 0 rows and matched 0 | 10:32:29,870 | 10.100.10.10 |            269
 Executing seq scan across 0 sstables for (max(-7641496274625021033), max(-7607124651219571752)] | 10:32:29,870 | 10.10.10.200 |          59189
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,870 | 10.100.10.10 |            291
                                                                    Scanned 0 rows and matched 0 | 10:32:29,870 | 10.10.10.200 |          59240
                                                                Sending message to /10.10.10.200 | 10:32:29,870 | 10.100.10.10 |            359
 Executing seq scan across 0 sstables for (max(-7607124651219571752), max(-7605048336063222868)] | 10:32:29,870 | 10.10.10.200 |          59335
                                                                    Scanned 0 rows and matched 0 | 10:32:29,871 | 10.10.10.200 |          59355
                                                             Message received from /10.10.10.200 | 10:32:29,871 | 10.100.10.10 |             16
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,871 | 10.10.10.200 |          59466
                                                                Sending message to /10.100.10.10 | 10:32:29,871 | 10.10.10.200 |          59814
                                                             Message received from /10.100.10.10 | 10:32:29,872 | 10.10.10.200 |          61173
 Executing seq scan across 0 sstables for (max(-7465891255254356075), max(-7430743266795275518)] | 10:32:29,872 | 10.100.10.10 |            293
                                                          Processing response from /10.100.10.10 | 10:32:29,872 | 10.10.10.200 |          61217
                                                                    Scanned 0 rows and matched 0 | 10:32:29,872 | 10.100.10.10 |            324
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,872 | 10.10.10.200 |          61274
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,872 | 10.100.10.10 |            368
                                                                Sending message to /10.100.10.10 | 10:32:29,872 | 10.10.10.200 |          61329
                                                                Sending message to /10.10.10.200 | 10:32:29,872 | 10.100.10.10 |            421
                                                             Message received from /10.100.10.10 | 10:32:29,874 | 10.10.10.200 |          63035
                                                             Message received from /10.10.10.200 | 10:32:29,874 | 10.100.10.10 |             16
                                                          Processing response from /10.100.10.10 | 10:32:29,874 | 10.10.10.200 |          63079
 Executing seq scan across 0 sstables for (max(-7430743266795275518), max(-7379374530999686429)] | 10:32:29,874 | 10.100.10.10 |            206
 Executing seq scan across 0 sstables for (max(-7486619690497254568), max(-7465891255254356075)] | 10:32:29,874 | 10.10.10.200 |          63181
                                                                    Scanned 0 rows and matched 0 | 10:32:29,874 | 10.100.10.10 |            236
                                                                    Scanned 0 rows and matched 0 | 10:32:29,874 | 10.10.10.200 |          63200
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,874 | 10.100.10.10 |            259
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,874 | 10.10.10.200 |          63311
                                                                Sending message to /10.10.10.200 | 10:32:29,874 | 10.100.10.10 |            306
                                                                Sending message to /10.100.10.10 | 10:32:29,875 | 10.10.10.200 |          63364
                                                             Message received from /10.10.10.200 | 10:32:29,875 | 10.100.10.10 |             14
 Executing seq scan across 0 sstables for (max(-7345539136938023777), max(-7331161781417823387)] | 10:32:29,875 | 10.100.10.10 |            199
                                                                    Scanned 0 rows and matched 0 | 10:32:29,875 | 10.100.10.10 |            228
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,875 | 10.100.10.10 |            250
                                                             Message received from /10.100.10.10 | 10:32:29,876 | 10.10.10.200 |          65116
                                                                Sending message to /10.10.10.200 | 10:32:29,876 | 10.100.10.10 |            316
                                                          Processing response from /10.100.10.10 | 10:32:29,876 | 10.10.10.200 |          65179
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,876 | 10.10.10.200 |          65236
                                                                Sending message to /10.100.10.10 | 10:32:29,877 | 10.10.10.200 |          65530
                                                             Message received from /10.10.10.200 | 10:32:29,877 | 10.100.10.10 |             16
 Executing seq scan across 0 sstables for (max(-7312129259987524756), max(-7306385596967945277)] | 10:32:29,877 | 10.100.10.10 |            284
                                                                    Scanned 0 rows and matched 0 | 10:32:29,877 | 10.100.10.10 |            333
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,877 | 10.100.10.10 |            359
                                                                Sending message to /10.10.10.200 | 10:32:29,877 | 10.100.10.10 |            405
                                                             Message received from /10.100.10.10 | 10:32:29,878 | 10.10.10.200 |          67283
                                                          Processing response from /10.100.10.10 | 10:32:29,878 | 10.10.10.200 |          67330
 Executing seq scan across 0 sstables for (max(-7379374530999686429), max(-7345539136938023777)] | 10:32:29,879 | 10.10.10.200 |          67433
                                                             Message received from /10.10.10.200 | 10:32:29,879 | 10.100.10.10 |             18
                                                                    Scanned 0 rows and matched 0 | 10:32:29,879 | 10.10.10.200 |          67452
 Executing seq scan across 0 sstables for (max(-7295123702850152958), max(-7289624796331900507)] | 10:32:29,879 | 10.100.10.10 |            367
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,879 | 10.10.10.200 |          67506
                                                                    Scanned 0 rows and matched 0 | 10:32:29,879 | 10.100.10.10 |            395
                                                                Sending message to /10.100.10.10 | 10:32:29,879 | 10.10.10.200 |          67668
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,879 | 10.100.10.10 |            419
                                                             Message received from /10.100.10.10 | 10:32:29,880 | 10.10.10.200 |          68802
                                                                Sending message to /10.10.10.200 | 10:32:29,880 | 10.100.10.10 |            478
                                                          Processing response from /10.100.10.10 | 10:32:29,880 | 10.10.10.200 |          68847
 Executing seq scan across 0 sstables for (max(-7331161781417823387), max(-7327940600064170049)] | 10:32:29,880 | 10.10.10.200 |          68956
                                                                    Scanned 0 rows and matched 0 | 10:32:29,880 | 10.10.10.200 |          68974
 Executing seq scan across 0 sstables for (max(-7327940600064170049), max(-7312129259987524756)] | 10:32:29,880 | 10.10.10.200 |          69118
                                                                    Scanned 0 rows and matched 0 | 10:32:29,880 | 10.10.10.200 |          69137
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,880 | 10.10.10.200 |          69191
                                                                Sending message to /10.100.10.10 | 10:32:29,880 | 10.10.10.200 |          69250
                                                             Message received from /10.100.10.10 | 10:32:29,882 | 10.10.10.200 |          70404
                                                          Processing response from /10.100.10.10 | 10:32:29,882 | 10.10.10.200 |          70474
 Executing seq scan across 0 sstables for (max(-7306385596967945277), max(-7295123702850152958)] | 10:32:29,882 | 10.10.10.200 |          70573
                                                                    Scanned 0 rows and matched 0 | 10:32:29,882 | 10.10.10.200 |          70594
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,882 | 10.10.10.200 |          70658
                                                                Sending message to /10.100.10.10 | 10:32:29,882 | 10.10.10.200 |          70747
                                                             Message received from /10.10.10.200 | 10:32:29,883 | 10.100.10.10 |             16
 Executing seq scan across 0 sstables for (max(-7206530577063076397), max(-7193707678937979856)] | 10:32:29,883 | 10.100.10.10 |            202
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,883 | 10.100.10.10 |            296
                                                                    Scanned 1 rows and matched 1 | 10:32:29,883 | 10.100.10.10 |            324
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,883 | 10.100.10.10 |            349
                                                                Sending message to /10.10.10.200 | 10:32:29,883 | 10.100.10.10 |            485
                                                             Message received from /10.100.10.10 | 10:32:29,884 | 10.10.10.200 |          72827
                                                          Processing response from /10.100.10.10 | 10:32:29,884 | 10.10.10.200 |          72875
 Executing seq scan across 0 sstables for (max(-7289624796331900507), max(-7227663503983266473)] | 10:32:29,884 | 10.10.10.200 |          72974
                                                                    Scanned 0 rows and matched 0 | 10:32:29,884 | 10.10.10.200 |          72998
 Executing seq scan across 0 sstables for (max(-7227663503983266473), max(-7206530577063076397)] | 10:32:29,884 | 10.10.10.200 |          73089
                                                                    Scanned 0 rows and matched 0 | 10:32:29,884 | 10.10.10.200 |          73106
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,884 | 10.10.10.200 |          73158
                                                                Sending message to /10.100.10.10 | 10:32:29,884 | 10.10.10.200 |          73202
                                                             Message received from /10.10.10.200 | 10:32:29,886 | 10.100.10.10 |             14
 Executing seq scan across 0 sstables for (max(-7052154013890814892), max(-6992345552257018733)] | 10:32:29,886 | 10.100.10.10 |            102
                                                                    Scanned 0 rows and matched 0 | 10:32:29,886 | 10.100.10.10 |            157
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,886 | 10.100.10.10 |            182
                                                                Sending message to /10.10.10.200 | 10:32:29,886 | 10.100.10.10 |            228
                                                             Message received from /10.10.10.200 | 10:32:29,887 | 10.100.10.10 |             15
                                                             Message received from /10.100.10.10 | 10:32:29,888 | 10.10.10.200 |          76520
 Executing seq scan across 0 sstables for (max(-6992345552257018733), max(-6984297540970650519)] | 10:32:29,888 | 10.100.10.10 |            440
                                                          Processing response from /10.100.10.10 | 10:32:29,888 | 10.10.10.200 |          76568
                                                                    Scanned 0 rows and matched 0 | 10:32:29,888 | 10.100.10.10 |            468
 Executing seq scan across 0 sstables for (max(-7193707678937979856), max(-7155649084555074240)] | 10:32:29,888 | 10.10.10.200 |          76667
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,888 | 10.100.10.10 |            494
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,888 | 10.10.10.200 |          76742
                                                                Sending message to /10.10.10.200 | 10:32:29,888 | 10.100.10.10 |            566
                                                                    Scanned 1 rows and matched 1 | 10:32:29,888 | 10.10.10.200 |          76765
 Executing seq scan across 0 sstables for (max(-7155649084555074240), max(-7141551675747740452)] | 10:32:29,888 | 10.10.10.200 |          77001
                                                                    Scanned 0 rows and matched 0 | 10:32:29,888 | 10.10.10.200 |          77041
 Executing seq scan across 0 sstables for (max(-7141551675747740452), max(-7106996367524033136)] | 10:32:29,888 | 10.10.10.200 |          77131
                                                                    Scanned 0 rows and matched 0 | 10:32:29,888 | 10.10.10.200 |          77149
 Executing seq scan across 0 sstables for (max(-7106996367524033136), max(-7086846501108917900)] | 10:32:29,888 | 10.10.10.200 |          77311
                                                                    Scanned 0 rows and matched 0 | 10:32:29,888 | 10.10.10.200 |          77336
 Executing seq scan across 0 sstables for (max(-7086846501108917900), max(-7077145769313733834)] | 10:32:29,889 | 10.10.10.200 |          77429
                                                                    Scanned 0 rows and matched 0 | 10:32:29,889 | 10.10.10.200 |          77447
 Executing seq scan across 0 sstables for (max(-7077145769313733834), max(-7052154013890814892)] | 10:32:29,889 | 10.10.10.200 |          77538
                                                                    Scanned 0 rows and matched 0 | 10:32:29,889 | 10.10.10.200 |          77556
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,889 | 10.10.10.200 |          77607
                                                                Sending message to /10.100.10.10 | 10:32:29,889 | 10.10.10.200 |          77756
                                                             Message received from /10.100.10.10 | 10:32:29,890 | 10.10.10.200 |          79133
                                                             Message received from /10.10.10.200 | 10:32:29,890 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,890 | 10.10.10.200 |          79177
 Executing seq scan across 0 sstables for (max(-6984297540970650519), max(-6886849656804722937)] | 10:32:29,890 | 10.100.10.10 |            196
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,890 | 10.10.10.200 |          79257
                                                                    Scanned 0 rows and matched 0 | 10:32:29,890 | 10.100.10.10 |            228
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,890 | 10.100.10.10 |            251
                                                                Sending message to /10.10.10.200 | 10:32:29,890 | 10.100.10.10 |            296
                                                                Sending message to /10.100.10.10 | 10:32:29,891 | 10.10.10.200 |          79430
                                                             Message received from /10.100.10.10 | 10:32:29,892 | 10.10.10.200 |          81054
                                                             Message received from /10.10.10.200 | 10:32:29,892 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,892 | 10.10.10.200 |          81099
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,892 | 10.10.10.200 |          81158
                                                                Sending message to /10.100.10.10 | 10:32:29,892 | 10.10.10.200 |          81219
 Executing seq scan across 0 sstables for (max(-6858885281601581066), max(-6808644573935606239)] | 10:32:29,893 | 10.100.10.10 |            195
                                                                    Scanned 0 rows and matched 0 | 10:32:29,893 | 10.100.10.10 |            225
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,893 | 10.100.10.10 |            247
                                                                Sending message to /10.10.10.200 | 10:32:29,893 | 10.100.10.10 |            292
                                                             Message received from /10.100.10.10 | 10:32:29,895 | 10.10.10.200 |          83371
                                                             Message received from /10.10.10.200 | 10:32:29,895 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,895 | 10.10.10.200 |          83424
 Executing seq scan across 0 sstables for (max(-6886849656804722937), max(-6859355547535347036)] | 10:32:29,895 | 10.10.10.200 |          83547
                                                                    Scanned 0 rows and matched 0 | 10:32:29,895 | 10.10.10.200 |          83567
 Executing seq scan across 0 sstables for (max(-6859355547535347036), max(-6858885281601581066)] | 10:32:29,895 | 10.10.10.200 |          83677
                                                                    Scanned 0 rows and matched 0 | 10:32:29,895 | 10.10.10.200 |          83736
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,895 | 10.10.10.200 |          83796
                                                                Sending message to /10.100.10.10 | 10:32:29,895 | 10.10.10.200 |          83851
 Executing seq scan across 0 sstables for (max(-6702836051995416034), max(-6659887118281626292)] | 10:32:29,896 | 10.100.10.10 |           1067
                                                                    Scanned 0 rows and matched 0 | 10:32:29,896 | 10.100.10.10 |           1098
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,896 | 10.100.10.10 |           1120
                                                                Sending message to /10.10.10.200 | 10:32:29,896 | 10.100.10.10 |           1180
                                                             Message received from /10.100.10.10 | 10:32:29,897 | 10.10.10.200 |          86021
                                                          Processing response from /10.100.10.10 | 10:32:29,897 | 10.10.10.200 |          86066
 Executing seq scan across 0 sstables for (max(-6808644573935606239), max(-6766406881475559205)] | 10:32:29,897 | 10.10.10.200 |          86188
                                                                    Scanned 0 rows and matched 0 | 10:32:29,897 | 10.10.10.200 |          86207
 Executing seq scan across 0 sstables for (max(-6766406881475559205), max(-6726521077819108230)] | 10:32:29,898 | 10.10.10.200 |          86368
                                                                    Scanned 0 rows and matched 0 | 10:32:29,898 | 10.10.10.200 |          86390
 Executing seq scan across 0 sstables for (max(-6726521077819108230), max(-6702836051995416034)] | 10:32:29,898 | 10.10.10.200 |          86477
                                                                    Scanned 0 rows and matched 0 | 10:32:29,898 | 10.10.10.200 |          86499
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,898 | 10.10.10.200 |          86551
                                                                Sending message to /10.100.10.10 | 10:32:29,898 | 10.10.10.200 |          86700
                                                             Message received from /10.10.10.200 | 10:32:29,899 | 10.100.10.10 |             99
 Executing seq scan across 0 sstables for (max(-6659887118281626292), max(-6654417042897836875)] | 10:32:29,899 | 10.100.10.10 |            255
                                                                    Scanned 0 rows and matched 0 | 10:32:29,899 | 10.100.10.10 |            305
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,899 | 10.100.10.10 |            328
                                                                Sending message to /10.10.10.200 | 10:32:29,899 | 10.100.10.10 |            374
                                                             Message received from /10.100.10.10 | 10:32:29,900 | 10.10.10.200 |          88992
                                                             Message received from /10.10.10.200 | 10:32:29,900 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,900 | 10.10.10.200 |          89037
 Executing seq scan across 0 sstables for (max(-6654417042897836875), max(-6653683072058782526)] | 10:32:29,900 | 10.100.10.10 |            361
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,900 | 10.10.10.200 |          89094
                                                                    Scanned 0 rows and matched 0 | 10:32:29,900 | 10.100.10.10 |            389
                                                                Sending message to /10.100.10.10 | 10:32:29,900 | 10.10.10.200 |          89146
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,901 | 10.100.10.10 |            442
                                                                Sending message to /10.10.10.200 | 10:32:29,901 | 10.100.10.10 |            529
                                                             Message received from /10.10.10.200 | 10:32:29,902 | 10.100.10.10 |             14
                                                             Message received from /10.100.10.10 | 10:32:29,903 | 10.10.10.200 |          92208
 Executing seq scan across 0 sstables for (max(-6612637177973889097), max(-6579875099398175156)] | 10:32:29,903 | 10.100.10.10 |            719
                                                          Processing response from /10.100.10.10 | 10:32:29,903 | 10.10.10.200 |          92257
                                                                    Scanned 0 rows and matched 0 | 10:32:29,903 | 10.100.10.10 |            750
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,903 | 10.10.10.200 |          92322
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,903 | 10.100.10.10 |            773
                                                                Sending message to /10.10.10.200 | 10:32:29,903 | 10.100.10.10 |            818
                                                                Sending message to /10.100.10.10 | 10:32:29,904 | 10.10.10.200 |          92377
                                                             Message received from /10.10.10.200 | 10:32:29,904 | 10.100.10.10 |             20
 Executing seq scan across 0 sstables for (max(-6579875099398175156), max(-6416850907694759701)] | 10:32:29,904 | 10.100.10.10 |            108
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,904 | 10.100.10.10 |            217
                                                                    Scanned 1 rows and matched 1 | 10:32:29,904 | 10.100.10.10 |            246
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,904 | 10.100.10.10 |            269
                                                                Sending message to /10.10.10.200 | 10:32:29,904 | 10.100.10.10 |            317
                                                             Message received from /10.100.10.10 | 10:32:29,905 | 10.10.10.200 |          93881
                                                          Processing response from /10.100.10.10 | 10:32:29,905 | 10.10.10.200 |          93929
 Executing seq scan across 0 sstables for (max(-6653683072058782526), max(-6612637177973889097)] | 10:32:29,905 | 10.10.10.200 |          94029
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,905 | 10.10.10.200 |          94099
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,905 | 10.10.10.200 |          94134
                                                                    Scanned 2 rows and matched 2 | 10:32:29,905 | 10.10.10.200 |          94151
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,905 | 10.10.10.200 |          94210
                                                                Sending message to /10.100.10.10 | 10:32:29,906 | 10.10.10.200 |          94501
                                                             Message received from /10.100.10.10 | 10:32:29,907 | 10.10.10.200 |          95934
                                                             Message received from /10.10.10.200 | 10:32:29,907 | 10.100.10.10 |             16
                                                          Processing response from /10.100.10.10 | 10:32:29,907 | 10.10.10.200 |          95982
 Executing seq scan across 0 sstables for (max(-6416850907694759701), max(-6350310147739112536)] | 10:32:29,907 | 10.100.10.10 |            363
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,907 | 10.10.10.200 |          96041
                                                                    Scanned 0 rows and matched 0 | 10:32:29,907 | 10.100.10.10 |            633
                                                                Sending message to /10.100.10.10 | 10:32:29,907 | 10.10.10.200 |          96100
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,907 | 10.100.10.10 |            659
                                                                Sending message to /10.10.10.200 | 10:32:29,907 | 10.100.10.10 |            715
                                                             Message received from /10.10.10.200 | 10:32:29,908 | 10.100.10.10 |             14
 Executing seq scan across 0 sstables for (max(-6350310147739112536), max(-6322986782616207190)] | 10:32:29,908 | 10.100.10.10 |            198
                                                                    Scanned 0 rows and matched 0 | 10:32:29,908 | 10.100.10.10 |            229
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,908 | 10.100.10.10 |            251
                                                                Sending message to /10.10.10.200 | 10:32:29,908 | 10.100.10.10 |            339
                                                             Message received from /10.100.10.10 | 10:32:29,909 | 10.10.10.200 |          97793
                                                          Processing response from /10.100.10.10 | 10:32:29,909 | 10.10.10.200 |          97905
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,909 | 10.10.10.200 |          97967
                                                                Sending message to /10.100.10.10 | 10:32:29,909 | 10.10.10.200 |          98023
                                                             Message received from /10.10.10.200 | 10:32:29,910 | 10.100.10.10 |             16
 Executing seq scan across 0 sstables for (max(-6222505134890287439), max(-6208656358102697057)] | 10:32:29,910 | 10.100.10.10 |            275
                                                                    Scanned 0 rows and matched 0 | 10:32:29,910 | 10.100.10.10 |            304
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,910 | 10.100.10.10 |            330
                                                                Sending message to /10.10.10.200 | 10:32:29,910 | 10.100.10.10 |            408
                                                             Message received from /10.100.10.10 | 10:32:29,912 | 10.10.10.200 |         100567
                                                             Message received from /10.10.10.200 | 10:32:29,912 | 10.100.10.10 |             17
                                                          Processing response from /10.100.10.10 | 10:32:29,912 | 10.10.10.200 |         100615
 Executing seq scan across 0 sstables for (max(-6186273263489399965), max(-6156332924838406292)] | 10:32:29,912 | 10.100.10.10 |            399
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,912 | 10.10.10.200 |         100674
                                                                    Scanned 0 rows and matched 0 | 10:32:29,912 | 10.100.10.10 |            428
                                                                Sending message to /10.100.10.10 | 10:32:29,912 | 10.10.10.200 |         100731
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,912 | 10.100.10.10 |            450
                                                                Sending message to /10.10.10.200 | 10:32:29,912 | 10.100.10.10 |            543
                                                             Message received from /10.100.10.10 | 10:32:29,913 | 10.10.10.200 |         101771
                                                          Processing response from /10.100.10.10 | 10:32:29,913 | 10.10.10.200 |         101818
 Executing seq scan across 0 sstables for (max(-6322986782616207190), max(-6222505134890287439)] | 10:32:29,913 | 10.10.10.200 |         101932
                                                                    Scanned 0 rows and matched 0 | 10:32:29,913 | 10.10.10.200 |         101957
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,913 | 10.10.10.200 |         102010
                                                                Sending message to /10.100.10.10 | 10:32:29,913 | 10.10.10.200 |         102129
                                                             Message received from /10.10.10.200 | 10:32:29,914 | 10.100.10.10 |             14
                                                             Message received from /10.100.10.10 | 10:32:29,915 | 10.10.10.200 |         103426
 Executing seq scan across 0 sstables for (max(-6040909159294332851), max(-5985412769565683297)] | 10:32:29,915 | 10.100.10.10 |            432
                                                          Processing response from /10.100.10.10 | 10:32:29,915 | 10.10.10.200 |         103573
                                                                    Scanned 0 rows and matched 0 | 10:32:29,915 | 10.100.10.10 |            461
 Executing seq scan across 0 sstables for (max(-6208656358102697057), max(-6186273263489399965)] | 10:32:29,915 | 10.10.10.200 |         103671
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,915 | 10.100.10.10 |            511
                                                                    Scanned 0 rows and matched 0 | 10:32:29,915 | 10.10.10.200 |         103689
                                                                Sending message to /10.10.10.200 | 10:32:29,915 | 10.100.10.10 |            559
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,915 | 10.10.10.200 |         103749
                                                                Sending message to /10.100.10.10 | 10:32:29,915 | 10.10.10.200 |         103800
                                                             Message received from /10.10.10.200 | 10:32:29,916 | 10.100.10.10 |             14
                                                             Message received from /10.100.10.10 | 10:32:29,917 | 10.10.10.200 |         105689
 Executing seq scan across 0 sstables for (max(-5985412769565683297), max(-5968055162352912193)] | 10:32:29,917 | 10.100.10.10 |            386
                                                          Processing response from /10.100.10.10 | 10:32:29,917 | 10.10.10.200 |         105737
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,917 | 10.100.10.10 |            465
 Executing seq scan across 0 sstables for (max(-6156332924838406292), max(-6095750444652389273)] | 10:32:29,917 | 10.10.10.200 |         105843
                                                                    Scanned 1 rows and matched 1 | 10:32:29,917 | 10.100.10.10 |            492
                                                                    Scanned 0 rows and matched 0 | 10:32:29,917 | 10.10.10.200 |         105865
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,917 | 10.100.10.10 |            515
 Executing seq scan across 0 sstables for (max(-6095750444652389273), max(-6080117390846736578)] | 10:32:29,917 | 10.10.10.200 |         106058
                                                                Sending message to /10.10.10.200 | 10:32:29,917 | 10.100.10.10 |            663
                                                                    Scanned 0 rows and matched 0 | 10:32:29,917 | 10.10.10.200 |         106078
 Executing seq scan across 0 sstables for (max(-6080117390846736578), max(-6057626480186618775)] | 10:32:29,917 | 10.10.10.200 |         106239
                                                                    Scanned 0 rows and matched 0 | 10:32:29,917 | 10.10.10.200 |         106256
 Executing seq scan across 0 sstables for (max(-6057626480186618775), max(-6040909159294332851)] | 10:32:29,918 | 10.10.10.200 |         106405
                                                                    Scanned 0 rows and matched 0 | 10:32:29,918 | 10.10.10.200 |         106423
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,918 | 10.10.10.200 |         106480
                                                                Sending message to /10.100.10.10 | 10:32:29,918 | 10.10.10.200 |         106538
                                                             Message received from /10.100.10.10 | 10:32:29,919 | 10.10.10.200 |         108088
                                                             Message received from /10.10.10.200 | 10:32:29,919 | 10.100.10.10 |             16
                                                          Processing response from /10.100.10.10 | 10:32:29,919 | 10.10.10.200 |         108158
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,919 | 10.10.10.200 |         108215
                                                                Sending message to /10.100.10.10 | 10:32:29,920 | 10.10.10.200 |         108395
 Executing seq scan across 0 sstables for (max(-5968055162352912193), max(-5948517750984450247)] | 10:32:29,920 | 10.100.10.10 |            285
                                                                    Scanned 0 rows and matched 0 | 10:32:29,920 | 10.100.10.10 |            315
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,920 | 10.100.10.10 |            337
                                                                Sending message to /10.10.10.200 | 10:32:29,920 | 10.100.10.10 |            424
                                                             Message received from /10.100.10.10 | 10:32:29,921 | 10.10.10.200 |         110242
                                                             Message received from /10.10.10.200 | 10:32:29,921 | 10.100.10.10 |             27
                                                          Processing response from /10.100.10.10 | 10:32:29,921 | 10.10.10.200 |         110290
 Executing seq scan across 0 sstables for (max(-5948517750984450247), max(-5946849253072432362)] | 10:32:29,921 | 10.100.10.10 |            396
                                                                    Scanned 0 rows and matched 0 | 10:32:29,921 | 10.100.10.10 |            425
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,921 | 10.100.10.10 |            447
                                                                Sending message to /10.10.10.200 | 10:32:29,921 | 10.100.10.10 |            496
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,922 | 10.10.10.200 |         110350
                                                                Sending message to /10.100.10.10 | 10:32:29,922 | 10.10.10.200 |         110405
                                                             Message received from /10.10.10.200 | 10:32:29,923 | 10.100.10.10 |             16
 Executing seq scan across 0 sstables for (max(-5657405069341799340), max(-5628839850111446828)] | 10:32:29,923 | 10.100.10.10 |            208
                                                                    Scanned 0 rows and matched 0 | 10:32:29,923 | 10.100.10.10 |            238
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,923 | 10.100.10.10 |            260
                                                                Sending message to /10.10.10.200 | 10:32:29,923 | 10.100.10.10 |            307
                                                             Message received from /10.100.10.10 | 10:32:29,924 | 10.10.10.200 |         113011
                                                          Processing response from /10.100.10.10 | 10:32:29,924 | 10.10.10.200 |         113059
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,924 | 10.10.10.200 |         113118
                                                                Sending message to /10.100.10.10 | 10:32:29,924 | 10.10.10.200 |         113278
                                                             Message received from /10.10.10.200 | 10:32:29,925 | 10.100.10.10 |             19
 Executing seq scan across 0 sstables for (max(-5628839850111446828), max(-5555031559823762395)] | 10:32:29,925 | 10.100.10.10 |            194
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,925 | 10.100.10.10 |            265
                                                                    Scanned 1 rows and matched 1 | 10:32:29,925 | 10.100.10.10 |            291
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,925 | 10.100.10.10 |            337
                                                                Sending message to /10.10.10.200 | 10:32:29,925 | 10.100.10.10 |            385
                                                             Message received from /10.100.10.10 | 10:32:29,926 | 10.10.10.200 |         114638
                                                          Processing response from /10.100.10.10 | 10:32:29,926 | 10.10.10.200 |         114686
 Executing seq scan across 0 sstables for (max(-5946849253072432362), max(-5892325561580942446)] | 10:32:29,926 | 10.10.10.200 |         114803
                                                                    Scanned 0 rows and matched 0 | 10:32:29,926 | 10.10.10.200 |         114823
 Executing seq scan across 0 sstables for (max(-5892325561580942446), max(-5732538717997605621)] | 10:32:29,926 | 10.10.10.200 |         114974
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,926 | 10.10.10.200 |         115041
                                                                    Scanned 1 rows and matched 1 | 10:32:29,926 | 10.10.10.200 |         115062
 Executing seq scan across 0 sstables for (max(-5732538717997605621), max(-5657405069341799340)] | 10:32:29,926 | 10.10.10.200 |         115175
                                                                    Scanned 0 rows and matched 0 | 10:32:29,926 | 10.10.10.200 |         115192
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,926 | 10.10.10.200 |         115251
                                                                Sending message to /10.100.10.10 | 10:32:29,927 | 10.10.10.200 |         115362
                                                             Message received from /10.10.10.200 | 10:32:29,927 | 10.100.10.10 |             18
                                                             Message received from /10.100.10.10 | 10:32:29,927 | 10.10.10.200 |         116300
 Executing seq scan across 0 sstables for (max(-5499210590275684339), max(-5466184867665963679)] | 10:32:29,927 | 10.100.10.10 |            184
                                                          Processing response from /10.100.10.10 | 10:32:29,927 | 10.10.10.200 |         116347
                                                                    Scanned 0 rows and matched 0 | 10:32:29,927 | 10.100.10.10 |            213
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,927 | 10.100.10.10 |            237
                                                                Sending message to /10.10.10.200 | 10:32:29,927 | 10.100.10.10 |            307
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,928 | 10.10.10.200 |         116413
                                                                Sending message to /10.100.10.10 | 10:32:29,928 | 10.10.10.200 |         116485
                                                             Message received from /10.100.10.10 | 10:32:29,930 | 10.10.10.200 |         118524
                                                             Message received from /10.10.10.200 | 10:32:29,930 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,930 | 10.10.10.200 |         118571
 Executing seq scan across 0 sstables for (max(-5555031559823762395), max(-5553156017493192454)] | 10:32:29,930 | 10.10.10.200 |         118683
                                                                    Scanned 0 rows and matched 0 | 10:32:29,930 | 10.10.10.200 |         118711
 Executing seq scan across 0 sstables for (max(-5553156017493192454), max(-5499210590275684339)] | 10:32:29,930 | 10.10.10.200 |         118804
                                                                    Scanned 0 rows and matched 0 | 10:32:29,930 | 10.10.10.200 |         118820
                                                              Enqueuing request to /10.100.10.10 | 10:32:29,930 | 10.10.10.200 |         118879
                                                                Sending message to /10.100.10.10 | 10:32:29,930 | 10.10.10.200 |         118947
 Executing seq scan across 0 sstables for (max(-5162018820312076329), max(-5098292409978248397)] | 10:32:29,931 | 10.100.10.10 |            446
                                                                    Scanned 0 rows and matched 0 | 10:32:29,931 | 10.100.10.10 |            478
                                                             Enqueuing response to /10.10.10.200 | 10:32:29,931 | 10.100.10.10 |            500
                                                                Sending message to /10.10.10.200 | 10:32:29,931 | 10.100.10.10 |            547
                                                             Message received from /10.100.10.10 | 10:32:29,932 | 10.10.10.200 |         120774
                                                             Message received from /10.10.10.200 | 10:32:29,932 | 10.100.10.10 |             14
                                                          Processing response from /10.100.10.10 | 10:32:29,932 | 10.10.10.200 |         120821
 Executing seq scan across 0 sstables for (max(-5466184867665963679), max(-5448200515236856206)] | 10:32:29,932 | 10.10.10.200 |         120947
                                                                    Scanned 0 rows and matched 0 | 10:32:29,932 | 10.10.10.200 |         120966
 Executing seq scan across 0 sstables for (max(-5448200515236856206), max(-5285426351523733117)] | 10:32:29,932 | 10.10.10.200 |         121140
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,932 | 10.10.10.200 |         121200
                                                                    Scanned 1 rows and matched 1 | 10:32:29,932 | 10.10.10.200 |         121218
 Executing seq scan across 0 sstables for (max(-5285426351523733117), max(-5203473698720095617)] | 10:32:29,932 | 10.10.10.200 |         121311
                                                                    Scanned 0 rows and matched 0 | 10:32:29,932 | 10.10.10.200 |         121328
 Executing seq scan across 0 sstables for (max(-5203473698720095617), max(-5162018820312076329)] | 10:32:29,933 | 10.10.10.200 |         121417
 Executing seq scan across 0 sstables for (max(-5051971841363948749), max(-5050141115774371279)] | 10:32:29,933 | 10.100.10.10 |            483
                                                              Read 1 live and 0 tombstoned cells | 10:32:29,933 | 10.10.10.200 |         121459
                                                                    Scanned 0 rows and matched 0 | 10:32:29,933 | 10.100.10.10 |            512



Re: Error opening zip file or JAR manifest missing

Posted by Yuki Morishita <mo...@gmail.com>.
Micheal,

Thanks, and done. :)

On Mon, Nov 24, 2014 at 6:37 PM, Michael Shuler <mi...@pbandjelly.org> wrote:
> On 11/22/2014 05:58 PM, Rajanarayanan Thottuvaikkatumana wrote:
>>
>> A huge number of tests are failing with the same error message.
>> Reproducing one of such errors.
>>
>> testlist:
>>       [echo] running test bucket 0 tests
>>      [mkdir] Created dir:
>> /Users/RajT/cassandra-source/cassandra-trunk/build/test/cassandra
>>      [mkdir] Created dir:
>> /Users/RajT/cassandra-source/cassandra-trunk/build/test/output
>>      [junit] WARNING: multiple versions of ant detected in path for junit
>>      [junit]
>> jar:file:/usr/local/Cellar/ant/1.9.4/libexec/lib/ant.jar!/org/apache/tools/ant/Project.class
>>      [junit]      and
>> jar:file:/Users/RajT/cassandra-source/cassandra-trunk/build/lib/jars/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
>>      [junit] Error occurred during initialization of VM
>>      [junit] agent library failed to init: instrument
>>      [junit] objc[1300]: Class JavaLaunchHelper is implemented in both
>> /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/bin/java
>> and
>> /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/lib/libinstrument.dylib.
>> One of the two will be used. Which one is undefined.
>>      [junit] Error opening zip file or JAR manifest missing :
>> /Users/RajT/cassandra-source/cassandra-trunk/lib/jamm-0.3.0.jar
>>      [junit] Testsuite: org.apache.cassandra.cache.AutoSavingCacheTest
>>      [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
>> elapsed: 0 sec
>>      [junit]
>>      [junit] Testcase:
>> org.apache.cassandra.cache.AutoSavingCacheTest:null:     Caused an ERROR
>>      [junit] Forked Java VM exited abnormally. Please note the time in the
>> report does not reflect the time until the VM exit.
>>      [junit] junit.framework.AssertionFailedError: Forked Java VM exited
>> abnormally. Please note the time in the report does not reflect the time
>> until the VM exit.
>>      [junit]    at java.lang.Thread.run(Thread.java:745)
>
>
> I fixed this last time a new jamm jar was included. The problem is the
> conflict resolution on merge from 2.1 to trunk - value= is overwritten where
> there should be line=.
>
> Patch attached. Could someone commit this to trunk, pretty please?  :)
>
> --
> Kind regards,
> Michael
>



-- 
Yuki Morishita
 t:yukim (http://twitter.com/yukim)

Re: Error opening zip file or JAR manifest missing

Posted by Michael Shuler <mi...@pbandjelly.org>.
On 11/22/2014 05:58 PM, Rajanarayanan Thottuvaikkatumana wrote:
> A huge number of tests are failing with the same error message. Reproducing one of such errors.
>
> testlist:
>       [echo] running test bucket 0 tests
>      [mkdir] Created dir: /Users/RajT/cassandra-source/cassandra-trunk/build/test/cassandra
>      [mkdir] Created dir: /Users/RajT/cassandra-source/cassandra-trunk/build/test/output
>      [junit] WARNING: multiple versions of ant detected in path for junit
>      [junit]          jar:file:/usr/local/Cellar/ant/1.9.4/libexec/lib/ant.jar!/org/apache/tools/ant/Project.class
>      [junit]      and jar:file:/Users/RajT/cassandra-source/cassandra-trunk/build/lib/jars/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
>      [junit] Error occurred during initialization of VM
>      [junit] agent library failed to init: instrument
>      [junit] objc[1300]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/bin/java and /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/lib/libinstrument.dylib. One of the two will be used. Which one is undefined.
>      [junit] Error opening zip file or JAR manifest missing : /Users/RajT/cassandra-source/cassandra-trunk/lib/jamm-0.3.0.jar
>      [junit] Testsuite: org.apache.cassandra.cache.AutoSavingCacheTest
>      [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec
>      [junit]
>      [junit] Testcase: org.apache.cassandra.cache.AutoSavingCacheTest:null:	Caused an ERROR
>      [junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
>      [junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
>      [junit] 	at java.lang.Thread.run(Thread.java:745)

I fixed this last time a new jamm jar was included. The problem is the 
conflict resolution on merge from 2.1 to trunk - value= is overwritten 
where there should be line=.

Patch attached. Could someone commit this to trunk, pretty please?  :)

-- 
Kind regards,
Michael


Re: Error opening zip file or JAR manifest missing

Posted by Rajanarayanan Thottuvaikkatumana <rn...@gmail.com>.
A huge number of tests are failing with the same error message. Reproducing one of such errors.

testlist:
     [echo] running test bucket 0 tests
    [mkdir] Created dir: /Users/RajT/cassandra-source/cassandra-trunk/build/test/cassandra
    [mkdir] Created dir: /Users/RajT/cassandra-source/cassandra-trunk/build/test/output
    [junit] WARNING: multiple versions of ant detected in path for junit 
    [junit]          jar:file:/usr/local/Cellar/ant/1.9.4/libexec/lib/ant.jar!/org/apache/tools/ant/Project.class
    [junit]      and jar:file:/Users/RajT/cassandra-source/cassandra-trunk/build/lib/jars/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
    [junit] Error occurred during initialization of VM
    [junit] agent library failed to init: instrument
    [junit] objc[1300]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/bin/java and /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/lib/libinstrument.dylib. One of the two will be used. Which one is undefined.
    [junit] Error opening zip file or JAR manifest missing : /Users/RajT/cassandra-source/cassandra-trunk/lib/jamm-0.3.0.jar 
    [junit] Testsuite: org.apache.cassandra.cache.AutoSavingCacheTest
    [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec
    [junit] 
    [junit] Testcase: org.apache.cassandra.cache.AutoSavingCacheTest:null:	Caused an ERROR
    [junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
    [junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
    [junit] 	at java.lang.Thread.run(Thread.java:745)

Thanks
-Raj


On 22-Nov-2014, at 11:46 pm, Rajanarayanan Thottuvaikkatumana <rn...@gmail.com> wrote:

> While I am running some of the tests, I am getting the following error. 
> 
> [junit] Error opening zip file or JAR manifest missing : /Users/RajT/cassandra-source/cassandra-trunk/lib/jamm-0.3.0.jar 
> 
> In the git log, I could see the following.
> f02d194 Add missing jamm jar from CASSANDRA-8231 commit
> 
> 
> Are they related any way? 
> 
> Thanks
> -Raj


Error opening zip file or JAR manifest missing

Posted by Rajanarayanan Thottuvaikkatumana <rn...@gmail.com>.
While I am running some of the tests, I am getting the following error. 

[junit] Error opening zip file or JAR manifest missing : /Users/RajT/cassandra-source/cassandra-trunk/lib/jamm-0.3.0.jar 

In the git log, I could see the following.
f02d194 Add missing jamm jar from CASSANDRA-8231 commit


Are they related any way? 

Thanks
-Raj

Re: Reads requiring response from both servers.

Posted by Tyler Hobbs <ty...@datastax.com>.
On Tue, Nov 18, 2014 at 1:57 PM, Jacob Rhoden <ja...@me.com> wrote:

>
>
> If there are two nodes and RF=2, a simple data lookup on a very small
> table will only need to talk to one node if you put in a (fake/pointless)
> partition key, but two nodes if you don't. The impact is that if you want
> 1ms query time on a 50 row table you must use a partition key, otherwise
> you get 250ms query time.
>

A query that's restricted to a single partition key is fundamentally
different from an unrestricted table scan (Cassandra doesn't know that you
only have one partition).  So seeing a performance difference between the
two is not unexpected.

However, there were some semi-recent changes that improved the likelihood
that neighboring range scans will be merged if one node is a replica for
both ranges: CASSANDRA-6465 and CASSANDRA-7535.  In your case, all of the
ranges could potentially be merged to form a single range scan.  If you're
seeing this behavior on Cassandra 2.0.10+, it *may* be a bug.


>
>
> >> Why is this a bug? It seems that this behaviour of needing a response to
> >> both nodes only exists if you don’t query with a clustering key, or a
> key
> >> when RF=2. However you can change this behaviour, by, for example,
> changing
> >> the table from “primary key (uuid)” to “primary key ((a), uuid)” where
> the
> >> value of a always equals “a” ( so you can query 'where a=“a”’), at which
> >> point, cassandra decides it only needs results from one node.
> >
> > Can you clarify what you mean?  It sounds like you're saying "if I
> specify
> > a partition key, it only needs to query one node", which is also expected
> > behavior (assuming a consistency level of ONE).
>
> It's my understanding from the documentation that consistency level one
> (which I am using) is about write consistency, not read consistency.
> Actually if I change it in cqlsh, cqlsh refuses to run the query.
>

The consistency level matters for both reads and writes.


-- 
Tyler Hobbs
DataStax <http://datastax.com/>

Re: Latest Code from Trunk - Server is not starting

Posted by Robert Stupp <sn...@snazy.de>.
Try to clear the data + commitlog directory.
At least the primary key for system.schema_functions table has changed in an incompatible way.


> Am 18.11.2014 um 21:43 schrieb Rajanarayanan Thottuvaikkatumana <rn...@gmail.com>:
> 
> I have taken the latest code from trunk, compiled (I have some changes in some of the local files also). But when I start the Cassandra server, I am getting exceptions. The exceptions are not seeming to be from the classed where I changed OR has any relationship with the ones that are showing error. Any idea? Anybody else is getting same error? 
> 
> Rajanarayanans-MacBook-Pro:cassandra-trunk RajT$ ./bin/cassandra -f
> objc[4284]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/bin/java and /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/lib/libinstrument.dylib. One of the two will be used. Which one is undefined.
> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-local-7ad54392bcdd35a684174e047860b377-KeyCache-b.db
> ERROR 20:34:21 Exception encountered during startup
> java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
> 	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373) ~[main/:na]
> 	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643) ~[main/:na]
> 	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257) [main/:na]
> 	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482) [main/:na]
> 	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574) [main/:na]
> Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
> 	at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87) ~[main/:na]
> 	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53) ~[main/:na]
> 	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47) ~[main/:na]
> 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
> 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
> 	at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115) ~[main/:na]
> 	at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172) ~[main/:na]
> 	at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155) ~[main/:na]
> 	at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146) ~[main/:na]
> 	at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89) ~[main/:na]
> 	at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48) ~[main/:na]
> 	at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103) ~[main/:na]
> 	at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81) ~[main/:na]
> 	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99) ~[main/:na]
> 	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71) ~[main/:na]
> 	at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117) ~[main/:na]
> 	at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100) ~[main/:na]
> 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
> 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
> 	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931) ~[main/:na]
> 	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927) ~[main/:na]
> 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
> 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
> 	at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079) ~[main/:na]
> 	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038) ~[main/:na]
> 	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972) ~[main/:na]
> 	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942) ~[main/:na]
> 	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929) ~[main/:na]
> 	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357) ~[main/:na]
> 	... 4 common frames omitted


Re: Latest Code from Trunk - Server is not starting

Posted by Rajanarayanan Thottuvaikkatumana <rn...@gmail.com>.
Thanks a lot. It worked. Thanks
-Raj
On 18-Nov-2014, at 9:00 pm, Yuki Morishita <mo...@gmail.com> wrote:

> Clear your './bin/../data/data' directory, and cassandra will start up fine.
> 
> On Tue, Nov 18, 2014 at 2:43 PM, Rajanarayanan Thottuvaikkatumana
> <rn...@gmail.com> wrote:
>> I have taken the latest code from trunk, compiled (I have some changes in some of the local files also). But when I start the Cassandra server, I am getting exceptions. The exceptions are not seeming to be from the classed where I changed OR has any relationship with the ones that are showing error. Any idea? Anybody else is getting same error?
>> 
>> Rajanarayanans-MacBook-Pro:cassandra-trunk RajT$ ./bin/cassandra -f
>> objc[4284]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/bin/java and /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/lib/libinstrument.dylib. One of the two will be used. Which one is undefined.
>> CompilerOracle: inline org/apache/cassandra/db/AbstractNativeCell.compareTo (Lorg/apache/cassandra/db/composites/Composite;)I
>> CompilerOracle: inline org/apache/cassandra/db/composites/AbstractSimpleCellNameType.compareUnsigned (Lorg/apache/cassandra/db/composites/Composite;Lorg/apache/cassandra/db/composites/Composite;)I
>> CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare (Ljava/nio/ByteBuffer;[B)I
>> CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare ([BLjava/nio/ByteBuffer;)I
>> CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compareUnsigned (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
>> CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/lang/Object;JI)I
>> CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/nio/ByteBuffer;)I
>> CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
>> INFO  20:34:19 Hostname: Rajanarayanans-MacBook-Pro.local
>> INFO  20:34:19 Loading settings from file:/Users/RajT/cassandra-source/cassandra-trunk/conf/cassandra.yaml
>> INFO  20:34:19 Node configuration:[authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; cas_contention_timeout_in_ms=1000; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_period_in_ms=10000; compaction_throughput_mb_per_sec=16; concurrent_counter_writes=32; concurrent_reads=32; concurrent_writes=32; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; cross_node_timeout=false; disk_failure_policy=stop; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; endpoint_snitch=SimpleSnitch; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; incremental_backups=false; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; inter_dc_tcp_nodelay=false; internode_compression=all; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=localhost; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; memtable_allocation_type=heap_buffers; native_transport_port=9042; num_tokens=256; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_validity_in_ms=2000; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_timeout_in_ms=10000; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=localhost; rpc_keepalive=true; rpc_port=9160; rpc_server_type=sync; seed_provider=[{class_name=org.apache.cassandra.locator.SimpleSeedProvider, parameters=[{seeds=127.0.0.1}]}]; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=true; storage_port=7000; thrift_framed_transport_size_in_mb=15; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; write_request_timeout_in_ms=2000]
>> INFO  20:34:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
>> INFO  20:34:20 Global memtable on-heap threshold is enabled at 499MB
>> INFO  20:34:20 Global memtable off-heap threshold is enabled at 499MB
>> WARN  20:34:20 Couldn't open /proc/stats
>> INFO  20:34:20 Loading settings from file:/Users/RajT/cassandra-source/cassandra-trunk/conf/cassandra.yaml
>> INFO  20:34:20 Node configuration:[authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; cas_contention_timeout_in_ms=1000; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_period_in_ms=10000; compaction_throughput_mb_per_sec=16; concurrent_counter_writes=32; concurrent_reads=32; concurrent_writes=32; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; cross_node_timeout=false; disk_failure_policy=stop; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; endpoint_snitch=SimpleSnitch; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; incremental_backups=false; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; inter_dc_tcp_nodelay=false; internode_compression=all; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=localhost; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; memtable_allocation_type=heap_buffers; native_transport_port=9042; num_tokens=256; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_validity_in_ms=2000; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_timeout_in_ms=10000; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=localhost; rpc_keepalive=true; rpc_port=9160; rpc_server_type=sync; seed_provider=[{class_name=org.apache.cassandra.locator.SimpleSeedProvider, parameters=[{seeds=127.0.0.1}]}]; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=true; storage_port=7000; thrift_framed_transport_size_in_mb=15; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; write_request_timeout_in_ms=2000]
>> INFO  20:34:20 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.7.0_67
>> INFO  20:34:20 Heap size: 2093809664/2093809664
>> INFO  20:34:20 Code Cache Non-heap memory: init = 2555904(2496K) used = 736640(719K) committed = 2555904(2496K) max = 50331648(49152K)
>> INFO  20:34:20 Par Eden Space Heap memory: init = 429522944(419456K) used = 128876680(125856K) committed = 429522944(419456K) max = 429522944(419456K)
>> INFO  20:34:20 Par Survivor Space Heap memory: init = 53673984(52416K) used = 0(0K) committed = 53673984(52416K) max = 53673984(52416K)
>> INFO  20:34:20 CMS Old Gen Heap memory: init = 1610612736(1572864K) used = 0(0K) committed = 1610612736(1572864K) max = 1610612736(1572864K)
>> INFO  20:34:20 CMS Perm Gen Non-heap memory: init = 21757952(21248K) used = 17579984(17167K) committed = 21757952(21248K) max = 85983232(83968K)
>> INFO  20:34:20 Classpath: ./bin/../conf:./bin/../build/classes/main:./bin/../build/classes/thrift:./bin/../lib/airline-0.6.jar:./bin/../lib/antlr-runtime-3.5.2.jar:./bin/../lib/cassandra-driver-core-2.1.2.jar:./bin/../lib/commons-cli-1.1.jar:./bin/../lib/commons-codec-1.2.jar:./bin/../lib/commons-lang3-3.1.jar:./bin/../lib/commons-math3-3.2.jar:./bin/../lib/compress-lzf-0.8.4.jar:./bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:./bin/../lib/disruptor-3.0.1.jar:./bin/../lib/guava-16.0.jar:./bin/../lib/high-scale-lib-1.0.6.jar:./bin/../lib/jackson-core-asl-1.9.2.jar:./bin/../lib/jackson-mapper-asl-1.9.2.jar:./bin/../lib/jamm-0.2.8.jar:./bin/../lib/javassist-3.18.2-GA.jar:./bin/../lib/javax.inject.jar:./bin/../lib/jbcrypt-0.3m.jar:./bin/../lib/jna-4.0.0.jar:./bin/../lib/json-simple-1.1.jar:./bin/../lib/libthrift-0.9.1.jar:./bin/../lib/log4j-over-slf4j-1.7.2.jar:./bin/../lib/logback-classic-1.1.2.jar:./bin/../lib/logback-core-1.1.2.jar:./bin/../lib/lz4-1.2.0.jar:./bin/../lib/metrics-core-2.2.0.jar:./bin/../lib/netty-all-4.0.23.Final.jar:./bin/../lib/reporter-config-2.1.0.jar:./bin/../lib/sigar-1.6.4.jar:./bin/../lib/slf4j-api-1.7.2.jar:./bin/../lib/snakeyaml-1.11.jar:./bin/../lib/snappy-java-1.0.5.2.jar:./bin/../lib/stream-2.5.2.jar:./bin/../lib/stringtemplate-4.0.2.jar:./bin/../lib/super-csv-2.1.0.jar:./bin/../lib/thrift-server-0.3.7.jar:./bin/../lib/jamm-0.2.8.jar
>> WARN  20:34:20 JNA link failure, one or more native method will be unavailable.
>> INFO  20:34:20 Initializing SIGAR library
>> WARN  20:34:20 Cassandra server running in degraded mode. Is swap disabled? : false,  Address space adequate? : false,  nofile limit adequate? : true, nproc limit adequate? : false
>> INFO  20:34:20 Initializing key cache with capacity of 99 MBs.
>> INFO  20:34:20 Initializing row cache with capacity of 0 MBs
>> INFO  20:34:20 Initializing counter cache with capacity of 49 MBs
>> INFO  20:34:20 Scheduling counter cache save to every 7200 seconds (going to save all keys).
>> INFO  20:34:20 Initializing system.schema_triggers
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/la-1-big (32 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/la-2-big (32 bytes)
>> INFO  20:34:21 Initializing system.compaction_history
>> INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-46-big (250 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-48-big (344 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-47-big (342 bytes)
>> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca-KeyCache-b.db
>> INFO  20:34:21 Initializing system.batchlog
>> INFO  20:34:21 Initializing system.sstable_activity
>> INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-64-big (161 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-62-big (186 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-63-big (160 bytes)
>> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-sstable_activity-5a1ff267ace03f128563cfae6103c65e-KeyCache-b.db
>> INFO  20:34:21 Initializing system.peer_events
>> INFO  20:34:21 Initializing system.compactions_in_progress
>> INFO  20:34:21 Initializing system.hints
>> INFO  20:34:21 Initializing system.schema_keyspaces
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/la-37-big (260 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/la-38-big (135 bytes)
>> INFO  20:34:21 Initializing system.range_xfers
>> INFO  20:34:21 Initializing system.schema_columnfamilies
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/la-38-big (7204 bytes)
>> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697-KeyCache-b.db
>> INFO  20:34:21 Initializing system.schema_columns
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/la-38-big (11230 bytes)
>> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-schema_columns-296e9c049bec3085827dc17d3df2122a-KeyCache-b.db
>> INFO  20:34:21 Initializing system.schema_usertypes
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/la-2-big (32 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/la-1-big (32 bytes)
>> INFO  20:34:21 Initializing system.paxos
>> INFO  20:34:21 Initializing system.IndexInfo
>> INFO  20:34:21 Opening ./bin/../data/data/system/IndexInfo-9f5c6374d48532299a0a5094af9ad1e3/la-1 (67 bytes)
>> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-IndexInfo-9f5c6374d48532299a0a5094af9ad1e3-KeyCache-b.db
>> INFO  20:34:21 Initializing system.schema_functions
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-1-big (350 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-3-big (350 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-2-big (78 bytes)
>> INFO  20:34:21 Initializing system.peers
>> INFO  20:34:21 Opening ./bin/../data/data/system/peers-37f71aca7dc2383ba70672528af04d4f/la-2-big (30 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/peers-37f71aca7dc2383ba70672528af04d4f/la-1-big (30 bytes)
>> INFO  20:34:21 Initializing system.local
>> INFO  20:34:21 Opening ./bin/../data/data/system/local-7ad54392bcdd35a684174e047860b377/la-141-big (5692 bytes)
>> INFO  20:34:21 Opening ./bin/../data/data/system/local-7ad54392bcdd35a684174e047860b377/la-142-big (5263 bytes)
>> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-local-7ad54392bcdd35a684174e047860b377-KeyCache-b.db
>> ERROR 20:34:21 Exception encountered during startup
>> java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>>        at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373) ~[main/:na]
>>        at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643) ~[main/:na]
>>        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257) [main/:na]
>>        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482) [main/:na]
>>        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574) [main/:na]
>> Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>>        at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87) ~[main/:na]
>>        at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53) ~[main/:na]
>>        at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47) ~[main/:na]
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>>        at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81) ~[main/:na]
>>        at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99) ~[main/:na]
>>        at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100) ~[main/:na]
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931) ~[main/:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927) ~[main/:na]
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079) ~[main/:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038) ~[main/:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972) ~[main/:na]
>>        at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942) ~[main/:na]
>>        at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929) ~[main/:na]
>>        at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357) ~[main/:na]
>>        ... 4 common frames omitted
>> java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>>        at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373)
>>        at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643)
>>        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257)
>>        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482)
>>        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574)
>> Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>>        at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87)
>>        at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53)
>>        at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47)
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
>>        at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115)
>>        at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172)
>>        at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155)
>>        at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146)
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89)
>>        at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48)
>>        at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103)
>>        at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81)
>>        at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99)
>>        at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71)
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117)
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100)
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
>>        at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931)
>>        at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927)
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
>>        at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079)
>>        at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038)
>>        at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972)
>>        at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942)
>>        at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929)
>>        at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357)
>>        ... 4 more
>> Exception encountered during startup: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>> ERROR 20:34:21 Exception encountered during startup
>> java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>>        at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373) ~[main/:na]
>>        at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643) ~[main/:na]
>>        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257) [main/:na]
>>        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482) [main/:na]
>>        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574) [main/:na]
>> Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>>        at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87) ~[main/:na]
>>        at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53) ~[main/:na]
>>        at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47) ~[main/:na]
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>>        at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103) ~[main/:na]
>>        at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81) ~[main/:na]
>>        at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99) ~[main/:na]
>>        at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117) ~[main/:na]
>>        at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100) ~[main/:na]
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931) ~[main/:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927) ~[main/:na]
>>        at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>>        at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079) ~[main/:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038) ~[main/:na]
>>        at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972) ~[main/:na]
>>        at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942) ~[main/:na]
>>        at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929) ~[main/:na]
>>        at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357) ~[main/:na]
>>        ... 4 common frames omitted
>> 
> 
> 
> 
> -- 
> Yuki Morishita
> t:yukim (http://twitter.com/yukim)


Re: Latest Code from Trunk - Server is not starting

Posted by Yuki Morishita <mo...@gmail.com>.
Clear your './bin/../data/data' directory, and cassandra will start up fine.

On Tue, Nov 18, 2014 at 2:43 PM, Rajanarayanan Thottuvaikkatumana
<rn...@gmail.com> wrote:
> I have taken the latest code from trunk, compiled (I have some changes in some of the local files also). But when I start the Cassandra server, I am getting exceptions. The exceptions are not seeming to be from the classed where I changed OR has any relationship with the ones that are showing error. Any idea? Anybody else is getting same error?
>
> Rajanarayanans-MacBook-Pro:cassandra-trunk RajT$ ./bin/cassandra -f
> objc[4284]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/bin/java and /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/lib/libinstrument.dylib. One of the two will be used. Which one is undefined.
> CompilerOracle: inline org/apache/cassandra/db/AbstractNativeCell.compareTo (Lorg/apache/cassandra/db/composites/Composite;)I
> CompilerOracle: inline org/apache/cassandra/db/composites/AbstractSimpleCellNameType.compareUnsigned (Lorg/apache/cassandra/db/composites/Composite;Lorg/apache/cassandra/db/composites/Composite;)I
> CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare (Ljava/nio/ByteBuffer;[B)I
> CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare ([BLjava/nio/ByteBuffer;)I
> CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compareUnsigned (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
> CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/lang/Object;JI)I
> CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/nio/ByteBuffer;)I
> CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
> INFO  20:34:19 Hostname: Rajanarayanans-MacBook-Pro.local
> INFO  20:34:19 Loading settings from file:/Users/RajT/cassandra-source/cassandra-trunk/conf/cassandra.yaml
> INFO  20:34:19 Node configuration:[authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; cas_contention_timeout_in_ms=1000; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_period_in_ms=10000; compaction_throughput_mb_per_sec=16; concurrent_counter_writes=32; concurrent_reads=32; concurrent_writes=32; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; cross_node_timeout=false; disk_failure_policy=stop; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; endpoint_snitch=SimpleSnitch; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; incremental_backups=false; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; inter_dc_tcp_nodelay=false; internode_compression=all; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=localhost; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; memtable_allocation_type=heap_buffers; native_transport_port=9042; num_tokens=256; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_validity_in_ms=2000; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_timeout_in_ms=10000; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=localhost; rpc_keepalive=true; rpc_port=9160; rpc_server_type=sync; seed_provider=[{class_name=org.apache.cassandra.locator.SimpleSeedProvider, parameters=[{seeds=127.0.0.1}]}]; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=true; storage_port=7000; thrift_framed_transport_size_in_mb=15; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; write_request_timeout_in_ms=2000]
> INFO  20:34:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
> INFO  20:34:20 Global memtable on-heap threshold is enabled at 499MB
> INFO  20:34:20 Global memtable off-heap threshold is enabled at 499MB
> WARN  20:34:20 Couldn't open /proc/stats
> INFO  20:34:20 Loading settings from file:/Users/RajT/cassandra-source/cassandra-trunk/conf/cassandra.yaml
> INFO  20:34:20 Node configuration:[authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; cas_contention_timeout_in_ms=1000; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_period_in_ms=10000; compaction_throughput_mb_per_sec=16; concurrent_counter_writes=32; concurrent_reads=32; concurrent_writes=32; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; cross_node_timeout=false; disk_failure_policy=stop; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; endpoint_snitch=SimpleSnitch; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; incremental_backups=false; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; inter_dc_tcp_nodelay=false; internode_compression=all; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=localhost; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; memtable_allocation_type=heap_buffers; native_transport_port=9042; num_tokens=256; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_validity_in_ms=2000; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_timeout_in_ms=10000; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=localhost; rpc_keepalive=true; rpc_port=9160; rpc_server_type=sync; seed_provider=[{class_name=org.apache.cassandra.locator.SimpleSeedProvider, parameters=[{seeds=127.0.0.1}]}]; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=true; storage_port=7000; thrift_framed_transport_size_in_mb=15; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; write_request_timeout_in_ms=2000]
> INFO  20:34:20 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.7.0_67
> INFO  20:34:20 Heap size: 2093809664/2093809664
> INFO  20:34:20 Code Cache Non-heap memory: init = 2555904(2496K) used = 736640(719K) committed = 2555904(2496K) max = 50331648(49152K)
> INFO  20:34:20 Par Eden Space Heap memory: init = 429522944(419456K) used = 128876680(125856K) committed = 429522944(419456K) max = 429522944(419456K)
> INFO  20:34:20 Par Survivor Space Heap memory: init = 53673984(52416K) used = 0(0K) committed = 53673984(52416K) max = 53673984(52416K)
> INFO  20:34:20 CMS Old Gen Heap memory: init = 1610612736(1572864K) used = 0(0K) committed = 1610612736(1572864K) max = 1610612736(1572864K)
> INFO  20:34:20 CMS Perm Gen Non-heap memory: init = 21757952(21248K) used = 17579984(17167K) committed = 21757952(21248K) max = 85983232(83968K)
> INFO  20:34:20 Classpath: ./bin/../conf:./bin/../build/classes/main:./bin/../build/classes/thrift:./bin/../lib/airline-0.6.jar:./bin/../lib/antlr-runtime-3.5.2.jar:./bin/../lib/cassandra-driver-core-2.1.2.jar:./bin/../lib/commons-cli-1.1.jar:./bin/../lib/commons-codec-1.2.jar:./bin/../lib/commons-lang3-3.1.jar:./bin/../lib/commons-math3-3.2.jar:./bin/../lib/compress-lzf-0.8.4.jar:./bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:./bin/../lib/disruptor-3.0.1.jar:./bin/../lib/guava-16.0.jar:./bin/../lib/high-scale-lib-1.0.6.jar:./bin/../lib/jackson-core-asl-1.9.2.jar:./bin/../lib/jackson-mapper-asl-1.9.2.jar:./bin/../lib/jamm-0.2.8.jar:./bin/../lib/javassist-3.18.2-GA.jar:./bin/../lib/javax.inject.jar:./bin/../lib/jbcrypt-0.3m.jar:./bin/../lib/jna-4.0.0.jar:./bin/../lib/json-simple-1.1.jar:./bin/../lib/libthrift-0.9.1.jar:./bin/../lib/log4j-over-slf4j-1.7.2.jar:./bin/../lib/logback-classic-1.1.2.jar:./bin/../lib/logback-core-1.1.2.jar:./bin/../lib/lz4-1.2.0.jar:./bin/../lib/metrics-core-2.2.0.jar:./bin/../lib/netty-all-4.0.23.Final.jar:./bin/../lib/reporter-config-2.1.0.jar:./bin/../lib/sigar-1.6.4.jar:./bin/../lib/slf4j-api-1.7.2.jar:./bin/../lib/snakeyaml-1.11.jar:./bin/../lib/snappy-java-1.0.5.2.jar:./bin/../lib/stream-2.5.2.jar:./bin/../lib/stringtemplate-4.0.2.jar:./bin/../lib/super-csv-2.1.0.jar:./bin/../lib/thrift-server-0.3.7.jar:./bin/../lib/jamm-0.2.8.jar
> WARN  20:34:20 JNA link failure, one or more native method will be unavailable.
> INFO  20:34:20 Initializing SIGAR library
> WARN  20:34:20 Cassandra server running in degraded mode. Is swap disabled? : false,  Address space adequate? : false,  nofile limit adequate? : true, nproc limit adequate? : false
> INFO  20:34:20 Initializing key cache with capacity of 99 MBs.
> INFO  20:34:20 Initializing row cache with capacity of 0 MBs
> INFO  20:34:20 Initializing counter cache with capacity of 49 MBs
> INFO  20:34:20 Scheduling counter cache save to every 7200 seconds (going to save all keys).
> INFO  20:34:20 Initializing system.schema_triggers
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/la-1-big (32 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/la-2-big (32 bytes)
> INFO  20:34:21 Initializing system.compaction_history
> INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-46-big (250 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-48-big (344 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-47-big (342 bytes)
> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca-KeyCache-b.db
> INFO  20:34:21 Initializing system.batchlog
> INFO  20:34:21 Initializing system.sstable_activity
> INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-64-big (161 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-62-big (186 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-63-big (160 bytes)
> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-sstable_activity-5a1ff267ace03f128563cfae6103c65e-KeyCache-b.db
> INFO  20:34:21 Initializing system.peer_events
> INFO  20:34:21 Initializing system.compactions_in_progress
> INFO  20:34:21 Initializing system.hints
> INFO  20:34:21 Initializing system.schema_keyspaces
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/la-37-big (260 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/la-38-big (135 bytes)
> INFO  20:34:21 Initializing system.range_xfers
> INFO  20:34:21 Initializing system.schema_columnfamilies
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/la-38-big (7204 bytes)
> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697-KeyCache-b.db
> INFO  20:34:21 Initializing system.schema_columns
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/la-38-big (11230 bytes)
> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-schema_columns-296e9c049bec3085827dc17d3df2122a-KeyCache-b.db
> INFO  20:34:21 Initializing system.schema_usertypes
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/la-2-big (32 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/la-1-big (32 bytes)
> INFO  20:34:21 Initializing system.paxos
> INFO  20:34:21 Initializing system.IndexInfo
> INFO  20:34:21 Opening ./bin/../data/data/system/IndexInfo-9f5c6374d48532299a0a5094af9ad1e3/la-1 (67 bytes)
> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-IndexInfo-9f5c6374d48532299a0a5094af9ad1e3-KeyCache-b.db
> INFO  20:34:21 Initializing system.schema_functions
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-1-big (350 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-3-big (350 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-2-big (78 bytes)
> INFO  20:34:21 Initializing system.peers
> INFO  20:34:21 Opening ./bin/../data/data/system/peers-37f71aca7dc2383ba70672528af04d4f/la-2-big (30 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/peers-37f71aca7dc2383ba70672528af04d4f/la-1-big (30 bytes)
> INFO  20:34:21 Initializing system.local
> INFO  20:34:21 Opening ./bin/../data/data/system/local-7ad54392bcdd35a684174e047860b377/la-141-big (5692 bytes)
> INFO  20:34:21 Opening ./bin/../data/data/system/local-7ad54392bcdd35a684174e047860b377/la-142-big (5263 bytes)
> INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-local-7ad54392bcdd35a684174e047860b377-KeyCache-b.db
> ERROR 20:34:21 Exception encountered during startup
> java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>         at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373) ~[main/:na]
>         at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643) ~[main/:na]
>         at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257) [main/:na]
>         at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482) [main/:na]
>         at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574) [main/:na]
> Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>         at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87) ~[main/:na]
>         at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53) ~[main/:na]
>         at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47) ~[main/:na]
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>         at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81) ~[main/:na]
>         at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99) ~[main/:na]
>         at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100) ~[main/:na]
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>         at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931) ~[main/:na]
>         at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927) ~[main/:na]
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>         at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079) ~[main/:na]
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038) ~[main/:na]
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972) ~[main/:na]
>         at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942) ~[main/:na]
>         at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929) ~[main/:na]
>         at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357) ~[main/:na]
>         ... 4 common frames omitted
> java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>         at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373)
>         at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643)
>         at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257)
>         at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482)
>         at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574)
> Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>         at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87)
>         at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53)
>         at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47)
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
>         at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115)
>         at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172)
>         at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155)
>         at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146)
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89)
>         at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48)
>         at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103)
>         at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81)
>         at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99)
>         at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71)
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117)
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100)
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
>         at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931)
>         at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927)
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
>         at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079)
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038)
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972)
>         at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942)
>         at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929)
>         at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357)
>         ... 4 more
> Exception encountered during startup: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
> ERROR 20:34:21 Exception encountered during startup
> java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>         at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373) ~[main/:na]
>         at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643) ~[main/:na]
>         at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257) [main/:na]
>         at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482) [main/:na]
>         at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574) [main/:na]
> Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
>         at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87) ~[main/:na]
>         at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53) ~[main/:na]
>         at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47) ~[main/:na]
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>         at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103) ~[main/:na]
>         at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81) ~[main/:na]
>         at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99) ~[main/:na]
>         at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117) ~[main/:na]
>         at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100) ~[main/:na]
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>         at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931) ~[main/:na]
>         at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927) ~[main/:na]
>         at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
>         at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
>         at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079) ~[main/:na]
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038) ~[main/:na]
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972) ~[main/:na]
>         at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942) ~[main/:na]
>         at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929) ~[main/:na]
>         at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357) ~[main/:na]
>         ... 4 common frames omitted
>



-- 
Yuki Morishita
 t:yukim (http://twitter.com/yukim)

Latest Code from Trunk - Server is not starting

Posted by Rajanarayanan Thottuvaikkatumana <rn...@gmail.com>.
I have taken the latest code from trunk, compiled (I have some changes in some of the local files also). But when I start the Cassandra server, I am getting exceptions. The exceptions are not seeming to be from the classed where I changed OR has any relationship with the ones that are showing error. Any idea? Anybody else is getting same error? 

Rajanarayanans-MacBook-Pro:cassandra-trunk RajT$ ./bin/cassandra -f
objc[4284]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/bin/java and /Library/Java/JavaVirtualMachines/jdk1.7.0_67.jdk/Contents/Home/jre/lib/libinstrument.dylib. One of the two will be used. Which one is undefined.
CompilerOracle: inline org/apache/cassandra/db/AbstractNativeCell.compareTo (Lorg/apache/cassandra/db/composites/Composite;)I
CompilerOracle: inline org/apache/cassandra/db/composites/AbstractSimpleCellNameType.compareUnsigned (Lorg/apache/cassandra/db/composites/Composite;Lorg/apache/cassandra/db/composites/Composite;)I
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare (Ljava/nio/ByteBuffer;[B)I
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare ([BLjava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compareUnsigned (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/lang/Object;JI)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
INFO  20:34:19 Hostname: Rajanarayanans-MacBook-Pro.local
INFO  20:34:19 Loading settings from file:/Users/RajT/cassandra-source/cassandra-trunk/conf/cassandra.yaml
INFO  20:34:19 Node configuration:[authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; cas_contention_timeout_in_ms=1000; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_period_in_ms=10000; compaction_throughput_mb_per_sec=16; concurrent_counter_writes=32; concurrent_reads=32; concurrent_writes=32; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; cross_node_timeout=false; disk_failure_policy=stop; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; endpoint_snitch=SimpleSnitch; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; incremental_backups=false; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; inter_dc_tcp_nodelay=false; internode_compression=all; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=localhost; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; memtable_allocation_type=heap_buffers; native_transport_port=9042; num_tokens=256; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_validity_in_ms=2000; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_timeout_in_ms=10000; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=localhost; rpc_keepalive=true; rpc_port=9160; rpc_server_type=sync; seed_provider=[{class_name=org.apache.cassandra.locator.SimpleSeedProvider, parameters=[{seeds=127.0.0.1}]}]; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=true; storage_port=7000; thrift_framed_transport_size_in_mb=15; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; write_request_timeout_in_ms=2000]
INFO  20:34:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO  20:34:20 Global memtable on-heap threshold is enabled at 499MB
INFO  20:34:20 Global memtable off-heap threshold is enabled at 499MB
WARN  20:34:20 Couldn't open /proc/stats
INFO  20:34:20 Loading settings from file:/Users/RajT/cassandra-source/cassandra-trunk/conf/cassandra.yaml
INFO  20:34:20 Node configuration:[authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; cas_contention_timeout_in_ms=1000; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_period_in_ms=10000; compaction_throughput_mb_per_sec=16; concurrent_counter_writes=32; concurrent_reads=32; concurrent_writes=32; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; cross_node_timeout=false; disk_failure_policy=stop; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; endpoint_snitch=SimpleSnitch; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; incremental_backups=false; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; inter_dc_tcp_nodelay=false; internode_compression=all; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=localhost; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; memtable_allocation_type=heap_buffers; native_transport_port=9042; num_tokens=256; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_validity_in_ms=2000; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_timeout_in_ms=10000; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=localhost; rpc_keepalive=true; rpc_port=9160; rpc_server_type=sync; seed_provider=[{class_name=org.apache.cassandra.locator.SimpleSeedProvider, parameters=[{seeds=127.0.0.1}]}]; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=true; storage_port=7000; thrift_framed_transport_size_in_mb=15; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; write_request_timeout_in_ms=2000]
INFO  20:34:20 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.7.0_67
INFO  20:34:20 Heap size: 2093809664/2093809664
INFO  20:34:20 Code Cache Non-heap memory: init = 2555904(2496K) used = 736640(719K) committed = 2555904(2496K) max = 50331648(49152K)
INFO  20:34:20 Par Eden Space Heap memory: init = 429522944(419456K) used = 128876680(125856K) committed = 429522944(419456K) max = 429522944(419456K)
INFO  20:34:20 Par Survivor Space Heap memory: init = 53673984(52416K) used = 0(0K) committed = 53673984(52416K) max = 53673984(52416K)
INFO  20:34:20 CMS Old Gen Heap memory: init = 1610612736(1572864K) used = 0(0K) committed = 1610612736(1572864K) max = 1610612736(1572864K)
INFO  20:34:20 CMS Perm Gen Non-heap memory: init = 21757952(21248K) used = 17579984(17167K) committed = 21757952(21248K) max = 85983232(83968K)
INFO  20:34:20 Classpath: ./bin/../conf:./bin/../build/classes/main:./bin/../build/classes/thrift:./bin/../lib/airline-0.6.jar:./bin/../lib/antlr-runtime-3.5.2.jar:./bin/../lib/cassandra-driver-core-2.1.2.jar:./bin/../lib/commons-cli-1.1.jar:./bin/../lib/commons-codec-1.2.jar:./bin/../lib/commons-lang3-3.1.jar:./bin/../lib/commons-math3-3.2.jar:./bin/../lib/compress-lzf-0.8.4.jar:./bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:./bin/../lib/disruptor-3.0.1.jar:./bin/../lib/guava-16.0.jar:./bin/../lib/high-scale-lib-1.0.6.jar:./bin/../lib/jackson-core-asl-1.9.2.jar:./bin/../lib/jackson-mapper-asl-1.9.2.jar:./bin/../lib/jamm-0.2.8.jar:./bin/../lib/javassist-3.18.2-GA.jar:./bin/../lib/javax.inject.jar:./bin/../lib/jbcrypt-0.3m.jar:./bin/../lib/jna-4.0.0.jar:./bin/../lib/json-simple-1.1.jar:./bin/../lib/libthrift-0.9.1.jar:./bin/../lib/log4j-over-slf4j-1.7.2.jar:./bin/../lib/logback-classic-1.1.2.jar:./bin/../lib/logback-core-1.1.2.jar:./bin/../lib/lz4-1.2.0.jar:./bin/../lib/metrics-core-2.2.0.jar:./bin/../lib/netty-all-4.0.23.Final.jar:./bin/../lib/reporter-config-2.1.0.jar:./bin/../lib/sigar-1.6.4.jar:./bin/../lib/slf4j-api-1.7.2.jar:./bin/../lib/snakeyaml-1.11.jar:./bin/../lib/snappy-java-1.0.5.2.jar:./bin/../lib/stream-2.5.2.jar:./bin/../lib/stringtemplate-4.0.2.jar:./bin/../lib/super-csv-2.1.0.jar:./bin/../lib/thrift-server-0.3.7.jar:./bin/../lib/jamm-0.2.8.jar
WARN  20:34:20 JNA link failure, one or more native method will be unavailable.
INFO  20:34:20 Initializing SIGAR library
WARN  20:34:20 Cassandra server running in degraded mode. Is swap disabled? : false,  Address space adequate? : false,  nofile limit adequate? : true, nproc limit adequate? : false 
INFO  20:34:20 Initializing key cache with capacity of 99 MBs.
INFO  20:34:20 Initializing row cache with capacity of 0 MBs
INFO  20:34:20 Initializing counter cache with capacity of 49 MBs
INFO  20:34:20 Scheduling counter cache save to every 7200 seconds (going to save all keys).
INFO  20:34:20 Initializing system.schema_triggers
INFO  20:34:21 Opening ./bin/../data/data/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/la-1-big (32 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/la-2-big (32 bytes)
INFO  20:34:21 Initializing system.compaction_history
INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-46-big (250 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-48-big (344 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/la-47-big (342 bytes)
INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca-KeyCache-b.db
INFO  20:34:21 Initializing system.batchlog
INFO  20:34:21 Initializing system.sstable_activity
INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-64-big (161 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-62-big (186 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/la-63-big (160 bytes)
INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-sstable_activity-5a1ff267ace03f128563cfae6103c65e-KeyCache-b.db
INFO  20:34:21 Initializing system.peer_events
INFO  20:34:21 Initializing system.compactions_in_progress
INFO  20:34:21 Initializing system.hints
INFO  20:34:21 Initializing system.schema_keyspaces
INFO  20:34:21 Opening ./bin/../data/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/la-37-big (260 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/la-38-big (135 bytes)
INFO  20:34:21 Initializing system.range_xfers
INFO  20:34:21 Initializing system.schema_columnfamilies
INFO  20:34:21 Opening ./bin/../data/data/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/la-38-big (7204 bytes)
INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697-KeyCache-b.db
INFO  20:34:21 Initializing system.schema_columns
INFO  20:34:21 Opening ./bin/../data/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/la-38-big (11230 bytes)
INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-schema_columns-296e9c049bec3085827dc17d3df2122a-KeyCache-b.db
INFO  20:34:21 Initializing system.schema_usertypes
INFO  20:34:21 Opening ./bin/../data/data/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/la-2-big (32 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/la-1-big (32 bytes)
INFO  20:34:21 Initializing system.paxos
INFO  20:34:21 Initializing system.IndexInfo
INFO  20:34:21 Opening ./bin/../data/data/system/IndexInfo-9f5c6374d48532299a0a5094af9ad1e3/la-1 (67 bytes)
INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-IndexInfo-9f5c6374d48532299a0a5094af9ad1e3-KeyCache-b.db
INFO  20:34:21 Initializing system.schema_functions
INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-1-big (350 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-3-big (350 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/schema_functions-d1b675fe2b503ca48e49c0f81989dcad/la-2-big (78 bytes)
INFO  20:34:21 Initializing system.peers
INFO  20:34:21 Opening ./bin/../data/data/system/peers-37f71aca7dc2383ba70672528af04d4f/la-2-big (30 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/peers-37f71aca7dc2383ba70672528af04d4f/la-1-big (30 bytes)
INFO  20:34:21 Initializing system.local
INFO  20:34:21 Opening ./bin/../data/data/system/local-7ad54392bcdd35a684174e047860b377/la-141-big (5692 bytes)
INFO  20:34:21 Opening ./bin/../data/data/system/local-7ad54392bcdd35a684174e047860b377/la-142-big (5263 bytes)
INFO  20:34:21 reading saved cache ./bin/../data/saved_caches/system-local-7ad54392bcdd35a684174e047860b377-KeyCache-b.db
ERROR 20:34:21 Exception encountered during startup
java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373) ~[main/:na]
	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643) ~[main/:na]
	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257) [main/:na]
	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482) [main/:na]
	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574) [main/:na]
Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
	at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87) ~[main/:na]
	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53) ~[main/:na]
	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47) ~[main/:na]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
	at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81) ~[main/:na]
	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99) ~[main/:na]
	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100) ~[main/:na]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931) ~[main/:na]
	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927) ~[main/:na]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
	at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079) ~[main/:na]
	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038) ~[main/:na]
	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972) ~[main/:na]
	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942) ~[main/:na]
	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929) ~[main/:na]
	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357) ~[main/:na]
	... 4 common frames omitted
java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373)
	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643)
	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257)
	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482)
	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574)
Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
	at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87)
	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53)
	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47)
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
	at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115)
	at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172)
	at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155)
	at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146)
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89)
	at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48)
	at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103)
	at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81)
	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99)
	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71)
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117)
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100)
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931)
	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927)
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
	at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079)
	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038)
	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972)
	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942)
	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929)
	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357)
	... 4 more
Exception encountered during startup: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
ERROR 20:34:21 Exception encountered during startup
java.lang.RuntimeException: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:373) ~[main/:na]
	at org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescriptor.java:643) ~[main/:na]
	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:257) [main/:na]
	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:482) [main/:na]
	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:574) [main/:na]
Caused by: java.lang.ClassCastException: org.apache.cassandra.db.composites.CompoundComposite cannot be cast to org.apache.cassandra.db.composites.CellName
	at org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:87) ~[main/:na]
	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:53) ~[main/:na]
	at org.apache.cassandra.db.AbstractCell$1.computeNext(AbstractCell.java:47) ~[main/:na]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
	at org.apache.cassandra.io.sstable.SSTableIdentityIterator.hasNext(SSTableIdentityIterator.java:115) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:172) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:155) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:146) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.java:89) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java:48) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:103) ~[main/:na]
	at org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:81) ~[main/:na]
	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:99) ~[main/:na]
	at org.apache.cassandra.db.RowIteratorFactory$2.getReduced(RowIteratorFactory.java:71) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:117) ~[main/:na]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:100) ~[main/:na]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1931) ~[main/:na]
	at org.apache.cassandra.db.ColumnFamilyStore$8.computeNext(ColumnFamilyStore.java:1927) ~[main/:na]
	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) ~[guava-16.0.jar:na]
	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) ~[guava-16.0.jar:na]
	at org.apache.cassandra.db.ColumnFamilyStore.filter(ColumnFamilyStore.java:2079) ~[main/:na]
	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2038) ~[main/:na]
	at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1972) ~[main/:na]
	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:942) ~[main/:na]
	at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:929) ~[main/:na]
	at org.apache.cassandra.config.Schema.updateVersion(Schema.java:357) ~[main/:na]
	... 4 common frames omitted


Re: Reads requiring response from both servers.

Posted by Jacob Rhoden <ja...@me.com>.
> On 19 Nov 2014, at 4:44 am, Tyler Hobbs <ty...@datastax.com> wrote:
> 
>> On Tue, Nov 18, 2014 at 4:46 AM, Jacob Rhoden <ja...@me.com> wrote:
>> 
>> I was going to report a bug, but first figured I should check its not
>> “working as expected”. Is it just me or is it wrong that the following
>> query needs to talk to both nodes to build a response to this query?
> 
> It seems to be working as expected to me, unless I'm missing something.

If there are two nodes and RF=2, a simple data lookup on a very small table will only need to talk to one node if you put in a (fake/pointless) partition key, but two nodes if you don't. The impact is that if you want 1ms query time on a 50 row table you must use a partition key, otherwise you get 250ms query time.


>> Why is this a bug? It seems that this behaviour of needing a response to
>> both nodes only exists if you don’t query with a clustering key, or a key
>> when RF=2. However you can change this behaviour, by, for example, changing
>> the table from “primary key (uuid)” to “primary key ((a), uuid)” where the
>> value of a always equals “a” ( so you can query 'where a=“a”’), at which
>> point, cassandra decides it only needs results from one node.
> 
> Can you clarify what you mean?  It sounds like you're saying "if I specify
> a partition key, it only needs to query one node", which is also expected
> behavior (assuming a consistency level of ONE).

It's my understanding from the documentation that consistency level one (which I am using) is about write consistency, not read consistency. Actually if I change it in cqlsh, cqlsh refuses to run the query.

> By the way, this type of question is better suited for the user mailing
> list than the dev

Ok thanks, I'll file it as a bug request with more details.

Thanks!

Re: Reads requiring response from both servers.

Posted by Tyler Hobbs <ty...@datastax.com>.
On Tue, Nov 18, 2014 at 4:46 AM, Jacob Rhoden <ja...@me.com> wrote:

> I was going to report a bug, but first figured I should check its not
> “working as expected”. Is it just me or is it wrong that the following
> query needs to talk to both nodes to build a response to this query?
>

It seems to be working as expected to me, unless I'm missing something.


>
>
> Why is this a bug? It seems that this behaviour of needing a response to
> both nodes only exists if you don’t query with a clustering key, or a key
> when RF=2. However you can change this behaviour, by, for example, changing
> the table from “primary key (uuid)” to “primary key ((a), uuid)” where the
> value of a always equals “a” ( so you can query 'where a=“a”’), at which
> point, cassandra decides it only needs results from one node.
>

Can you clarify what you mean?  It sounds like you're saying "if I specify
a partition key, it only needs to query one node", which is also expected
behavior (assuming a consistency level of ONE).

By the way, this type of question is better suited for the user mailing
list than the dev mailing list.

-- 
Tyler Hobbs
DataStax <http://datastax.com/>