You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Ran Tavory <ra...@gmail.com> on 2010/05/31 13:04:38 UTC

HintedHandoffEnabled

In 0.6.2 I disabled hinted handoff, however tpstats and cfstats report seems
odd.

On all servers in the cluster I have:

 <HintedHandoffEnabled>false</HintedHandoffEnabled>

tpstats reports 5 completed handoffs.

$ nodetool -h cass25 -p 9004 tpstats
Pool Name                    Active   Pending      Completed
FILEUTILS-DELETE-POOL             0         0              2
STREAM-STAGE                      0         0              0
RESPONSE-STAGE                    0         0        5903099
ROW-READ-STAGE                    0         0         669093
LB-OPERATIONS                     0         0              0
MESSAGE-DESERIALIZER-POOL         1         0        6595504
GMFD                              0         0          35947
LB-TARGET                         0         0              0
CONSISTENCY-MANAGER               0         0         669095
ROW-MUTATION-STAGE                0         0         644360
MESSAGE-STREAMING-POOL            0         0              0
LOAD-BALANCER-STAGE               0         0              0
FLUSH-SORTER-POOL                 0         0              0
MEMTABLE-POST-FLUSHER             0         0              7
FLUSH-WRITER-POOL                 0         0              7
AE-SERVICE-STAGE                  0         0              1
HINTED-HANDOFF-POOL               0         0              5

In data/system/* there are only LocationInfo files, so looks like hinted
handoff is indeed disabled and cfstats does indicate there are 0 bytes,
however it also indicates of 32 reads which I didn't expect (cluster has
been up for a few hours).

$ nodetool -h cass25 -p 9004 tpstats
...
                Column Family: HintsColumnFamily
                SSTable count: 0
                Space used (live): 0
                Space used (total): 0
                Memtable Columns Count: 0
                Memtable Data Size: 0
                Memtable Switch Count: 0
                Read Count: 32
                Read Latency: 0.062 ms.
                Write Count: 0
                Write Latency: NaN ms.
                Pending Tasks: 0
                Key cache capacity: 1
                Key cache size: 0
                Key cache hit rate: NaN
                Row cache: disabled
                Compacted row minimum size: 0
                Compacted row maximum size: 0
                Compacted row mean size: 0

Any idea why is this happening?

Re: HintedHandoffEnabled

Posted by Jonathan Ellis <jb...@gmail.com>.
Ah... no, that's just its "is there anything to deliver" check.
Basically a no-op if there are no data files left.

On Mon, May 31, 2010 at 2:05 PM, Ran Tavory <ra...@gmail.com> wrote:
> I deleted all files in the system dir, including hints before starting the
> servers.
> It's not a big deal. but can it be something else?
>
> On Mon, May 31, 2010 at 9:53 PM, Jonathan Ellis <jb...@gmail.com> wrote:
>>
>> disabling hinted handoff will prevent creation of new hints, but it
>> will continue to attempt to deliver existing ones unless you manually
>> delete the hint files in the system/ dir.
>>
>> On Mon, May 31, 2010 at 6:04 AM, Ran Tavory <ra...@gmail.com> wrote:
>> > In 0.6.2 I disabled hinted handoff, however tpstats and cfstats report
>> > seems
>> > odd.
>> > On all servers in the cluster I have:
>> >  <HintedHandoffEnabled>false</HintedHandoffEnabled>
>> > tpstats reports 5 completed handoffs.
>> > $ nodetool -h cass25 -p 9004 tpstats
>> > Pool Name                    Active   Pending      Completed
>> > FILEUTILS-DELETE-POOL             0         0              2
>> > STREAM-STAGE                      0         0              0
>> > RESPONSE-STAGE                    0         0        5903099
>> > ROW-READ-STAGE                    0         0         669093
>> > LB-OPERATIONS                     0         0              0
>> > MESSAGE-DESERIALIZER-POOL         1         0        6595504
>> > GMFD                              0         0          35947
>> > LB-TARGET                         0         0              0
>> > CONSISTENCY-MANAGER               0         0         669095
>> > ROW-MUTATION-STAGE                0         0         644360
>> > MESSAGE-STREAMING-POOL            0         0              0
>> > LOAD-BALANCER-STAGE               0         0              0
>> > FLUSH-SORTER-POOL                 0         0              0
>> > MEMTABLE-POST-FLUSHER             0         0              7
>> > FLUSH-WRITER-POOL                 0         0              7
>> > AE-SERVICE-STAGE                  0         0              1
>> > HINTED-HANDOFF-POOL               0         0              5
>> > In data/system/* there are only LocationInfo files, so looks like hinted
>> > handoff is indeed disabled and cfstats does indicate there are 0 bytes,
>> > however it also indicates of 32 reads which I didn't expect (cluster has
>> > been up for a few hours).
>> > $ nodetool -h cass25 -p 9004 tpstats
>> > ...
>> >                 Column Family: HintsColumnFamily
>> >                 SSTable count: 0
>> >                 Space used (live): 0
>> >                 Space used (total): 0
>> >                 Memtable Columns Count: 0
>> >                 Memtable Data Size: 0
>> >                 Memtable Switch Count: 0
>> >                 Read Count: 32
>> >                 Read Latency: 0.062 ms.
>> >                 Write Count: 0
>> >                 Write Latency: NaN ms.
>> >                 Pending Tasks: 0
>> >                 Key cache capacity: 1
>> >                 Key cache size: 0
>> >                 Key cache hit rate: NaN
>> >                 Row cache: disabled
>> >                 Compacted row minimum size: 0
>> >                 Compacted row maximum size: 0
>> >                 Compacted row mean size: 0
>> > Any idea why is this happening?
>>
>>
>>
>> --
>> Jonathan Ellis
>> Project Chair, Apache Cassandra
>> co-founder of Riptano, the source for professional Cassandra support
>> http://riptano.com
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com

Re: HintedHandoffEnabled

Posted by Ran Tavory <ra...@gmail.com>.
I deleted all files in the system dir, including hints before starting the
servers.
It's not a big deal. but can it be something else?

On Mon, May 31, 2010 at 9:53 PM, Jonathan Ellis <jb...@gmail.com> wrote:

> disabling hinted handoff will prevent creation of new hints, but it
> will continue to attempt to deliver existing ones unless you manually
> delete the hint files in the system/ dir.
>
> On Mon, May 31, 2010 at 6:04 AM, Ran Tavory <ra...@gmail.com> wrote:
> > In 0.6.2 I disabled hinted handoff, however tpstats and cfstats report
> seems
> > odd.
> > On all servers in the cluster I have:
> >  <HintedHandoffEnabled>false</HintedHandoffEnabled>
> > tpstats reports 5 completed handoffs.
> > $ nodetool -h cass25 -p 9004 tpstats
> > Pool Name                    Active   Pending      Completed
> > FILEUTILS-DELETE-POOL             0         0              2
> > STREAM-STAGE                      0         0              0
> > RESPONSE-STAGE                    0         0        5903099
> > ROW-READ-STAGE                    0         0         669093
> > LB-OPERATIONS                     0         0              0
> > MESSAGE-DESERIALIZER-POOL         1         0        6595504
> > GMFD                              0         0          35947
> > LB-TARGET                         0         0              0
> > CONSISTENCY-MANAGER               0         0         669095
> > ROW-MUTATION-STAGE                0         0         644360
> > MESSAGE-STREAMING-POOL            0         0              0
> > LOAD-BALANCER-STAGE               0         0              0
> > FLUSH-SORTER-POOL                 0         0              0
> > MEMTABLE-POST-FLUSHER             0         0              7
> > FLUSH-WRITER-POOL                 0         0              7
> > AE-SERVICE-STAGE                  0         0              1
> > HINTED-HANDOFF-POOL               0         0              5
> > In data/system/* there are only LocationInfo files, so looks like hinted
> > handoff is indeed disabled and cfstats does indicate there are 0 bytes,
> > however it also indicates of 32 reads which I didn't expect (cluster has
> > been up for a few hours).
> > $ nodetool -h cass25 -p 9004 tpstats
> > ...
> >                 Column Family: HintsColumnFamily
> >                 SSTable count: 0
> >                 Space used (live): 0
> >                 Space used (total): 0
> >                 Memtable Columns Count: 0
> >                 Memtable Data Size: 0
> >                 Memtable Switch Count: 0
> >                 Read Count: 32
> >                 Read Latency: 0.062 ms.
> >                 Write Count: 0
> >                 Write Latency: NaN ms.
> >                 Pending Tasks: 0
> >                 Key cache capacity: 1
> >                 Key cache size: 0
> >                 Key cache hit rate: NaN
> >                 Row cache: disabled
> >                 Compacted row minimum size: 0
> >                 Compacted row maximum size: 0
> >                 Compacted row mean size: 0
> > Any idea why is this happening?
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>

Re: HintedHandoffEnabled

Posted by Jonathan Ellis <jb...@gmail.com>.
disabling hinted handoff will prevent creation of new hints, but it
will continue to attempt to deliver existing ones unless you manually
delete the hint files in the system/ dir.

On Mon, May 31, 2010 at 6:04 AM, Ran Tavory <ra...@gmail.com> wrote:
> In 0.6.2 I disabled hinted handoff, however tpstats and cfstats report seems
> odd.
> On all servers in the cluster I have:
>  <HintedHandoffEnabled>false</HintedHandoffEnabled>
> tpstats reports 5 completed handoffs.
> $ nodetool -h cass25 -p 9004 tpstats
> Pool Name                    Active   Pending      Completed
> FILEUTILS-DELETE-POOL             0         0              2
> STREAM-STAGE                      0         0              0
> RESPONSE-STAGE                    0         0        5903099
> ROW-READ-STAGE                    0         0         669093
> LB-OPERATIONS                     0         0              0
> MESSAGE-DESERIALIZER-POOL         1         0        6595504
> GMFD                              0         0          35947
> LB-TARGET                         0         0              0
> CONSISTENCY-MANAGER               0         0         669095
> ROW-MUTATION-STAGE                0         0         644360
> MESSAGE-STREAMING-POOL            0         0              0
> LOAD-BALANCER-STAGE               0         0              0
> FLUSH-SORTER-POOL                 0         0              0
> MEMTABLE-POST-FLUSHER             0         0              7
> FLUSH-WRITER-POOL                 0         0              7
> AE-SERVICE-STAGE                  0         0              1
> HINTED-HANDOFF-POOL               0         0              5
> In data/system/* there are only LocationInfo files, so looks like hinted
> handoff is indeed disabled and cfstats does indicate there are 0 bytes,
> however it also indicates of 32 reads which I didn't expect (cluster has
> been up for a few hours).
> $ nodetool -h cass25 -p 9004 tpstats
> ...
>                 Column Family: HintsColumnFamily
>                 SSTable count: 0
>                 Space used (live): 0
>                 Space used (total): 0
>                 Memtable Columns Count: 0
>                 Memtable Data Size: 0
>                 Memtable Switch Count: 0
>                 Read Count: 32
>                 Read Latency: 0.062 ms.
>                 Write Count: 0
>                 Write Latency: NaN ms.
>                 Pending Tasks: 0
>                 Key cache capacity: 1
>                 Key cache size: 0
>                 Key cache hit rate: NaN
>                 Row cache: disabled
>                 Compacted row minimum size: 0
>                 Compacted row maximum size: 0
>                 Compacted row mean size: 0
> Any idea why is this happening?



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com