You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Brandon Williams (Issue Comment Edited) (JIRA)" <ji...@apache.org> on 2011/11/09 15:05:52 UTC
[jira] [Issue Comment Edited] (CASSANDRA-3466) Hinted handoff not
working after rolling upgrade from 0.8.7 to 1.0.2
[ https://issues.apache.org/jira/browse/CASSANDRA-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147057#comment-13147057 ]
Brandon Williams edited comment on CASSANDRA-3466 at 11/9/11 2:04 PM:
----------------------------------------------------------------------
bq. Brandon, Did you verify that removing those lines of code actually fixes hint delivery?
Yes.
bq. Instead of changing the code I just did a quick experiment with "nodetool flush" on the node holding the hints and then restarting the other node but that was not enough to trigger hints delivery
Hints aren't delivered immediately, there's up to a 60s random delay to stagger the replay. Did you wait long enough to be sure it passed?
was (Author: brandon.williams):
bq. Brandon, Did you verify that removing those lines of code actually fixes hint delivery?
Yes.
bq. Instead of changing the code I just did a quick experiment with "nodetool flush" on the node holding the hints and then restarting the other node but that was not enough to trigger hints delivery
Hints aren't delivered immediately, there's up a 60s random delay to stagger the replay. Did you wait long enough to be sure it passed?
> Hinted handoff not working after rolling upgrade from 0.8.7 to 1.0.2
> --------------------------------------------------------------------
>
> Key: CASSANDRA-3466
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3466
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.0
> Reporter: Jonas Borgström
> Assignee: Brandon Williams
> Labels: hintedhandoff
> Fix For: 1.0.3
>
>
> While testing rolling upgrades from 0.8.7 to 1.0.2 on a test cluster I've noticed that hinted hand-off didn't always work properly. Hints generated on an upgraded node does not seem to be delivered to other newly upgraded nodes once they rejoin the ring. They only way I've found to get a node to deliver its hints is to restart it.
> Here's some steps to reproduce this issue:
> 1. Install cassandra 0.8.7 on node1 and node2 using default settings.
> 2. Create keyspace foo with {replication_factor: 2}. Create column family bar
> 3. Shutdown node2
> 4. Insert data into bar and verify that HintsColumnFamily on node2 contains hints
> 5. Start node2 and verify that hinted handoff is performed and HintsColumnFamily becomes empty again.
> 6. Upgrade and restart node1
> 7. Shutdown node2
> 8. Insert data into bar and verify that HintsColumnFamily on node2 contains hints
> 9. Upgrade and start node2
> 10. Notice that hinted handoff is *not* performed when "node2" comes back. (Only if node1 is restarted)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira