You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2010/01/05 03:29:04 UTC
[jira] Created: (CASSANDRA-668) long commitlog syncs can cause
write pauses
long commitlog syncs can cause write pauses
-------------------------------------------
Key: CASSANDRA-668
URL: https://issues.apache.org/jira/browse/CASSANDRA-668
Project: Cassandra
Issue Type: Bug
Reporter: Jonathan Ellis
Assignee: Jonathan Ellis
Priority: Minor
Fix For: 0.5, 0.9
on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-668) long commitlog syncs can cause
write pauses
Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796767#action_12796767 ]
Brandon Williams commented on CASSANDRA-668:
--------------------------------------------
+1, no more write pauses with bonnie++ running.
> long commitlog syncs can cause write pauses
> -------------------------------------------
>
> Key: CASSANDRA-668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-668
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.5, 0.9
>
> Attachments: 668.patch
>
>
> on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-668) long commitlog syncs can cause
write pauses
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796770#action_12796770 ]
Jonathan Ellis commented on CASSANDRA-668:
------------------------------------------
(committed patch to 0.5 and trunk)
> long commitlog syncs can cause write pauses
> -------------------------------------------
>
> Key: CASSANDRA-668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-668
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.5, 0.9
>
> Attachments: 668.patch
>
>
> on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-668) long commitlog syncs can cause
write pauses
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-668:
-------------------------------------
Fix Version/s: (was: 0.5)
(un-tagging 0.5 since any further work almost certainly won't be backported there)
> long commitlog syncs can cause write pauses
> -------------------------------------------
>
> Key: CASSANDRA-668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-668
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.9
>
> Attachments: 668.patch
>
>
> on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (CASSANDRA-668) long commitlog syncs can cause
write pauses
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-668.
--------------------------------------
Resolution: Fixed
Fix Version/s: (was: 0.9)
0.5
(actually I think the best thing to do is tag this 0.5 and resolve it, and create a new issue for further investigation)
> long commitlog syncs can cause write pauses
> -------------------------------------------
>
> Key: CASSANDRA-668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-668
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.5
>
> Attachments: 668.patch
>
>
> on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-668) long commitlog syncs can cause
write pauses
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-668:
-------------------------------------
Component/s: Core
> long commitlog syncs can cause write pauses
> -------------------------------------------
>
> Key: CASSANDRA-668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-668
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.5, 0.9
>
> Attachments: 668.patch
>
>
> on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-668) long commitlog syncs can cause
write pauses
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796769#action_12796769 ]
Jonathan Ellis commented on CASSANDRA-668:
------------------------------------------
There's still some mystery here, because the commitlog was on a separate device + xfs filesystem, so syncing that shouldn't have to wait for IO from the data filesystem. But short term this patch is better than nothing.
> long commitlog syncs can cause write pauses
> -------------------------------------------
>
> Key: CASSANDRA-668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-668
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.5, 0.9
>
> Attachments: 668.patch
>
>
> on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-668) long commitlog syncs can cause
write pauses
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-668:
-------------------------------------
Attachment: 668.patch
increase default sync period, and wait for last sync to finish before submitting another
> long commitlog syncs can cause write pauses
> -------------------------------------------
>
> Key: CASSANDRA-668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-668
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.5, 0.9
>
> Attachments: 668.patch
>
>
> on a heavily loaded system (deliberately exacerbated by running the bonnie++ i/o benchmarking tool at the same time as cassandra -- which might not be too far off from the environment you would see on some VPS hosts), we're seeing CL sync times of 1-5s, causing write pauses.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.