You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2011/09/14 18:06:08 UTC
[jira] [Created] (CASSANDRA-3206) increase file descriptor limit in
deb, rpm packages
increase file descriptor limit in deb, rpm packages
---------------------------------------------------
Key: CASSANDRA-3206
URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
Project: Cassandra
Issue Type: Bug
Components: Packaging
Reporter: Jonathan Ellis
Assignee: paul cannon
Priority: Minor
Fix For: 0.8.6
We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104632#comment-13104632 ]
Jonathan Ellis commented on CASSANDRA-3206:
-------------------------------------------
bq. 5? per sstable
This is incorrect -- when using mmap'd I/O, we don't consume FD-per-sstable (we use one temporarily when setting up the mmap, then release it). And even in buffered I/O mode we use one FD per sstable being read, per reading thread. (Which will be much less than one FD per sstable in most cases, although range scans under LevelDB do not yet do a very good job of cutting back the number of SSTables consulted.)
So it sounds like we mostly need to make sure we have it high enough that we tolerate high numbers of unpooled connections (common in PHP environments, I'm told).
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.6
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104966#comment-13104966 ]
Jonathan Ellis commented on CASSANDRA-3206:
-------------------------------------------
SGTM.
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.6
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104649#comment-13104649 ]
Jonathan Ellis commented on CASSANDRA-3206:
-------------------------------------------
So... 64K?
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.6
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105082#comment-13105082 ]
paul cannon commented on CASSANDRA-3206:
----------------------------------------
I concur. I'll go with 100k unless someone has a good argument for having it be higher.
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.6
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "Peter Schuller (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104892#comment-13104892 ]
Peter Schuller commented on CASSANDRA-3206:
-------------------------------------------
My two cents: Just go wild. I really don't see the need to be conservative. On any modern system that you run Cassandra on, the resources consumed by file descriptors is going to be irrelevant and I don't see when you'd ever actually want Cassandra to hit the limit, unless it's *completely* run-away and buggy in which case the limit need not be low. Better a very high number so people don't run into it, than try to shave off.
64k seems reasonable, I'd be fine with 250k ;)
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.6
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3206) increase file descriptor limit in
deb, rpm packages
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
paul cannon updated CASSANDRA-3206:
-----------------------------------
Attachment: 3206.patch.txt
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.7
>
> Attachments: 3206.patch.txt
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113816#comment-13113816 ]
Hudson commented on CASSANDRA-3206:
-----------------------------------
Integrated in Cassandra-0.8 #339 (See [https://builds.apache.org/job/Cassandra-0.8/339/])
Increase FD limit to 100k in packaging.
Patch by Paul Cannon, reviewed by brandonwilliams for CASSANDRA-3206
brandonwilliams : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1175027
Files :
* /cassandra/branches/cassandra-0.8/CHANGES.txt
* /cassandra/branches/cassandra-0.8/debian/cassandra.conf
* /cassandra/branches/cassandra-0.8/debian/init
* /cassandra/branches/cassandra-0.8/redhat/cassandra.conf
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.7
>
> Attachments: 3206.patch.txt
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104648#comment-13104648 ]
Jonathan Ellis commented on CASSANDRA-3206:
-------------------------------------------
Jeremy pointed out that we can also use a large number of FDs during compaction: either major compaction for tiered strategy, or a L0 compaction under Leveled, can open an effectively arbitrary number of sstables if compaction is behind.
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.6
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3206) increase file descriptor limit
in deb, rpm packages
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104609#comment-13104609 ]
Jonathan Ellis commented on CASSANDRA-3206:
-------------------------------------------
I'd suggest sizing this based on the number of sstables we need to support a "sane" amount of storage. 1TB? 2?
> increase file descriptor limit in deb, rpm packages
> ---------------------------------------------------
>
> Key: CASSANDRA-3206
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3206
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Jonathan Ellis
> Assignee: paul cannon
> Priority: Minor
> Fix For: 0.8.6
>
>
> We can use a lot of file descriptors (one per socket, 5? per sstable). People hit this regularly on the user list and it will get worse with Leveled compaction, which limits sstable size to a relatively low size (currently 5MB).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira