maximum number of open file handles

[Sa Li <sa...@gmail.com>]

Hi, all

I read the comments from
http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/,
Michael mentioned to increase the maximum number of open file handles for
the user kafka to 98,304 (change kafka to whatever user you are running the
Kafka daemons with – this can be your own user account, of course) you must
add the following line to /etc/security/limits.conf:

kafka  - nofile 98304

I am installing the latest version of kafka, do I need to do the same thing
above?

thanks
-- 

Alec Li

Re: maximum number of open file handles

[Otis Gospodnetic <ot...@gmail.com>]

This is not an absolute rule/number.  It depends on your Kafka usage and
your existing limits.  SPM <http://sematext.com/spm/> will show you the
number of open files Kafka is using, as will a tool like 'lsof'.

Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/


On Thu, Nov 27, 2014 at 6:58 PM, Sa Li <sa...@gmail.com> wrote:

> Hi, all
>
> I read the comments from
> http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/,
> Michael mentioned to increase the maximum number of open file handles for
> the user kafka to 98,304 (change kafka to whatever user you are running the
> Kafka daemons with – this can be your own user account, of course) you must
> add the following line to /etc/security/limits.conf:
>
> kafka  - nofile 98304
>
> I am installing the latest version of kafka, do I need to do the same thing
> above?
>
> thanks
> --
>
> Alec Li
>