You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Tianji Li <sk...@gmail.com> on 2017/04/06 21:23:49 UTC
Kafka Streams: Is it possible to set heap size for the JVMs running
Kafka Streams?
If so, how to?
Thanks
Tianji
Re: Kafka Streams: Is it possible to set heap size for the JVMs
running Kafka Streams?
Posted by Tianji Li <sk...@gmail.com>.
Thanks very much Eno for the promptly help. Very appreciated!
Tianji
On Thu, Apr 6, 2017 at 7:23 PM, Eno Thereska <en...@gmail.com> wrote:
> Hi Tianji,
>
> Yes, with some caveats. First, to set the heap size of the JVM, you can
> treat it just like any other Java program, e.g., see
> http://stackoverflow.com/questions/27681511/how-do-i-
> set-the-java-options-for-kafka <http://stackoverflow.com/
> questions/27681511/how-do-i-set-the-java-options-for-kafka> (the answer
> that starts with "You can pass java parameters from command line".
>
> For a guideline on stream-specific setting see this thread:
> https://groups.google.com/forum/?pli=1#!searchin/confluent-platform/heap$
> 20size$20streams%7Csort:relevance/confluent-platform/
> jazg8f-qn0M/hulJwk60AAAJ <https://groups.google.com/
> forum/?pli=1#!searchin/confluent-platform/heap$20size$20streams|sort:
> relevance/confluent-platform/jazg8f-qn0M/hulJwk60AAAJ>.
>
> One caveat is that RocksDb uses off-heap memory, but that can also be
> tuned.
>
> Thanks
> Eno
>
> > On 6 Apr 2017, at 14:23, Tianji Li <sk...@gmail.com> wrote:
> >
> > If so, how to?
> >
> > Thanks
> > Tianji
>
>
Re: Kafka Streams: Is it possible to set heap size for the JVMs
running Kafka Streams?
Posted by Eno Thereska <en...@gmail.com>.
Hi Tianji,
Yes, with some caveats. First, to set the heap size of the JVM, you can treat it just like any other Java program, e.g., see http://stackoverflow.com/questions/27681511/how-do-i-set-the-java-options-for-kafka <http://stackoverflow.com/questions/27681511/how-do-i-set-the-java-options-for-kafka> (the answer that starts with "You can pass java parameters from command line".
For a guideline on stream-specific setting see this thread: https://groups.google.com/forum/?pli=1#!searchin/confluent-platform/heap$20size$20streams%7Csort:relevance/confluent-platform/jazg8f-qn0M/hulJwk60AAAJ <https://groups.google.com/forum/?pli=1#!searchin/confluent-platform/heap$20size$20streams|sort:relevance/confluent-platform/jazg8f-qn0M/hulJwk60AAAJ>.
One caveat is that RocksDb uses off-heap memory, but that can also be tuned.
Thanks
Eno
> On 6 Apr 2017, at 14:23, Tianji Li <sk...@gmail.com> wrote:
>
> If so, how to?
>
> Thanks
> Tianji