You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Abhit Kalsotra <ab...@gmail.com> on 2016/11/27 05:44:25 UTC
Strange issue in Kafka Windows where Log directory getting increased
day by day
Dear *
I am facing some issue in Kafka Windows, the Log directories size are keep
on increasing day by day..
Currently the traffic on my kafka set up is minimal , but if this log
directory size does not get fixed then its going to be serious issue...
My Kafka SetUp
- 2 Windows Server
- kafka_2.11-0.10.0.1 and zoo keeper 3.4.9
- 6 kafka broker nodes running on 2 Windows servers.
- 2 topics, with 50 partitions and replication factor of 3.
And one topic retention time is *86400000(24 hours)*, and other one
is *3600000
(1 Hour)*
But every day I see the log directories are getting increased, where as the
traffic on my Kafka is the constant.
Please let me know what would be the resolution for the same. Also when i
see the Log directories e.g
*C:\kafka_2.11-0.10.0.1\kafka_2.11-0.10.0.1kafka-logs04\xyz-47inside this I
could see 000000000000000000000000.index and000000000000000000000000.log
file existed around 10 days ago date too.*
Please let me know what needs to be done
As other wise its going to a big bottle neck for me
Jira issue *<https://issues.apache.org/jira/browse/KAFKA-1194
<https://issues.apache.org/jira/browse/KAFKA-1194>>*
Abhi
!wq
--
If you can't succeed, call it version 1.0
Re: Strange issue in Kafka Windows where Log directory getting
increased day by day
Posted by Abhit Kalsotra <ab...@gmail.com>.
Any pointers guys ?
Abhi
On Sun, Nov 27, 2016 at 11:14 AM, Abhit Kalsotra <ab...@gmail.com> wrote:
> Dear *
>
> I am facing some issue in Kafka Windows, the Log directories size are keep
> on increasing day by day..
>
> Currently the traffic on my kafka set up is minimal , but if this log
> directory size does not get fixed then its going to be serious issue...
>
> My Kafka SetUp
>
> - 2 Windows Server
> - kafka_2.11-0.10.0.1 and zoo keeper 3.4.9
> - 6 kafka broker nodes running on 2 Windows servers.
> - 2 topics, with 50 partitions and replication factor of 3.
> And one topic retention time is *86400000(24 hours)*, and other one is *3600000
> (1 Hour)*
>
> But every day I see the log directories are getting increased, where as
> the traffic on my Kafka is the constant.
>
> Please let me know what would be the resolution for the same. Also when i
> see the Log directories e.g
>
>
>
>
>
> *C:\kafka_2.11-0.10.0.1\kafka_2.11-0.10.0.1kafka-logs04\xyz-47inside this
> I could see 000000000000000000000000.index and000000000000000000000000.log
> file existed around 10 days ago date too.*
> Please let me know what needs to be done
>
> As other wise its going to a big bottle neck for me
>
> Jira issue *<https://issues.apache.org/jira/browse/KAFKA-1194
> <https://issues.apache.org/jira/browse/KAFKA-1194>>*
> Abhi
> !wq
> --
> If you can't succeed, call it version 1.0
>
--
If you can't succeed, call it version 1.0