You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by chenlax <la...@hotmail.com> on 2014/12/23 13:44:31 UTC
kafka 0.8.1.1 delay in replica data
i set a topic retention.ms as 360000;and then i find the replica data is delay.
What could cause this?
as follows screenshot:
master broker:
replica broker:
Thanks，
Lax
RE: kafka 0.8.1.1 delay in replica data
Posted by chenlax <la...@hotmail.com>.
i set the conf num.replica.fetchers=6,then solve this.
Thanks，
Lax
> Date: Wed, 31 Dec 2014 15:51:57 -0800
> Subject: Re: kafka 0.8.1.1 delay in replica data
> From: jun@confluent.io
> To: users@kafka.apache.org
>
> Is the system time in-sync btw the two hosts?
>
> Thanks,
>
> Jun
>
> On Tue, Dec 23, 2014 at 5:23 AM, chenlax <la...@hotmail.com> wrote:
>
> > topic:
> >
> > Topic_test_data_1-10
> >
> > leader broker data info:
> > -rw-rw-r-- 1 mqq mqq 237728 Dec 23 19:51 00000000000211076304.index
> > -rw-rw-r-- 1 mqq mqq 536875106 Dec 23 19:51 00000000000211076304.log
> > -rw-rw-r-- 1 mqq mqq 237632 Dec 23 19:45 00000000000203797807.index
> > -rw-rw-r-- 1 mqq mqq 536879703 Dec 23 19:45 00000000000203797807.log
> > -rw-rw-r-- 1 mqq mqq 237576 Dec 23 19:38 00000000000196519197.index
> > -rw-rw-r-- 1 mqq mqq 536885834 Dec 23 19:38 00000000000196519197.log
> > -rw-rw-r-- 1 mqq mqq 237848 Dec 23 19:32 00000000000189241352.index
> > -rw-rw-r-- 1 mqq mqq 536882522 Dec 23 19:32 00000000000189241352.log
> > -rw-rw-r-- 1 mqq mqq 238048 Dec 23 19:26 00000000000181963182.index
> > -rw-rw-r-- 1 mqq mqq 536874188 Dec 23 19:26 00000000000181963182.log
> > -rw-rw-r-- 1 mqq mqq 237472 Dec 23 19:19 00000000000174684585.index
> > -rw-rw-r-- 1 mqq mqq 536883850 Dec 23 19:19 00000000000174684585.log
> > -rw-rw-r-- 1 mqq mqq 237848 Dec 23 19:13 00000000000167406454.index
> > -rw-rw-r-- 1 mqq mqq 536877465 Dec 23 19:13 00000000000167406454.log
> >
> > replica data info:
> >
> > -rw-rw-r-- 1 mqq mqq 173539804 Dec 23 20:37 00000000000196519197.log
> > -rw-rw-r-- 1 mqq mqq 10485760 Dec 23 20:37 00000000000196519197.index
> > -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:36 00000000000189241352.index
> > -rw-rw-r-- 1 mqq mqq 536882522 Dec 23 20:36 00000000000189241352.log
> > -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:30 00000000000181963182.index
> > -rw-rw-r-- 1 mqq mqq 536874188 Dec 23 20:30 00000000000181963182.log
> > -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:25 00000000000174684585.index
> > -rw-rw-r-- 1 mqq mqq 536883850 Dec 23 20:25 00000000000174684585.log
> > -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:20 00000000000167406454.index
> > -rw-rw-r-- 1 mqq mqq 536877465 Dec 23 20:20 00000000000167406454.log
> >
> > the offset 167406454 in leader broker time is 19:13, but in replica
> > broker the time is 20:20.
> >
> > Thanks，
> > Lax
> >
> >
> > From: laxpio@hotmail.com
> > To: users@kafka.apache.org
> > Subject: kafka 0.8.1.1 delay in replica data
> > Date: Tue, 23 Dec 2014 20:44:31 +0800
> >
> >
> >
> >
> > i set a topic retention.ms as 360000;and then i find the replica data is
> > delay.
> > What could cause this?
> >
> > as follows screenshot:
> > master broker:
> >
> > replica broker:
> >
> >
> >
> > Thanks，
> > Lax
> >
> >
Re: kafka 0.8.1.1 delay in replica data
Posted by Jun Rao <ju...@confluent.io>.
Is the system time in-sync btw the two hosts?
Thanks,
Jun
On Tue, Dec 23, 2014 at 5:23 AM, chenlax <la...@hotmail.com> wrote:
> topic:
>
> Topic_test_data_1-10
>
> leader broker data info:
> -rw-rw-r-- 1 mqq mqq 237728 Dec 23 19:51 00000000000211076304.index
> -rw-rw-r-- 1 mqq mqq 536875106 Dec 23 19:51 00000000000211076304.log
> -rw-rw-r-- 1 mqq mqq 237632 Dec 23 19:45 00000000000203797807.index
> -rw-rw-r-- 1 mqq mqq 536879703 Dec 23 19:45 00000000000203797807.log
> -rw-rw-r-- 1 mqq mqq 237576 Dec 23 19:38 00000000000196519197.index
> -rw-rw-r-- 1 mqq mqq 536885834 Dec 23 19:38 00000000000196519197.log
> -rw-rw-r-- 1 mqq mqq 237848 Dec 23 19:32 00000000000189241352.index
> -rw-rw-r-- 1 mqq mqq 536882522 Dec 23 19:32 00000000000189241352.log
> -rw-rw-r-- 1 mqq mqq 238048 Dec 23 19:26 00000000000181963182.index
> -rw-rw-r-- 1 mqq mqq 536874188 Dec 23 19:26 00000000000181963182.log
> -rw-rw-r-- 1 mqq mqq 237472 Dec 23 19:19 00000000000174684585.index
> -rw-rw-r-- 1 mqq mqq 536883850 Dec 23 19:19 00000000000174684585.log
> -rw-rw-r-- 1 mqq mqq 237848 Dec 23 19:13 00000000000167406454.index
> -rw-rw-r-- 1 mqq mqq 536877465 Dec 23 19:13 00000000000167406454.log
>
> replica data info:
>
> -rw-rw-r-- 1 mqq mqq 173539804 Dec 23 20:37 00000000000196519197.log
> -rw-rw-r-- 1 mqq mqq 10485760 Dec 23 20:37 00000000000196519197.index
> -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:36 00000000000189241352.index
> -rw-rw-r-- 1 mqq mqq 536882522 Dec 23 20:36 00000000000189241352.log
> -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:30 00000000000181963182.index
> -rw-rw-r-- 1 mqq mqq 536874188 Dec 23 20:30 00000000000181963182.log
> -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:25 00000000000174684585.index
> -rw-rw-r-- 1 mqq mqq 536883850 Dec 23 20:25 00000000000174684585.log
> -rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:20 00000000000167406454.index
> -rw-rw-r-- 1 mqq mqq 536877465 Dec 23 20:20 00000000000167406454.log
>
> the offset 167406454 in leader broker time is 19:13, but in replica
> broker the time is 20:20.
>
> Thanks，
> Lax
>
>
> From: laxpio@hotmail.com
> To: users@kafka.apache.org
> Subject: kafka 0.8.1.1 delay in replica data
> Date: Tue, 23 Dec 2014 20:44:31 +0800
>
>
>
>
> i set a topic retention.ms as 360000;and then i find the replica data is
> delay.
> What could cause this?
>
> as follows screenshot:
> master broker:
>
> replica broker:
>
>
>
> Thanks，
> Lax
>
>
RE: kafka 0.8.1.1 delay in replica data
Posted by chenlax <la...@hotmail.com>.
topic:
Topic_test_data_1-10
leader broker data info:
-rw-rw-r-- 1 mqq mqq 237728 Dec 23 19:51 00000000000211076304.index
-rw-rw-r-- 1 mqq mqq 536875106 Dec 23 19:51 00000000000211076304.log
-rw-rw-r-- 1 mqq mqq 237632 Dec 23 19:45 00000000000203797807.index
-rw-rw-r-- 1 mqq mqq 536879703 Dec 23 19:45 00000000000203797807.log
-rw-rw-r-- 1 mqq mqq 237576 Dec 23 19:38 00000000000196519197.index
-rw-rw-r-- 1 mqq mqq 536885834 Dec 23 19:38 00000000000196519197.log
-rw-rw-r-- 1 mqq mqq 237848 Dec 23 19:32 00000000000189241352.index
-rw-rw-r-- 1 mqq mqq 536882522 Dec 23 19:32 00000000000189241352.log
-rw-rw-r-- 1 mqq mqq 238048 Dec 23 19:26 00000000000181963182.index
-rw-rw-r-- 1 mqq mqq 536874188 Dec 23 19:26 00000000000181963182.log
-rw-rw-r-- 1 mqq mqq 237472 Dec 23 19:19 00000000000174684585.index
-rw-rw-r-- 1 mqq mqq 536883850 Dec 23 19:19 00000000000174684585.log
-rw-rw-r-- 1 mqq mqq 237848 Dec 23 19:13 00000000000167406454.index
-rw-rw-r-- 1 mqq mqq 536877465 Dec 23 19:13 00000000000167406454.log
replica data info:
-rw-rw-r-- 1 mqq mqq 173539804 Dec 23 20:37 00000000000196519197.log
-rw-rw-r-- 1 mqq mqq 10485760 Dec 23 20:37 00000000000196519197.index
-rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:36 00000000000189241352.index
-rw-rw-r-- 1 mqq mqq 536882522 Dec 23 20:36 00000000000189241352.log
-rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:30 00000000000181963182.index
-rw-rw-r-- 1 mqq mqq 536874188 Dec 23 20:30 00000000000181963182.log
-rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:25 00000000000174684585.index
-rw-rw-r-- 1 mqq mqq 536883850 Dec 23 20:25 00000000000174684585.log
-rw-rw-r-- 1 mqq mqq 4128 Dec 23 20:20 00000000000167406454.index
-rw-rw-r-- 1 mqq mqq 536877465 Dec 23 20:20 00000000000167406454.log
the offset 167406454 in leader broker time is 19:13, but in replica broker the time is 20:20.
Thanks，
Lax
From: laxpio@hotmail.com
To: users@kafka.apache.org
Subject: kafka 0.8.1.1 delay in replica data
Date: Tue, 23 Dec 2014 20:44:31 +0800
i set a topic retention.ms as 360000;and then i find the replica data is delay.
What could cause this?
as follows screenshot:
master broker:
replica broker:
Thanks，
Lax