You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by chenlax <la...@hotmail.com> on 2015/01/06 11:50:31 UTC

The message would be committed if message "un-committed"

as the kafka doc " Only committed messages are ever given out to the consumer. ".
if followers does not copy the message on time and followers are in ISR, consumers would consume the message from leader broker?

Thanks,
Lax
 		 	   		  

Re: The message would be committed if message "un-committed"

Posted by Jun Rao <ju...@confluent.io>.
The consumer always fetches data from the leader broker.

Thanks,

Jun

On Tue, Jan 6, 2015 at 2:50 AM, chenlax <la...@hotmail.com> wrote:

> as the kafka doc " Only committed messages are ever given out to the
> consumer. ".
> if followers does not copy the message on time and followers are in ISR,
> consumers would consume the message from leader broker?
>
> Thanks,
> Lax
>

RE: The message would be consumed if message "un-committed"

Posted by chenlax <la...@hotmail.com>.
the offset between leader.hw and leader.leo(leo > hw) can not be consumed by consumer,is it?
so messages can not be consumed if follower does not pull them on time(the follower in ISR list)?

Thanks,
Lax


> From: mgharat@linkedin.com.INVALID
> To: users@kafka.apache.org
> Subject: RE: The message would be consumed if message "un-committed"
> Date: Thu, 8 Jan 2015 17:47:35 +0000
> 
> The consumer can only read up to leader High water mark.
> 
> Thanks,
> 
> Mayuresh
> ________________________________________
> From: chenlax [laxpio@hotmail.com]
> Sent: Thursday, January 08, 2015 2:53 AM
> To: users kafka
> Subject: RE: The message would be consumed if message "un-committed"
> 
> so consumer can not read the offset between leader.hw and min(followers.leo)?
> 
> Thanks,
> Lax
> 
> 
> > Date: Tue, 6 Jan 2015 08:44:39 -0800
> > Subject: Re: The message would be consumed if message "un-committed"
> > From: gharatmayuresh15@gmail.com
> > To: users@kafka.apache.org
> >
> > Only Committed messages are made available to the consumer. The consumer
> > will always read from the leader. The message is said to be committed (The
> > high water mark is advanced)  only when all the replicas in the ISR have
> > received it.
> >
> > Thanks,
> >
> > Mayuresh
> >
> > On Tue, Jan 6, 2015 at 3:41 AM, chenlax <la...@hotmail.com> wrote:
> >
> > >  as the kafka doc " Only committed messages are ever given out to the
> > > consumer. ".
> > > if followers does not copy the message on time and followers are in ISR,
> > > consumers would consume the message from leader broker?
> > >
> > > Thanks,
> > > Lax
> > >
> >
> >
> >
> >
> > --
> > -Regards,
> > Mayuresh R. Gharat
> > (862) 250-7125
 		 	   		  

RE: The message would be consumed if message "un-committed"

Posted by Mayuresh Gharat <mg...@linkedin.com.INVALID>.
The consumer can only read up to leader High water mark.

Thanks,

Mayuresh
________________________________________
From: chenlax [laxpio@hotmail.com]
Sent: Thursday, January 08, 2015 2:53 AM
To: users kafka
Subject: RE: The message would be consumed if message "un-committed"

so consumer can not read the offset between leader.hw and min(followers.leo)?

Thanks,
Lax


> Date: Tue, 6 Jan 2015 08:44:39 -0800
> Subject: Re: The message would be consumed if message "un-committed"
> From: gharatmayuresh15@gmail.com
> To: users@kafka.apache.org
>
> Only Committed messages are made available to the consumer. The consumer
> will always read from the leader. The message is said to be committed (The
> high water mark is advanced)  only when all the replicas in the ISR have
> received it.
>
> Thanks,
>
> Mayuresh
>
> On Tue, Jan 6, 2015 at 3:41 AM, chenlax <la...@hotmail.com> wrote:
>
> >  as the kafka doc " Only committed messages are ever given out to the
> > consumer. ".
> > if followers does not copy the message on time and followers are in ISR,
> > consumers would consume the message from leader broker?
> >
> > Thanks,
> > Lax
> >
>
>
>
>
> --
> -Regards,
> Mayuresh R. Gharat
> (862) 250-7125

Re: The message would be consumed if message "un-committed"

Posted by Mayuresh Gharat <gh...@gmail.com>.
The consumer can only read up to leader High water mark.

Thanks,

Mayuresh

On Thu, Jan 8, 2015 at 2:53 AM, chenlax <la...@hotmail.com> wrote:

> so consumer can not read the offset between leader.hw and
> min(followers.leo)?
>
> Thanks,
> Lax
>
>
> > Date: Tue, 6 Jan 2015 08:44:39 -0800
> > Subject: Re: The message would be consumed if message "un-committed"
> > From: gharatmayuresh15@gmail.com
> > To: users@kafka.apache.org
> >
> > Only Committed messages are made available to the consumer. The consumer
> > will always read from the leader. The message is said to be committed
> (The
> > high water mark is advanced)  only when all the replicas in the ISR have
> > received it.
> >
> > Thanks,
> >
> > Mayuresh
> >
> > On Tue, Jan 6, 2015 at 3:41 AM, chenlax <la...@hotmail.com> wrote:
> >
> > >  as the kafka doc " Only committed messages are ever given out to the
> > > consumer. ".
> > > if followers does not copy the message on time and followers are in
> ISR,
> > > consumers would consume the message from leader broker?
> > >
> > > Thanks,
> > > Lax
> > >
> >
> >
> >
> >
> > --
> > -Regards,
> > Mayuresh R. Gharat
> > (862) 250-7125
>
>



-- 
-Regards,
Mayuresh R. Gharat
(862) 250-7125

RE: The message would be consumed if message "un-committed"

Posted by chenlax <la...@hotmail.com>.
so consumer can not read the offset between leader.hw and min(followers.leo)?

Thanks,
Lax


> Date: Tue, 6 Jan 2015 08:44:39 -0800
> Subject: Re: The message would be consumed if message "un-committed"
> From: gharatmayuresh15@gmail.com
> To: users@kafka.apache.org
> 
> Only Committed messages are made available to the consumer. The consumer
> will always read from the leader. The message is said to be committed (The
> high water mark is advanced)  only when all the replicas in the ISR have
> received it.
> 
> Thanks,
> 
> Mayuresh
> 
> On Tue, Jan 6, 2015 at 3:41 AM, chenlax <la...@hotmail.com> wrote:
> 
> >  as the kafka doc " Only committed messages are ever given out to the
> > consumer. ".
> > if followers does not copy the message on time and followers are in ISR,
> > consumers would consume the message from leader broker?
> >
> > Thanks,
> > Lax
> >
> 
> 
> 
> 
> -- 
> -Regards,
> Mayuresh R. Gharat
> (862) 250-7125
 		 	   		  

Re: The message would be consumed if message "un-committed"

Posted by Mayuresh Gharat <gh...@gmail.com>.
Only Committed messages are made available to the consumer. The consumer
will always read from the leader. The message is said to be committed (The
high water mark is advanced)  only when all the replicas in the ISR have
received it.

Thanks,

Mayuresh

On Tue, Jan 6, 2015 at 3:41 AM, chenlax <la...@hotmail.com> wrote:

>  as the kafka doc " Only committed messages are ever given out to the
> consumer. ".
> if followers does not copy the message on time and followers are in ISR,
> consumers would consume the message from leader broker?
>
> Thanks,
> Lax
>




-- 
-Regards,
Mayuresh R. Gharat
(862) 250-7125

The message would be consumed if message "un-committed"

Posted by chenlax <la...@hotmail.com>.
 as the kafka doc " Only committed messages are ever given out to the consumer. ".
if followers does not copy the message on time and followers are in ISR, consumers would consume the message from leader broker?

Thanks,
Lax