You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by ravi singh <rr...@gmail.com> on 2014/09/26 03:19:50 UTC
BytesOutPerSec is more than BytesInPerSec.
I have set up my kafka broker with as single producer and consumer. When I
am plotting the graph for all topic bytes in/out per sec i could see that
value of BytesOutPerSec is more than BytesInPerSec.
Is this correct? I confirmed that my consumer is consuming the messages
only once. What could be the reason for this behavior?
[image: Inline image 1]
--
*Regards,*
*Ravi*
Re: BytesOutPerSec is more than BytesInPerSec.
Posted by ravi singh <rr...@gmail.com>.
Thanks Steven, I am using replication factor of 3 .
As you mentioned, the replicas also consume from the leader that's the
reason for deviation in BytesInPerSec and BytesOutPersec
Regards,
Ravi
On Fri, Sep 26, 2014 at 10:27 AM, Joel Koshy <jj...@gmail.com> wrote:
> Can you confirm that you are using a replication factor of two? As
> Steven said, the replicas also consume from the leader. So it's your
> consumer, plus the replica.
>
> On Thu, Sep 25, 2014 at 10:04:29PM -0700, ravi singh wrote:
> > Thanks Steven. That answers the difference in Bytes in and bytes Out per
> > sec. But I was wondering why(and how) is BytesOutPerSec is calculated
> based
> > on number of partition even though it is consumed only once?
> >
> >
> > *Regards,*
> > *Ravi*
> >
> > On Thu, Sep 25, 2014 at 9:55 PM, Steven Wu <st...@gmail.com> wrote:
> >
> > > couldn't see your graph. but your replicator factor is 2. then
> replication
> > > traffic can be the explanation. basically, BytesOut will be 2x of
> BytesIn.
> > >
> > > On Thu, Sep 25, 2014 at 6:19 PM, ravi singh <rr...@gmail.com>
> wrote:
> > >
> > > > I have set up my kafka broker with as single producer and consumer.
> When
> > > I
> > > > am plotting the graph for all topic bytes in/out per sec i could see
> > > that
> > > > value of BytesOutPerSec is more than BytesInPerSec.
> > > > Is this correct? I confirmed that my consumer is consuming the
> messages
> > > > only once. What could be the reason for this behavior?
> > > >
> > > > [image: Inline image 1]
> > > >
> > > >
> > > > --
> > > > *Regards,*
> > > > *Ravi*
> > > >
> > >
> >
> >
> >
> > --
> > *Regards,*
> > *Ravi*
>
>
--
*Regards,*
*Ravi*
Re: BytesOutPerSec is more than BytesInPerSec.
Posted by Joel Koshy <jj...@gmail.com>.
Can you confirm that you are using a replication factor of two? As
Steven said, the replicas also consume from the leader. So it's your
consumer, plus the replica.
On Thu, Sep 25, 2014 at 10:04:29PM -0700, ravi singh wrote:
> Thanks Steven. That answers the difference in Bytes in and bytes Out per
> sec. But I was wondering why(and how) is BytesOutPerSec is calculated based
> on number of partition even though it is consumed only once?
>
>
> *Regards,*
> *Ravi*
>
> On Thu, Sep 25, 2014 at 9:55 PM, Steven Wu <st...@gmail.com> wrote:
>
> > couldn't see your graph. but your replicator factor is 2. then replication
> > traffic can be the explanation. basically, BytesOut will be 2x of BytesIn.
> >
> > On Thu, Sep 25, 2014 at 6:19 PM, ravi singh <rr...@gmail.com> wrote:
> >
> > > I have set up my kafka broker with as single producer and consumer. When
> > I
> > > am plotting the graph for all topic bytes in/out per sec i could see
> > that
> > > value of BytesOutPerSec is more than BytesInPerSec.
> > > Is this correct? I confirmed that my consumer is consuming the messages
> > > only once. What could be the reason for this behavior?
> > >
> > > [image: Inline image 1]
> > >
> > >
> > > --
> > > *Regards,*
> > > *Ravi*
> > >
> >
>
>
>
> --
> *Regards,*
> *Ravi*
Re: BytesOutPerSec is more than BytesInPerSec.
Posted by ravi singh <rr...@gmail.com>.
Thanks Steven. That answers the difference in Bytes in and bytes Out per
sec. But I was wondering why(and how) is BytesOutPerSec is calculated based
on number of partition even though it is consumed only once?
*Regards,*
*Ravi*
On Thu, Sep 25, 2014 at 9:55 PM, Steven Wu <st...@gmail.com> wrote:
> couldn't see your graph. but your replicator factor is 2. then replication
> traffic can be the explanation. basically, BytesOut will be 2x of BytesIn.
>
> On Thu, Sep 25, 2014 at 6:19 PM, ravi singh <rr...@gmail.com> wrote:
>
> > I have set up my kafka broker with as single producer and consumer. When
> I
> > am plotting the graph for all topic bytes in/out per sec i could see
> that
> > value of BytesOutPerSec is more than BytesInPerSec.
> > Is this correct? I confirmed that my consumer is consuming the messages
> > only once. What could be the reason for this behavior?
> >
> > [image: Inline image 1]
> >
> >
> > --
> > *Regards,*
> > *Ravi*
> >
>
--
*Regards,*
*Ravi*
Re: BytesOutPerSec is more than BytesInPerSec.
Posted by Steven Wu <st...@gmail.com>.
couldn't see your graph. but your replicator factor is 2. then replication
traffic can be the explanation. basically, BytesOut will be 2x of BytesIn.
On Thu, Sep 25, 2014 at 6:19 PM, ravi singh <rr...@gmail.com> wrote:
> I have set up my kafka broker with as single producer and consumer. When I
> am plotting the graph for all topic bytes in/out per sec i could see that
> value of BytesOutPerSec is more than BytesInPerSec.
> Is this correct? I confirmed that my consumer is consuming the messages
> only once. What could be the reason for this behavior?
>
> [image: Inline image 1]
>
>
> --
> *Regards,*
> *Ravi*
>