You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Guillermo Ortiz <ko...@gmail.com> on 2014/09/10 14:20:57 UTC
Flume, what happen if the batchsize is not enough
Hi,
I have a question. I'm using an HBaseSink, If I define a batchSize = 1000
(for example), and it never get 1000, is there a timeout and send the
events I got?
Which is that time?
Re: Flume, what happen if the batchsize is not enough
Posted by Guillermo Ortiz <ko...@gmail.com>.
Ok, thank you.
2014-09-10 14:48 GMT+02:00 Joey Echeverria <jo...@cloudera.com>:
> There isn't an explicit timeout on the HBaseSink, though there is on
> the AsyncHBaseSink. For the HBaseSink, it will grab events out of the
> channel until it reaches the batch size or the channel is empty. When
> the channel is empty, it will commit however many events it already
> pulled from the channel even if it's less than the batch size. So,
> there is no worry of events getting delayed due to an insufficient
> number, but it can mean sending much smaller batches to HBase.
>
> HTH,
>
> -Joey
>
> On Wed, Sep 10, 2014 at 5:20 AM, Guillermo Ortiz <ko...@gmail.com>
> wrote:
> > Hi,
> >
> > I have a question. I'm using an HBaseSink, If I define a batchSize = 1000
> > (for example), and it never get 1000, is there a timeout and send the
> events
> > I got?
> > Which is that time?
> >
> >
> >
>
>
>
> --
> Joey Echeverria
>
Re: Flume, what happen if the batchsize is not enough
Posted by Joey Echeverria <jo...@cloudera.com>.
There isn't an explicit timeout on the HBaseSink, though there is on
the AsyncHBaseSink. For the HBaseSink, it will grab events out of the
channel until it reaches the batch size or the channel is empty. When
the channel is empty, it will commit however many events it already
pulled from the channel even if it's less than the batch size. So,
there is no worry of events getting delayed due to an insufficient
number, but it can mean sending much smaller batches to HBase.
HTH,
-Joey
On Wed, Sep 10, 2014 at 5:20 AM, Guillermo Ortiz <ko...@gmail.com> wrote:
> Hi,
>
> I have a question. I'm using an HBaseSink, If I define a batchSize = 1000
> (for example), and it never get 1000, is there a timeout and send the events
> I got?
> Which is that time?
>
>
>
--
Joey Echeverria