kafkaspout stops fetching

[clay teahouse <cl...@gmail.com>]

Hi all,

My kafkaspout stops fetching after the first couple of hundred tuples. My
fetch and buffer are set to a couple of hundred meg and the max spout
pending is 1024. I don't see anything unusual in the log. Any idea what
could be the cause?

thanks
Clay

Re: kafkaspout stops fetching

[clay teahouse <cl...@gmail.com>]

Lowering it to a few meg didn't make any difference. Also, I am feeding the
kafka topic, several hundred of thousands of records, but the spout stops
fetching after a couple of hundred tuples.

On Fri, Feb 6, 2015 at 8:58 AM, Harsha <st...@harsha.io> wrote:

>  " My fetch and buffer are set to a couple of hundred meg and the max
> spout pending is 1024"
> your fetch.size probably too large as it trying to fetch 200mb of data at
> a time and your topic might not have sufficient data.
>
>
> On Fri, Feb 6, 2015, at 06:03 AM, clay teahouse wrote:
>
> Hi all,
>
> My kafkaspout stops fetching after the first couple of hundred tuples. My
> fetch and buffer are set to a couple of hundred meg and the max spout
> pending is 1024. I don't see anything unusual in the log. Any idea what
> could be the cause?
>
> thanks
> Clay
>
>
>

Re: kafkaspout stops fetching

[Harsha <st...@harsha.io>]

" My fetch and buffer are set to a couple of hundred meg and the max
spout pending is 1024" your fetch.size probably too large as it trying
to fetch 200mb of data at a time and your topic might not have
sufficient data.


On Fri, Feb 6, 2015, at 06:03 AM, clay teahouse wrote:
> Hi all,
>
> My kafkaspout stops fetching after the first couple of hundred tuples.
> My fetch and buffer are set to a couple of hundred meg and the max
> spout pending is 1024. I don't see anything unusual in the log. Any
> idea what could be the cause?
>
> thanks Clay