You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Hao Ren <in...@gmail.com> on 2016/03/16 11:51:07 UTC
[Streaming] textFileStream has no events shown in web UI
Just a quick question,
When using textFileStream, I did not see any events via web UI.
Actually, I am uploading files to s3 every 5 seconds,
And the mini-batch duration is 30 seconds.
On web ui,:
*Input Rate*
Avg: 0.00 events/sec
But the schedule time and processing time are correct, and the output of
the steam is also correct. Not sure why web ui has not detected any events.
Thank you.
--
Hao Ren
Data Engineer @ leboncoin
Paris, France
Re: [Streaming] textFileStream has no events shown in web UI
Posted by Yogesh Mahajan <ym...@snappydata.io>.
Yes, this has observed in my case also. The Input Rate is 0 even in case of
rawSocketStream.
Is there a way we can enable the Input Rate for these types of streams ?
Thanks,
http://www.snappydata.io/blog <http://snappydata.io>
On Wed, Mar 16, 2016 at 4:21 PM, Hao Ren <in...@gmail.com> wrote:
> Just a quick question,
>
> When using textFileStream, I did not see any events via web UI.
> Actually, I am uploading files to s3 every 5 seconds,
> And the mini-batch duration is 30 seconds.
> On web ui,:
>
> *Input Rate*
> Avg: 0.00 events/sec
>
> But the schedule time and processing time are correct, and the output of
> the steam is also correct. Not sure why web ui has not detected any events.
>
> Thank you.
>
> --
> Hao Ren
>
> Data Engineer @ leboncoin
>
> Paris, France
>
Re: [Streaming] textFileStream has no events shown in web UI
Posted by Yogesh Mahajan <ym...@snappydata.io>.
Yes, this has observed in my case also. The Input Rate is 0 even in case of
rawSocketStream.
Is there a way we can enable the Input Rate for these types of streams ?
Thanks,
http://www.snappydata.io/blog <http://snappydata.io>
On Wed, Mar 16, 2016 at 4:21 PM, Hao Ren <in...@gmail.com> wrote:
> Just a quick question,
>
> When using textFileStream, I did not see any events via web UI.
> Actually, I am uploading files to s3 every 5 seconds,
> And the mini-batch duration is 30 seconds.
> On web ui,:
>
> *Input Rate*
> Avg: 0.00 events/sec
>
> But the schedule time and processing time are correct, and the output of
> the steam is also correct. Not sure why web ui has not detected any events.
>
> Thank you.
>
> --
> Hao Ren
>
> Data Engineer @ leboncoin
>
> Paris, France
>