You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by vimal dinakaran <vi...@gmail.com> on 2016/01/27 18:14:56 UTC
spark streaming web ui not showing the events - direct kafka api
Hi ,
I am using spark 1.4 with direct kafka api . In my streaming ui , I am
able to see the events listed in UI only if add stream.print() statements
or else event rate and input events remains in 0 eventhough the events gets
processed.
Without print statements , I have the action saveToCassandra in the
dstream.
Any reasons why is this not working ?
Thanks
Vimal
Re: spark streaming web ui not showing the events - direct kafka api
Posted by Cody Koeninger <co...@koeninger.org>.
There have been changes to visibility of info in ui between 1.4 and 1.5, I
can't say off the top of my head at which point versions they took place.
On Thu, Feb 4, 2016 at 12:07 AM, vimal dinakaran <vi...@gmail.com>
wrote:
> No I am using DSE 4.8 which has spark 1.4. Is this a known issue ?
>
> On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeninger <co...@koeninger.org>
> wrote:
>
>> Have you tried spark 1.5?
>>
>> On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran <vi...@gmail.com>
>> wrote:
>>
>>> Hi ,
>>> I am using spark 1.4 with direct kafka api . In my streaming ui , I am
>>> able to see the events listed in UI only if add stream.print() statements
>>> or else event rate and input events remains in 0 eventhough the events gets
>>> processed.
>>>
>>> Without print statements , I have the action saveToCassandra in the
>>> dstream.
>>>
>>> Any reasons why is this not working ?
>>>
>>> Thanks
>>> Vimal
>>>
>>
>>
>
Re: spark streaming web ui not showing the events - direct kafka api
Posted by vimal dinakaran <vi...@gmail.com>.
No I am using DSE 4.8 which has spark 1.4. Is this a known issue ?
On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeninger <co...@koeninger.org> wrote:
> Have you tried spark 1.5?
>
> On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran <vi...@gmail.com>
> wrote:
>
>> Hi ,
>> I am using spark 1.4 with direct kafka api . In my streaming ui , I am
>> able to see the events listed in UI only if add stream.print() statements
>> or else event rate and input events remains in 0 eventhough the events gets
>> processed.
>>
>> Without print statements , I have the action saveToCassandra in the
>> dstream.
>>
>> Any reasons why is this not working ?
>>
>> Thanks
>> Vimal
>>
>
>
Re: spark streaming web ui not showing the events - direct kafka api
Posted by Cody Koeninger <co...@koeninger.org>.
Have you tried spark 1.5?
On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran <vi...@gmail.com>
wrote:
> Hi ,
> I am using spark 1.4 with direct kafka api . In my streaming ui , I am
> able to see the events listed in UI only if add stream.print() statements
> or else event rate and input events remains in 0 eventhough the events gets
> processed.
>
> Without print statements , I have the action saveToCassandra in the
> dstream.
>
> Any reasons why is this not working ?
>
> Thanks
> Vimal
>