You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by vimal dinakaran <vi...@gmail.com> on 2016/02/04 07:07:41 UTC
Re: spark streaming web ui not showing the events - direct kafka api
No I am using DSE 4.8 which has spark 1.4. Is this a known issue ?
On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeninger <co...@koeninger.org> wrote:
> Have you tried spark 1.5?
>
> On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran <vi...@gmail.com>
> wrote:
>
>> Hi ,
>> I am using spark 1.4 with direct kafka api . In my streaming ui , I am
>> able to see the events listed in UI only if add stream.print() statements
>> or else event rate and input events remains in 0 eventhough the events gets
>> processed.
>>
>> Without print statements , I have the action saveToCassandra in the
>> dstream.
>>
>> Any reasons why is this not working ?
>>
>> Thanks
>> Vimal
>>
>
>
Re: spark streaming web ui not showing the events - direct kafka api
Posted by Cody Koeninger <co...@koeninger.org>.
There have been changes to visibility of info in ui between 1.4 and 1.5, I
can't say off the top of my head at which point versions they took place.
On Thu, Feb 4, 2016 at 12:07 AM, vimal dinakaran <vi...@gmail.com>
wrote:
> No I am using DSE 4.8 which has spark 1.4. Is this a known issue ?
>
> On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeninger <co...@koeninger.org>
> wrote:
>
>> Have you tried spark 1.5?
>>
>> On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran <vi...@gmail.com>
>> wrote:
>>
>>> Hi ,
>>> I am using spark 1.4 with direct kafka api . In my streaming ui , I am
>>> able to see the events listed in UI only if add stream.print() statements
>>> or else event rate and input events remains in 0 eventhough the events gets
>>> processed.
>>>
>>> Without print statements , I have the action saveToCassandra in the
>>> dstream.
>>>
>>> Any reasons why is this not working ?
>>>
>>> Thanks
>>> Vimal
>>>
>>
>>
>