You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by kant kodali <ka...@gmail.com> on 2016/09/07 07:00:32 UTC
Re: is there way to push stream of updates to Zeppelin dashboard
as they come in ?
Hi Moon,
I don't see any websocket connection from the code you sent so I wonder how is
it getting push updates?
Thanks,Kant
On Wed, Aug 24, 2016 4:27 AM, moon soo Lee moon@apache.org
wrote:
Hi,
Regarding push update result,
https://gist.github.com/granturing/a09aed4a302a7367be92
can be an interesting example. Which push update map from tweet stream.
Thanks,
moon
On Wed, Aug 24, 2016 at 4:25 AM kant kodali <ka...@gmail.com> wrote:
> Hi Guys,
> is there way to push stream of updates to Zeppelin dashboard ? for example
> I get bunch of data to my
> spark streaming cluster and as I get more and more data I want to compute
> and
> write it somewhere such that my Zeppelin dashboard is updated? If so, where
> would be the best place to write the latest results? and how can the
> dashboard
> be updated automatically (more like push not pull)?
> Thanks,
>
> Kant
Re: is there way to push stream of updates to Zeppelin dashboard as
they come in ?
Posted by Corneau Damien <co...@gmail.com>.
I explained the workflow a bit more on the other thread.
The front-end react to what the server is sending to him. (through
websocket)
So in the end it's more of a processing issue and
Zeppelin-server/Interpreter communication one.
If you could tell more about the stream updates (technology-wise) you are
talking about, we could maybe help you more with it.
Maybe it would need a special interpreter, maybe you can use an existing
one, maybe an interpreter needs to be modified to handle that case.
On Thu, Sep 8, 2016 at 10:37 AM, kant kodali <ka...@gmail.com> wrote:
> Hi Corneau,
>
> I still don't quite understand (probably because I am more of a backend
> engineer). All I want to know is how do I need connect my data that I get
> from my websocket to the charts? other words I shouldn't be writing code to
> build charts (like bar, pie and so on) I should be able to tell zeppellin
> that "here is my latest data that I got from websocket please show me a bar
> graph or pie chart" and so on. is that possible?
>
> Thanks,
> Kant
>
> On Wed, Sep 7, 2016 at 6:10 PM, Corneau Damien <co...@gmail.com>
> wrote:
>
> > Hi Kant,
> >
> > The front-end react to multiple websocket events sent by the server to
> > update its content.
> > The most usual events regarding the paragraph rendering would be "NOTE"
> and
> > "PARAGRAPH"
> > However those are handled by the server itself.
> >
> > The latest link from moon is a good example on how it can be achieved to
> > some degree, however it is meant for custom visualizations.
> >
> >
> > On Thu, Sep 8, 2016 at 4:03 AM, kant kodali <ka...@gmail.com> wrote:
> >
> > > Hi Moon,
> > > When I receive the events through a websocket from a server how can I
> use
> > > Zeppelin charts (The charts that get generated after running a sql
> > command
> > > per
> > > say) to display it ?
> > > Thanks,Kant
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Sep 7, 2016 8:02 AM, moon soo Lee moon@apache.org
> > >
> > > wrote:
> > > You can check
> > >
> > > http://zeppelin.apache.org/docs/latest/displaysystem/
> > back-end-angular.html
> > > to
> > >
> > > how front-end / back-end can exchange data and events.
> > >
> > >
> > >
> > >
> > > Thanks,
> > >
> > > moon
> > >
> > >
> > >
> > >
> > > On Wed, Sep 7, 2016 at 12:00 AM kant kodali <ka...@gmail.com>
> wrote:
> > >
> > >
> > >
> > >
> > > Hi Moon,
> > >>
> > >
> > > I don't see any websocket connection from the code you sent so I wonder
> > >>
> > >
> > > how is
> > >>
> > >
> > > it getting push updates?
> > >>
> > >
> > > Thanks,Kant
> > >>
> > >
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > > On Wed, Aug 24, 2016 4:27 AM, moon soo Lee moon@apache.org
> > >>
> > >
> > > wrote:
> > >>
> > >
> > > Hi,
> > >>
> > >
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > > Regarding push update result,
> > >>
> > >
> > >
> > >>
> > > https://gist.github.com/granturing/a09aed4a302a7367be92
> > >>
> > >
> > >
> > >>
> > > can be an interesting example. Which push update map from tweet stream.
> > >>
> > >
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > > Thanks,
> > >>
> > >
> > >
> > >>
> > > moon
> > >>
> > >
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > > On Wed, Aug 24, 2016 at 4:25 AM kant kodali <ka...@gmail.com>
> wrote:
> > >>
> > >
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > >
> > >>
> > > > Hi Guys,
> > >>
> > >
> > >
> > >>
> > > > is there way to push stream of updates to Zeppelin dashboard ? for
> > >>
> > >
> > > example
> > >>
> > >
> > >
> > >>
> > > > I get bunch of data to my
> > >>
> > >
> > >
> > >>
> > > > spark streaming cluster and as I get more and more data I want to
> > compute
> > >>
> > >
> > >
> > >>
> > > > and
> > >>
> > >
> > >
> > >>
> > > > write it somewhere such that my Zeppelin dashboard is updated? If so,
> > >>
> > >
> > > where
> > >>
> > >
> > >
> > >>
> > > > would be the best place to write the latest results? and how can the
> > >>
> > >
> > >
> > >>
> > > > dashboard
> > >>
> > >
> > >
> > >>
> > > > be updated automatically (more like push not pull)?
> > >>
> > >
> > >
> > >>
> > > > Thanks,
> > >>
> > >
> > >
> > >>
> > > >
> > >>
> > >
> > >
> > >>
> > > > Kant
> > >
> > >
> >
>
Re: is there way to push stream of updates to Zeppelin dashboard as
they come in ?
Posted by kant kodali <ka...@gmail.com>.
Hi Corneau,
I still don't quite understand (probably because I am more of a backend
engineer). All I want to know is how do I need connect my data that I get
from my websocket to the charts? other words I shouldn't be writing code to
build charts (like bar, pie and so on) I should be able to tell zeppellin
that "here is my latest data that I got from websocket please show me a bar
graph or pie chart" and so on. is that possible?
Thanks,
Kant
On Wed, Sep 7, 2016 at 6:10 PM, Corneau Damien <co...@gmail.com> wrote:
> Hi Kant,
>
> The front-end react to multiple websocket events sent by the server to
> update its content.
> The most usual events regarding the paragraph rendering would be "NOTE" and
> "PARAGRAPH"
> However those are handled by the server itself.
>
> The latest link from moon is a good example on how it can be achieved to
> some degree, however it is meant for custom visualizations.
>
>
> On Thu, Sep 8, 2016 at 4:03 AM, kant kodali <ka...@gmail.com> wrote:
>
> > Hi Moon,
> > When I receive the events through a websocket from a server how can I use
> > Zeppelin charts (The charts that get generated after running a sql
> command
> > per
> > say) to display it ?
> > Thanks,Kant
> >
> >
> >
> >
> >
> >
> > On Wed, Sep 7, 2016 8:02 AM, moon soo Lee moon@apache.org
> >
> > wrote:
> > You can check
> >
> > http://zeppelin.apache.org/docs/latest/displaysystem/
> back-end-angular.html
> > to
> >
> > how front-end / back-end can exchange data and events.
> >
> >
> >
> >
> > Thanks,
> >
> > moon
> >
> >
> >
> >
> > On Wed, Sep 7, 2016 at 12:00 AM kant kodali <ka...@gmail.com> wrote:
> >
> >
> >
> >
> > Hi Moon,
> >>
> >
> > I don't see any websocket connection from the code you sent so I wonder
> >>
> >
> > how is
> >>
> >
> > it getting push updates?
> >>
> >
> > Thanks,Kant
> >>
> >
> >
> >>
> >
> >>
> >
> >>
> >
> >>
> >
> >>
> >
> >>
> > On Wed, Aug 24, 2016 4:27 AM, moon soo Lee moon@apache.org
> >>
> >
> > wrote:
> >>
> >
> > Hi,
> >>
> >
> >
> >>
> >
> >>
> >
> >>
> >
> >>
> > Regarding push update result,
> >>
> >
> >
> >>
> > https://gist.github.com/granturing/a09aed4a302a7367be92
> >>
> >
> >
> >>
> > can be an interesting example. Which push update map from tweet stream.
> >>
> >
> >
> >>
> >
> >>
> >
> >>
> >
> >>
> > Thanks,
> >>
> >
> >
> >>
> > moon
> >>
> >
> >
> >>
> >
> >>
> >
> >>
> >
> >>
> > On Wed, Aug 24, 2016 at 4:25 AM kant kodali <ka...@gmail.com> wrote:
> >>
> >
> >
> >>
> >
> >>
> >
> >>
> >
> >>
> > > Hi Guys,
> >>
> >
> >
> >>
> > > is there way to push stream of updates to Zeppelin dashboard ? for
> >>
> >
> > example
> >>
> >
> >
> >>
> > > I get bunch of data to my
> >>
> >
> >
> >>
> > > spark streaming cluster and as I get more and more data I want to
> compute
> >>
> >
> >
> >>
> > > and
> >>
> >
> >
> >>
> > > write it somewhere such that my Zeppelin dashboard is updated? If so,
> >>
> >
> > where
> >>
> >
> >
> >>
> > > would be the best place to write the latest results? and how can the
> >>
> >
> >
> >>
> > > dashboard
> >>
> >
> >
> >>
> > > be updated automatically (more like push not pull)?
> >>
> >
> >
> >>
> > > Thanks,
> >>
> >
> >
> >>
> > >
> >>
> >
> >
> >>
> > > Kant
> >
> >
>
Re: is there way to push stream of updates to Zeppelin dashboard as
they come in ?
Posted by Corneau Damien <co...@gmail.com>.
Hi Kant,
The front-end react to multiple websocket events sent by the server to
update its content.
The most usual events regarding the paragraph rendering would be "NOTE" and
"PARAGRAPH"
However those are handled by the server itself.
The latest link from moon is a good example on how it can be achieved to
some degree, however it is meant for custom visualizations.
On Thu, Sep 8, 2016 at 4:03 AM, kant kodali <ka...@gmail.com> wrote:
> Hi Moon,
> When I receive the events through a websocket from a server how can I use
> Zeppelin charts (The charts that get generated after running a sql command
> per
> say) to display it ?
> Thanks,Kant
>
>
>
>
>
>
> On Wed, Sep 7, 2016 8:02 AM, moon soo Lee moon@apache.org
>
> wrote:
> You can check
>
> http://zeppelin.apache.org/docs/latest/displaysystem/back-end-angular.html
> to
>
> how front-end / back-end can exchange data and events.
>
>
>
>
> Thanks,
>
> moon
>
>
>
>
> On Wed, Sep 7, 2016 at 12:00 AM kant kodali <ka...@gmail.com> wrote:
>
>
>
>
> Hi Moon,
>>
>
> I don't see any websocket connection from the code you sent so I wonder
>>
>
> how is
>>
>
> it getting push updates?
>>
>
> Thanks,Kant
>>
>
>
>>
>
>>
>
>>
>
>>
>
>>
>
>>
> On Wed, Aug 24, 2016 4:27 AM, moon soo Lee moon@apache.org
>>
>
> wrote:
>>
>
> Hi,
>>
>
>
>>
>
>>
>
>>
>
>>
> Regarding push update result,
>>
>
>
>>
> https://gist.github.com/granturing/a09aed4a302a7367be92
>>
>
>
>>
> can be an interesting example. Which push update map from tweet stream.
>>
>
>
>>
>
>>
>
>>
>
>>
> Thanks,
>>
>
>
>>
> moon
>>
>
>
>>
>
>>
>
>>
>
>>
> On Wed, Aug 24, 2016 at 4:25 AM kant kodali <ka...@gmail.com> wrote:
>>
>
>
>>
>
>>
>
>>
>
>>
> > Hi Guys,
>>
>
>
>>
> > is there way to push stream of updates to Zeppelin dashboard ? for
>>
>
> example
>>
>
>
>>
> > I get bunch of data to my
>>
>
>
>>
> > spark streaming cluster and as I get more and more data I want to compute
>>
>
>
>>
> > and
>>
>
>
>>
> > write it somewhere such that my Zeppelin dashboard is updated? If so,
>>
>
> where
>>
>
>
>>
> > would be the best place to write the latest results? and how can the
>>
>
>
>>
> > dashboard
>>
>
>
>>
> > be updated automatically (more like push not pull)?
>>
>
>
>>
> > Thanks,
>>
>
>
>>
> >
>>
>
>
>>
> > Kant
>
>
Re: is there way to push stream of updates to Zeppelin dashboard
as they come in ?
Posted by kant kodali <ka...@gmail.com>.
Hi Moon,
When I receive the events through a websocket from a server how can I use
Zeppelin charts (The charts that get generated after running a sql command per
say) to display it ?
Thanks,Kant
On Wed, Sep 7, 2016 8:02 AM, moon soo Lee moon@apache.org
wrote:
You can check
http://zeppelin.apache.org/docs/latest/displaysystem/back-end-angular.html to
how front-end / back-end can exchange data and events.
Thanks,
moon
On Wed, Sep 7, 2016 at 12:00 AM kant kodali <ka...@gmail.com> wrote:
> Hi Moon,
> I don't see any websocket connection from the code you sent so I wonder
> how is
> it getting push updates?
> Thanks,Kant
>
>
>
>
>
>
> On Wed, Aug 24, 2016 4:27 AM, moon soo Lee moon@apache.org
> wrote:
> Hi,
>
>
>
>
> Regarding push update result,
>
> https://gist.github.com/granturing/a09aed4a302a7367be92
>
> can be an interesting example. Which push update map from tweet stream.
>
>
>
>
> Thanks,
>
> moon
>
>
>
>
> On Wed, Aug 24, 2016 at 4:25 AM kant kodali <ka...@gmail.com> wrote:
>
>
>
>
> > Hi Guys,
>
> > is there way to push stream of updates to Zeppelin dashboard ? for
> example
>
> > I get bunch of data to my
>
> > spark streaming cluster and as I get more and more data I want to compute
>
> > and
>
> > write it somewhere such that my Zeppelin dashboard is updated? If so,
> where
>
> > would be the best place to write the latest results? and how can the
>
> > dashboard
>
> > be updated automatically (more like push not pull)?
>
> > Thanks,
>
> >
>
> > Kant
Re: is there way to push stream of updates to Zeppelin dashboard as
they come in ?
Posted by moon soo Lee <mo...@apache.org>.
You can check
http://zeppelin.apache.org/docs/latest/displaysystem/back-end-angular.html to
how front-end / back-end can exchange data and events.
Thanks,
moon
On Wed, Sep 7, 2016 at 12:00 AM kant kodali <ka...@gmail.com> wrote:
> Hi Moon,
> I don't see any websocket connection from the code you sent so I wonder
> how is
> it getting push updates?
> Thanks,Kant
>
>
>
>
>
>
> On Wed, Aug 24, 2016 4:27 AM, moon soo Lee moon@apache.org
> wrote:
> Hi,
>
>
>
>
> Regarding push update result,
>
> https://gist.github.com/granturing/a09aed4a302a7367be92
>
> can be an interesting example. Which push update map from tweet stream.
>
>
>
>
> Thanks,
>
> moon
>
>
>
>
> On Wed, Aug 24, 2016 at 4:25 AM kant kodali <ka...@gmail.com> wrote:
>
>
>
>
> > Hi Guys,
>
> > is there way to push stream of updates to Zeppelin dashboard ? for
> example
>
> > I get bunch of data to my
>
> > spark streaming cluster and as I get more and more data I want to compute
>
> > and
>
> > write it somewhere such that my Zeppelin dashboard is updated? If so,
> where
>
> > would be the best place to write the latest results? and how can the
>
> > dashboard
>
> > be updated automatically (more like push not pull)?
>
> > Thanks,
>
> >
>
> > Kant