You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by Nick Allen <ni...@nickallen.org> on 2017/12/19 15:03:09 UTC
[DISCUSS] Stellar in a Zeppelin Notebook
(1) I love the REPL, but I hate how inaccessible it is.
(2) I love our use cases
<https://github.com/apache/metron/tree/master/use-cases/geographic_login_outliers>
and
examples
<https://github.com/apache/metron/tree/master/metron-analytics/metron-profiler#creating-profiles>,
but I hate how difficult it is for a new user to run them.
(3) I love the extensibility of Metron, but I hate looking at JSON.
(4) I love the Profiler, but I hate not being able to *see* my profiles as
plots.
...
Let me introduce, Stellar running in a Zeppelin Notebook.
(1) Access the REPL from any web browser.
(2) Create executable use cases that can be easily shared between users.
(3) Use the simpler management functions to interact with Metron (less
JSON).
(4) Extract your profiles and create a time series plot.
[image: Inline image 1]
The screenshot above is a very lightweight MVP showing that we can run
Stellar from Zeppelin. I have a lot more work ahead in refactoring the
existing Stellar Shell/REPL functionality so that we get the same
experience in Zeppelin as we get on the command line.
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by Nick Allen <ni...@nickallen.org>.
FYI - The PR for Stellar in a Notebook is open, if anyone is interested.
https://github.com/apache/metron/pull/884
On Wed, Dec 20, 2017 at 10:06 AM, Zeolla@GMail.com <ze...@gmail.com> wrote:
> This is some awesome work, I'm looking forward to being able to play with
> it.
>
> Jon
>
> On Tue, Dec 19, 2017 at 1:12 PM Nick Allen <ni...@nickallen.org> wrote:
>
> > Yes, I definitely want auto-complete also.
> >
> > I am factoring out some of the logic you did for auto-complete in the
> REPL
> > in hopes of being able to apply that in Zeppelin. I believe I saw
> > references in the other Zeppelin interpreters for handling auto-complete,
> > but I'll have to research it a bit more.
> >
> > On Tue, Dec 19, 2017 at 1:07 PM, Casey Stella <ce...@gmail.com>
> wrote:
> >
> > > I love it! I wonder if we could get more of the REPL-like experience
> > > (i.e. I crave autocomplete ;) if we integrated it with jquery shell
> like
> > > they did with nanook (https://github.com/aeshell/nanook). I know
> > > zeppelin lets you integrate with more complex javascript. Regardless,
> > > this is awesome, great job!
> > >
> > > On Tue, Dec 19, 2017 at 12:44 PM, Otto Fowler <ottobackwards@gmail.com
> >
> > > wrote:
> > >
> > >> That looks great!
> > >>
> > >>
> > >> On December 19, 2017 at 12:34:47, Nick Allen (nick@nickallen.org)
> > wrote:
> > >>
> > >> Ah, dang. Hopefully this works...
> > >>
> > >> https://www.dropbox.com/s/44qz3518dn4jtzq/Stellar%20in%20a%
> > >> 20Zeppelin%20Notebook.png?dl=0
> > >>
> > >> On Tue, Dec 19, 2017 at 10:23 AM, Otto Fowler <
> ottobackwards@gmail.com>
> > >> wrote:
> > >>
> > >> > The image is stripped for me, can you post it as a link?
> > >> >
> > >> > This seems like it would look awesome ;)
> > >> >
> > >> >
> > >> > On December 19, 2017 at 10:03:26, Nick Allen (nick@nickallen.org)
> > >> wrote:
> > >> >
> > >> > (1) I love the REPL, but I hate how inaccessible it is.
> > >> >
> > >> > (2) I love our use cases
> > >> > <https://github.com/apache/metron/tree/master/use-cases/geog
> > >> raphic_login_outliers> and
> > >> > examples
> > >> > <https://github.com/apache/metron/tree/master/metron-analyti
> > >> cs/metron-profiler#creating-profiles>,
> > >> > but I hate how difficult it is for a new user to run them.
> > >> >
> > >> > (3) I love the extensibility of Metron, but I hate looking at JSON.
> > >> >
> > >> > (4) I love the Profiler, but I hate not being able to *see* my
> > profiles
> > >> as
> > >> > plots.
> > >> >
> > >> > ...
> > >> >
> > >> > Let me introduce, Stellar running in a Zeppelin Notebook.
> > >> >
> > >> > (1) Access the REPL from any web browser.
> > >> >
> > >> > (2) Create executable use cases that can be easily shared between
> > users.
> > >> >
> > >> > (3) Use the simpler management functions to interact with Metron
> (less
> > >> > JSON).
> > >> >
> > >> > (4) Extract your profiles and create a time series plot.
> > >> >
> > >> >
> > >> >
> > >> > [image: Inline image 1]
> > >> > The screenshot above is a very lightweight MVP showing that we can
> run
> > >> > Stellar from Zeppelin. I have a lot more work ahead in refactoring
> > the
> > >> > existing Stellar Shell/REPL functionality so that we get the same
> > >> > experience in Zeppelin as we get on the command line.
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >
> > >>
> > >
> > >
> >
> --
>
> Jon
>
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by "Zeolla@GMail.com" <ze...@gmail.com>.
This is some awesome work, I'm looking forward to being able to play with
it.
Jon
On Tue, Dec 19, 2017 at 1:12 PM Nick Allen <ni...@nickallen.org> wrote:
> Yes, I definitely want auto-complete also.
>
> I am factoring out some of the logic you did for auto-complete in the REPL
> in hopes of being able to apply that in Zeppelin. I believe I saw
> references in the other Zeppelin interpreters for handling auto-complete,
> but I'll have to research it a bit more.
>
> On Tue, Dec 19, 2017 at 1:07 PM, Casey Stella <ce...@gmail.com> wrote:
>
> > I love it! I wonder if we could get more of the REPL-like experience
> > (i.e. I crave autocomplete ;) if we integrated it with jquery shell like
> > they did with nanook (https://github.com/aeshell/nanook). I know
> > zeppelin lets you integrate with more complex javascript. Regardless,
> > this is awesome, great job!
> >
> > On Tue, Dec 19, 2017 at 12:44 PM, Otto Fowler <ot...@gmail.com>
> > wrote:
> >
> >> That looks great!
> >>
> >>
> >> On December 19, 2017 at 12:34:47, Nick Allen (nick@nickallen.org)
> wrote:
> >>
> >> Ah, dang. Hopefully this works...
> >>
> >> https://www.dropbox.com/s/44qz3518dn4jtzq/Stellar%20in%20a%
> >> 20Zeppelin%20Notebook.png?dl=0
> >>
> >> On Tue, Dec 19, 2017 at 10:23 AM, Otto Fowler <ot...@gmail.com>
> >> wrote:
> >>
> >> > The image is stripped for me, can you post it as a link?
> >> >
> >> > This seems like it would look awesome ;)
> >> >
> >> >
> >> > On December 19, 2017 at 10:03:26, Nick Allen (nick@nickallen.org)
> >> wrote:
> >> >
> >> > (1) I love the REPL, but I hate how inaccessible it is.
> >> >
> >> > (2) I love our use cases
> >> > <https://github.com/apache/metron/tree/master/use-cases/geog
> >> raphic_login_outliers> and
> >> > examples
> >> > <https://github.com/apache/metron/tree/master/metron-analyti
> >> cs/metron-profiler#creating-profiles>,
> >> > but I hate how difficult it is for a new user to run them.
> >> >
> >> > (3) I love the extensibility of Metron, but I hate looking at JSON.
> >> >
> >> > (4) I love the Profiler, but I hate not being able to *see* my
> profiles
> >> as
> >> > plots.
> >> >
> >> > ...
> >> >
> >> > Let me introduce, Stellar running in a Zeppelin Notebook.
> >> >
> >> > (1) Access the REPL from any web browser.
> >> >
> >> > (2) Create executable use cases that can be easily shared between
> users.
> >> >
> >> > (3) Use the simpler management functions to interact with Metron (less
> >> > JSON).
> >> >
> >> > (4) Extract your profiles and create a time series plot.
> >> >
> >> >
> >> >
> >> > [image: Inline image 1]
> >> > The screenshot above is a very lightweight MVP showing that we can run
> >> > Stellar from Zeppelin. I have a lot more work ahead in refactoring
> the
> >> > existing Stellar Shell/REPL functionality so that we get the same
> >> > experience in Zeppelin as we get on the command line.
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >>
> >
> >
>
--
Jon
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by Nick Allen <ni...@nickallen.org>.
Yes, I definitely want auto-complete also.
I am factoring out some of the logic you did for auto-complete in the REPL
in hopes of being able to apply that in Zeppelin. I believe I saw
references in the other Zeppelin interpreters for handling auto-complete,
but I'll have to research it a bit more.
On Tue, Dec 19, 2017 at 1:07 PM, Casey Stella <ce...@gmail.com> wrote:
> I love it! I wonder if we could get more of the REPL-like experience
> (i.e. I crave autocomplete ;) if we integrated it with jquery shell like
> they did with nanook (https://github.com/aeshell/nanook). I know
> zeppelin lets you integrate with more complex javascript. Regardless,
> this is awesome, great job!
>
> On Tue, Dec 19, 2017 at 12:44 PM, Otto Fowler <ot...@gmail.com>
> wrote:
>
>> That looks great!
>>
>>
>> On December 19, 2017 at 12:34:47, Nick Allen (nick@nickallen.org) wrote:
>>
>> Ah, dang. Hopefully this works...
>>
>> https://www.dropbox.com/s/44qz3518dn4jtzq/Stellar%20in%20a%
>> 20Zeppelin%20Notebook.png?dl=0
>>
>> On Tue, Dec 19, 2017 at 10:23 AM, Otto Fowler <ot...@gmail.com>
>> wrote:
>>
>> > The image is stripped for me, can you post it as a link?
>> >
>> > This seems like it would look awesome ;)
>> >
>> >
>> > On December 19, 2017 at 10:03:26, Nick Allen (nick@nickallen.org)
>> wrote:
>> >
>> > (1) I love the REPL, but I hate how inaccessible it is.
>> >
>> > (2) I love our use cases
>> > <https://github.com/apache/metron/tree/master/use-cases/geog
>> raphic_login_outliers> and
>> > examples
>> > <https://github.com/apache/metron/tree/master/metron-analyti
>> cs/metron-profiler#creating-profiles>,
>> > but I hate how difficult it is for a new user to run them.
>> >
>> > (3) I love the extensibility of Metron, but I hate looking at JSON.
>> >
>> > (4) I love the Profiler, but I hate not being able to *see* my profiles
>> as
>> > plots.
>> >
>> > ...
>> >
>> > Let me introduce, Stellar running in a Zeppelin Notebook.
>> >
>> > (1) Access the REPL from any web browser.
>> >
>> > (2) Create executable use cases that can be easily shared between users.
>> >
>> > (3) Use the simpler management functions to interact with Metron (less
>> > JSON).
>> >
>> > (4) Extract your profiles and create a time series plot.
>> >
>> >
>> >
>> > [image: Inline image 1]
>> > The screenshot above is a very lightweight MVP showing that we can run
>> > Stellar from Zeppelin. I have a lot more work ahead in refactoring the
>> > existing Stellar Shell/REPL functionality so that we get the same
>> > experience in Zeppelin as we get on the command line.
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>>
>
>
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by Casey Stella <ce...@gmail.com>.
I love it! I wonder if we could get more of the REPL-like experience (i.e.
I crave autocomplete ;) if we integrated it with jquery shell like they did
with nanook (https://github.com/aeshell/nanook). I know zeppelin lets you
integrate with more complex javascript. Regardless, this is awesome,
great job!
On Tue, Dec 19, 2017 at 12:44 PM, Otto Fowler <ot...@gmail.com>
wrote:
> That looks great!
>
>
> On December 19, 2017 at 12:34:47, Nick Allen (nick@nickallen.org) wrote:
>
> Ah, dang. Hopefully this works...
>
> https://www.dropbox.com/s/44qz3518dn4jtzq/Stellar%20in%
> 20a%20Zeppelin%20Notebook.png?dl=0
>
> On Tue, Dec 19, 2017 at 10:23 AM, Otto Fowler <ot...@gmail.com>
> wrote:
>
> > The image is stripped for me, can you post it as a link?
> >
> > This seems like it would look awesome ;)
> >
> >
> > On December 19, 2017 at 10:03:26, Nick Allen (nick@nickallen.org) wrote:
> >
> > (1) I love the REPL, but I hate how inaccessible it is.
> >
> > (2) I love our use cases
> > <https://github.com/apache/metron/tree/master/use-cases/
> geographic_login_outliers> and
> > examples
> > <https://github.com/apache/metron/tree/master/metron-
> analytics/metron-profiler#creating-profiles>,
> > but I hate how difficult it is for a new user to run them.
> >
> > (3) I love the extensibility of Metron, but I hate looking at JSON.
> >
> > (4) I love the Profiler, but I hate not being able to *see* my profiles
> as
> > plots.
> >
> > ...
> >
> > Let me introduce, Stellar running in a Zeppelin Notebook.
> >
> > (1) Access the REPL from any web browser.
> >
> > (2) Create executable use cases that can be easily shared between users.
> >
> > (3) Use the simpler management functions to interact with Metron (less
> > JSON).
> >
> > (4) Extract your profiles and create a time series plot.
> >
> >
> >
> > [image: Inline image 1]
> > The screenshot above is a very lightweight MVP showing that we can run
> > Stellar from Zeppelin. I have a lot more work ahead in refactoring the
> > existing Stellar Shell/REPL functionality so that we get the same
> > experience in Zeppelin as we get on the command line.
> >
> >
> >
> >
> >
> >
> >
> >
>
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by Otto Fowler <ot...@gmail.com>.
That looks great!
On December 19, 2017 at 12:34:47, Nick Allen (nick@nickallen.org) wrote:
Ah, dang. Hopefully this works...
https://www.dropbox.com/s/44qz3518dn4jtzq/Stellar%20in%20a%20Zeppelin%20Notebook.png?dl=0
On Tue, Dec 19, 2017 at 10:23 AM, Otto Fowler <ot...@gmail.com>
wrote:
> The image is stripped for me, can you post it as a link?
>
> This seems like it would look awesome ;)
>
>
> On December 19, 2017 at 10:03:26, Nick Allen (nick@nickallen.org) wrote:
>
> (1) I love the REPL, but I hate how inaccessible it is.
>
> (2) I love our use cases
> <https://github.com/apache/metron/tree/master/use-cases/geographic_login_outliers> and
> examples
> <https://github.com/apache/metron/tree/master/metron-analytics/metron-profiler#creating-profiles>,
> but I hate how difficult it is for a new user to run them.
>
> (3) I love the extensibility of Metron, but I hate looking at JSON.
>
> (4) I love the Profiler, but I hate not being able to *see* my profiles as
> plots.
>
> ...
>
> Let me introduce, Stellar running in a Zeppelin Notebook.
>
> (1) Access the REPL from any web browser.
>
> (2) Create executable use cases that can be easily shared between users.
>
> (3) Use the simpler management functions to interact with Metron (less
> JSON).
>
> (4) Extract your profiles and create a time series plot.
>
>
>
> [image: Inline image 1]
> The screenshot above is a very lightweight MVP showing that we can run
> Stellar from Zeppelin. I have a lot more work ahead in refactoring the
> existing Stellar Shell/REPL functionality so that we get the same
> experience in Zeppelin as we get on the command line.
>
>
>
>
>
>
>
>
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by Nick Allen <ni...@nickallen.org>.
Ah, dang. Hopefully this works...
https://www.dropbox.com/s/44qz3518dn4jtzq/Stellar%20in%20a%20Zeppelin%20Notebook.png?dl=0
On Tue, Dec 19, 2017 at 10:23 AM, Otto Fowler <ot...@gmail.com>
wrote:
> The image is stripped for me, can you post it as a link?
>
> This seems like it would look awesome ;)
>
>
> On December 19, 2017 at 10:03:26, Nick Allen (nick@nickallen.org) wrote:
>
> (1) I love the REPL, but I hate how inaccessible it is.
>
> (2) I love our use cases
> <https://github.com/apache/metron/tree/master/use-cases/geographic_login_outliers> and
> examples
> <https://github.com/apache/metron/tree/master/metron-analytics/metron-profiler#creating-profiles>,
> but I hate how difficult it is for a new user to run them.
>
> (3) I love the extensibility of Metron, but I hate looking at JSON.
>
> (4) I love the Profiler, but I hate not being able to *see* my profiles as
> plots.
>
> ...
>
> Let me introduce, Stellar running in a Zeppelin Notebook.
>
> (1) Access the REPL from any web browser.
>
> (2) Create executable use cases that can be easily shared between users.
>
> (3) Use the simpler management functions to interact with Metron (less
> JSON).
>
> (4) Extract your profiles and create a time series plot.
>
>
>
> [image: Inline image 1]
> The screenshot above is a very lightweight MVP showing that we can run
> Stellar from Zeppelin. I have a lot more work ahead in refactoring the
> existing Stellar Shell/REPL functionality so that we get the same
> experience in Zeppelin as we get on the command line.
>
>
>
>
>
>
>
>
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by Otto Fowler <ot...@gmail.com>.
The image is stripped for me, can you post it as a link?
This seems like it would look awesome ;)
On December 19, 2017 at 10:03:26, Nick Allen (nick@nickallen.org) wrote:
(1) I love the REPL, but I hate how inaccessible it is.
(2) I love our use cases
<https://github.com/apache/metron/tree/master/use-cases/geographic_login_outliers>
and
examples
<https://github.com/apache/metron/tree/master/metron-analytics/metron-profiler#creating-profiles>,
but I hate how difficult it is for a new user to run them.
(3) I love the extensibility of Metron, but I hate looking at JSON.
(4) I love the Profiler, but I hate not being able to *see* my profiles as
plots.
...
Let me introduce, Stellar running in a Zeppelin Notebook.
(1) Access the REPL from any web browser.
(2) Create executable use cases that can be easily shared between users.
(3) Use the simpler management functions to interact with Metron (less
JSON).
(4) Extract your profiles and create a time series plot.
[image: Inline image 1]
The screenshot above is a very lightweight MVP showing that we can run
Stellar from Zeppelin. I have a lot more work ahead in refactoring the
existing Stellar Shell/REPL functionality so that we get the same
experience in Zeppelin as we get on the command line.
Re: [DISCUSS] Stellar in a Zeppelin Notebook
Posted by Laurens Vets <la...@daemon.be>.
On 2017-12-19 07:03, Nick Allen wrote:
> (1) I love the REPL, but I hate how inaccessible it is.
>
> (2) I love our use cases [1] and examples [2], but I hate how difficult it is for a new user to run them.
>
> (3) I love the extensibility of Metron, but I hate looking at JSON.
>
> (4) I love the Profiler, but I hate not being able to *see* my profiles as plots.
>
> ...
>
> Let me introduce, Stellar running in a Zeppelin Notebook.
>
>> (1) Access the REPL from any web browser.
>>
>> (2) Create executable use cases that can be easily shared between users.
>>
>> (3) Use the simpler management functions to interact with Metron (less JSON).
>>
>> (4) Extract your profiles and create a time series plot.
>
> The screenshot above is a very lightweight MVP showing that we can run Stellar from Zeppelin. I have a lot more work ahead in refactoring the existing Stellar Shell/REPL functionality so that we get the same experience in Zeppelin as we get on the command line.
I love your screenshot :D
On a more serious note, I wanted to add the examples and use cases to
the installation documentation somehow (maybe as an addendum?) in the
future.
Links:
------
[1]
https://github.com/apache/metron/tree/master/use-cases/geographic_login_outliers
[2]
https://github.com/apache/metron/tree/master/metron-analytics/metron-profiler#creating-profiles