You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by Alexander Shoshin <Al...@epam.com> on 2016/12/08 15:25:48 UTC

Notebook example

Hi everyone.

I want to become a Zeppelin contributor. Before starting to fix issues I decided to make an example of a notebook to become understand Zeppelin better :). I chose Apache Flink as a main Interpreter for my example because there are not so many examples of "Zeppelin on Flink" usage. I think it also may be helpful for your community according to https://issues.apache.org/jira/browse/ZEPPELIN-684, so here is the link: https://github.com/AlexanderShoshin/zeppelin-example

I am ready to make any kind of corrections in this example.

Regards,
Alexander

RE: Notebook example

Posted by Alexander Shoshin <Al...@epam.com>.
Hi Trevor.

Your notebooks look very interesting for me. Especially about data sharing between different interpreters. I think it might be helpful for people who starts working with Zeppelin.

But it seems to me that we should better add them with different pull requests linked to different issues. I will correct “Flink example” in my issue description to “Flink Batching example”. So you could create an issue for Flink Streaming and others.

Regards,
Alexander


From: Trevor Grant [mailto:trevor.d.grant@gmail.com]
Sent: Tuesday, December 13, 2016 6:20 PM
To: dev@zeppelin.apache.org
Subject: Re: Notebook example

Nice work.
If we're going to do this- I have a couple of Zeppelin+Flink examples from flink forward I'd like to chip in to this- one on using Flink's streaming context, and one on visualizing Flink-Gelly with d3js (leveraging Zeppelin), and one on using resource pools with Flink
Alexander Shoshin, do you have that notebook on a branch in your local repo? If so I'll open a PR against your branch and you can merge my two examples in- or, I've attached them.
For the Gelly and the streaming to work you have to load a couple of libraries (twitter and the Gelly library).
I don't think %dep ever got to working with the Flink interpreter (for various reasons, Flink cluster still throws a hissy fit when you try to load libraries via zeppelin).  Maybe some mark down at the top about which libraries you need to add.

At any rate, A Flink Tutorial notebook would be a nice place for these to live imho.

Trevor Grant
Data Scientist
https://github.com/rawkintrevo
http://stackexchange.com/users/3002022/rawkintrevo
http://trevorgrant.org

"Fortunate is he, who is able to know the causes of things."  -Virgil


On Mon, Dec 12, 2016 at 8:35 PM, Alexander Bezzubov <bz...@apache.org>> wrote:
Done! Now you should be able to assign all further issues.

Thank you for contribution, the notebook looks great, and here is how it
looks like in case people want to see it "in action" [1]

Please, feel free to check other open issues in Zeppelin JIRA marked \w
'beginner' label [2] for good future contributions ideas!


 1.
https://www.zeppelinhub.com/viewer/notebooks/aHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL0FsZXhhbmRlclNob3NoaW4vemVwcGVsaW4tZXhhbXBsZS9tYXN0ZXIvbm90ZWJvb2tzL0ZsaWdodHMuanNvbg

 2.
https://issues.apache.org/jira/browse/ZEPPELIN-1793?jql=project%20%3D%20ZEPPELIN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22)%20AND%20labels%20%3D%20beginner

--
Alex

On Mon, Dec 12, 2016 at 5:55 PM, Alexander Shoshin <
Alexander_Shoshin@epam.com<ma...@epam.com>> wrote:

> I have created an issue:
> https://issues.apache.org/jira/browse/ZEPPELIN-1787
> but I can't assign it to myself. Could you assign it to me please?
>
> -----Original Message-----
>  From: moon soo Lee [mailto:leemoonsoo@gmail.com<ma...@gmail.com>]
>  Sent: Friday, December 09, 2016 8:49 PM
>  To: dev@zeppelin.apache.org<ma...@zeppelin.apache.org>
>  Subject: Re: Notebook example
>
> > Althought it's not mendentory, creating issue helps track the changes
> such as when
> > code has chaged, which version of zeppelin includes the changes, etc.
> So, please
> > create if you don't mind.
> >
> > Thanks,
> > moon
> > On Fri, 9 Dec 2016 at 11:05 AM Alexander Shoshin <
> Alexander_Shoshin@epam.com<ma...@epam.com>>
> > wrote:
> >
> > > Thanks for reply.
> > >
> > > And do I need to create an issue first? Or I can just make a pull
> > > request for adding a note to tutorial examples?
> > >
> > > Thanks,
> > > Alexander
> > >
> > > > -----Original Message-----
> > > > From: moon soo Lee [mailto:moon@apache.org<ma...@apache.org>]
> > > > Sent: Thursday, December 08, 2016 11:30 PM
> > > > To: dev@zeppelin.apache.org<ma...@zeppelin.apache.org>
> > > > Subject: Re: Notebook example
> > > >
> > > > Hi,
> > > >
> > > > Appreciate for sharing a notebook and considering contribution.
> > > > You can contribute your note as a tutorial under
> > > > https://github.com/apache/zeppelin/tree/master/notebook by making
> > > > pullrequest. So Zeppelin distribution can include notebook. Just
> > > > sharing on the mailing list greatly helps as well if you prefer.
> > > >
> > > > Don't hesitate making pullrequest or asking questions.
> > > >
> > > > Thanks,
> > > > moon
> > > >
> > > > On Thu, Dec 8, 2016 at 10:26 AM Alexander Shoshin <
> > > > Alexander_Shoshin@epam.com<ma...@epam.com>> wrote:
> > > >
> > > > > Hi everyone.
> > > > >
> > > > > I want to become a Zeppelin contributor. Before starting to fix
> > > > > issues I decided to make an example of a notebook to become
> > > > > understand Zeppelin better :). I chose Apache Flink as a main
> > > > > Interpreter for my example because there are not so many examples
> of "Zeppelin on Flink"
> > > > > usage. I think it also may be helpful for your community according
> > > > > to https://issues.apache.org/jira/browse/ZEPPELIN-684, so here is
> > > > > the link:
> > > > > https://github.com/AlexanderShoshin/zeppelin-example
> > > > >
> > > > > I am ready to make any kind of corrections in this example.
> > > > >
> > > > > Regards,
> > > > > Alexander
> > > > >
>


Re: Notebook example

Posted by Trevor Grant <tr...@gmail.com>.
Nice work.

If we're going to do this- I have a couple of Zeppelin+Flink examples from
flink forward I'd like to chip in to this- one on using Flink's streaming
context, and one on visualizing Flink-Gelly with d3js (leveraging
Zeppelin), and one on using resource pools with Flink

Alexander Shoshin, do you have that notebook on a branch in your local
repo? If so I'll open a PR against your branch and you can merge my two
examples in- or, I've attached them.

For the Gelly and the streaming to work you have to load a couple of
libraries (twitter and the Gelly library).

I don't think %dep ever got to working with the Flink interpreter (for
various reasons, Flink cluster still throws a hissy fit when you try to
load libraries via zeppelin).  Maybe some mark down at the top about which
libraries you need to add.

At any rate, A Flink Tutorial notebook would be a nice place for these to
live imho.

Trevor Grant
Data Scientist
https://github.com/rawkintrevo
http://stackexchange.com/users/3002022/rawkintrevo
http://trevorgrant.org

*"Fortunate is he, who is able to know the causes of things."  -Virgil*


On Mon, Dec 12, 2016 at 8:35 PM, Alexander Bezzubov <bz...@apache.org> wrote:

> Done! Now you should be able to assign all further issues.
>
> Thank you for contribution, the notebook looks great, and here is how it
> looks like in case people want to see it "in action" [1]
>
> Please, feel free to check other open issues in Zeppelin JIRA marked \w
> 'beginner' label [2] for good future contributions ideas!
>
>
>  1.
> https://www.zeppelinhub.com/viewer/notebooks/
> aHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL0FsZXhhbmRlclNo
> b3NoaW4vemVwcGVsaW4tZXhhbXBsZS9tYXN0ZXIvbm90ZWJvb2tzL0ZsaWdodHMuanNvbg
>
>  2.
> https://issues.apache.org/jira/browse/ZEPPELIN-1793?jql=
> project%20%3D%20ZEPPELIN%20AND%20status%20in%20(Open%
> 2C%20%22In%20Progress%22)%20AND%20labels%20%3D%20beginner
>
> --
> Alex
>
> On Mon, Dec 12, 2016 at 5:55 PM, Alexander Shoshin <
> Alexander_Shoshin@epam.com> wrote:
>
> > I have created an issue:
> > https://issues.apache.org/jira/browse/ZEPPELIN-1787
> > but I can't assign it to myself. Could you assign it to me please?
> >
> > -----Original Message-----
> >  From: moon soo Lee [mailto:leemoonsoo@gmail.com]
> >  Sent: Friday, December 09, 2016 8:49 PM
> >  To: dev@zeppelin.apache.org
> >  Subject: Re: Notebook example
> >
> > > Althought it's not mendentory, creating issue helps track the changes
> > such as when
> > > code has chaged, which version of zeppelin includes the changes, etc.
> > So, please
> > > create if you don't mind.
> > >
> > > Thanks,
> > > moon
> > > On Fri, 9 Dec 2016 at 11:05 AM Alexander Shoshin <
> > Alexander_Shoshin@epam.com>
> > > wrote:
> > >
> > > > Thanks for reply.
> > > >
> > > > And do I need to create an issue first? Or I can just make a pull
> > > > request for adding a note to tutorial examples?
> > > >
> > > > Thanks,
> > > > Alexander
> > > >
> > > > > -----Original Message-----
> > > > > From: moon soo Lee [mailto:moon@apache.org]
> > > > > Sent: Thursday, December 08, 2016 11:30 PM
> > > > > To: dev@zeppelin.apache.org
> > > > > Subject: Re: Notebook example
> > > > >
> > > > > Hi,
> > > > >
> > > > > Appreciate for sharing a notebook and considering contribution.
> > > > > You can contribute your note as a tutorial under
> > > > > https://github.com/apache/zeppelin/tree/master/notebook by making
> > > > > pullrequest. So Zeppelin distribution can include notebook. Just
> > > > > sharing on the mailing list greatly helps as well if you prefer.
> > > > >
> > > > > Don't hesitate making pullrequest or asking questions.
> > > > >
> > > > > Thanks,
> > > > > moon
> > > > >
> > > > > On Thu, Dec 8, 2016 at 10:26 AM Alexander Shoshin <
> > > > > Alexander_Shoshin@epam.com> wrote:
> > > > >
> > > > > > Hi everyone.
> > > > > >
> > > > > > I want to become a Zeppelin contributor. Before starting to fix
> > > > > > issues I decided to make an example of a notebook to become
> > > > > > understand Zeppelin better :). I chose Apache Flink as a main
> > > > > > Interpreter for my example because there are not so many examples
> > of "Zeppelin on Flink"
> > > > > > usage. I think it also may be helpful for your community
> according
> > > > > > to https://issues.apache.org/jira/browse/ZEPPELIN-684, so here
> is
> > > > > > the link:
> > > > > > https://github.com/AlexanderShoshin/zeppelin-example
> > > > > >
> > > > > > I am ready to make any kind of corrections in this example.
> > > > > >
> > > > > > Regards,
> > > > > > Alexander
> > > > > >
> >
>

Re: Notebook example

Posted by Alexander Bezzubov <bz...@apache.org>.
Done! Now you should be able to assign all further issues.

Thank you for contribution, the notebook looks great, and here is how it
looks like in case people want to see it "in action" [1]

Please, feel free to check other open issues in Zeppelin JIRA marked \w
'beginner' label [2] for good future contributions ideas!


 1.
https://www.zeppelinhub.com/viewer/notebooks/aHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL0FsZXhhbmRlclNob3NoaW4vemVwcGVsaW4tZXhhbXBsZS9tYXN0ZXIvbm90ZWJvb2tzL0ZsaWdodHMuanNvbg

 2.
https://issues.apache.org/jira/browse/ZEPPELIN-1793?jql=project%20%3D%20ZEPPELIN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22)%20AND%20labels%20%3D%20beginner

--
Alex

On Mon, Dec 12, 2016 at 5:55 PM, Alexander Shoshin <
Alexander_Shoshin@epam.com> wrote:

> I have created an issue:
> https://issues.apache.org/jira/browse/ZEPPELIN-1787
> but I can't assign it to myself. Could you assign it to me please?
>
> -----Original Message-----
>  From: moon soo Lee [mailto:leemoonsoo@gmail.com]
>  Sent: Friday, December 09, 2016 8:49 PM
>  To: dev@zeppelin.apache.org
>  Subject: Re: Notebook example
>
> > Althought it's not mendentory, creating issue helps track the changes
> such as when
> > code has chaged, which version of zeppelin includes the changes, etc.
> So, please
> > create if you don't mind.
> >
> > Thanks,
> > moon
> > On Fri, 9 Dec 2016 at 11:05 AM Alexander Shoshin <
> Alexander_Shoshin@epam.com>
> > wrote:
> >
> > > Thanks for reply.
> > >
> > > And do I need to create an issue first? Or I can just make a pull
> > > request for adding a note to tutorial examples?
> > >
> > > Thanks,
> > > Alexander
> > >
> > > > -----Original Message-----
> > > > From: moon soo Lee [mailto:moon@apache.org]
> > > > Sent: Thursday, December 08, 2016 11:30 PM
> > > > To: dev@zeppelin.apache.org
> > > > Subject: Re: Notebook example
> > > >
> > > > Hi,
> > > >
> > > > Appreciate for sharing a notebook and considering contribution.
> > > > You can contribute your note as a tutorial under
> > > > https://github.com/apache/zeppelin/tree/master/notebook by making
> > > > pullrequest. So Zeppelin distribution can include notebook. Just
> > > > sharing on the mailing list greatly helps as well if you prefer.
> > > >
> > > > Don't hesitate making pullrequest or asking questions.
> > > >
> > > > Thanks,
> > > > moon
> > > >
> > > > On Thu, Dec 8, 2016 at 10:26 AM Alexander Shoshin <
> > > > Alexander_Shoshin@epam.com> wrote:
> > > >
> > > > > Hi everyone.
> > > > >
> > > > > I want to become a Zeppelin contributor. Before starting to fix
> > > > > issues I decided to make an example of a notebook to become
> > > > > understand Zeppelin better :). I chose Apache Flink as a main
> > > > > Interpreter for my example because there are not so many examples
> of "Zeppelin on Flink"
> > > > > usage. I think it also may be helpful for your community according
> > > > > to https://issues.apache.org/jira/browse/ZEPPELIN-684, so here is
> > > > > the link:
> > > > > https://github.com/AlexanderShoshin/zeppelin-example
> > > > >
> > > > > I am ready to make any kind of corrections in this example.
> > > > >
> > > > > Regards,
> > > > > Alexander
> > > > >
>

RE: Notebook example

Posted by Alexander Shoshin <Al...@epam.com>.
I have created an issue:
https://issues.apache.org/jira/browse/ZEPPELIN-1787
but I can't assign it to myself. Could you assign it to me please?

-----Original Message-----
 From: moon soo Lee [mailto:leemoonsoo@gmail.com] 
 Sent: Friday, December 09, 2016 8:49 PM
 To: dev@zeppelin.apache.org
 Subject: Re: Notebook example

> Althought it's not mendentory, creating issue helps track the changes such as when
> code has chaged, which version of zeppelin includes the changes, etc. So, please 
> create if you don't mind.
>
> Thanks,
> moon
> On Fri, 9 Dec 2016 at 11:05 AM Alexander Shoshin <Al...@epam.com>
> wrote:
>
> > Thanks for reply.
> >
> > And do I need to create an issue first? Or I can just make a pull 
> > request for adding a note to tutorial examples?
> >
> > Thanks,
> > Alexander
> >
> > > -----Original Message-----
> > > From: moon soo Lee [mailto:moon@apache.org]
> > > Sent: Thursday, December 08, 2016 11:30 PM
> > > To: dev@zeppelin.apache.org
> > > Subject: Re: Notebook example
> > >
> > > Hi,
> > >
> > > Appreciate for sharing a notebook and considering contribution.
> > > You can contribute your note as a tutorial under
> > > https://github.com/apache/zeppelin/tree/master/notebook by making 
> > > pullrequest. So Zeppelin distribution can include notebook. Just 
> > > sharing on the mailing list greatly helps as well if you prefer.
> > >
> > > Don't hesitate making pullrequest or asking questions.
> > >
> > > Thanks,
> > > moon
> > >
> > > On Thu, Dec 8, 2016 at 10:26 AM Alexander Shoshin <
> > > Alexander_Shoshin@epam.com> wrote:
> > >
> > > > Hi everyone.
> > > >
> > > > I want to become a Zeppelin contributor. Before starting to fix 
> > > > issues I decided to make an example of a notebook to become 
> > > > understand Zeppelin better :). I chose Apache Flink as a main 
> > > > Interpreter for my example because there are not so many examples of "Zeppelin on Flink"
> > > > usage. I think it also may be helpful for your community according 
> > > > to https://issues.apache.org/jira/browse/ZEPPELIN-684, so here is 
> > > > the link:
> > > > https://github.com/AlexanderShoshin/zeppelin-example
> > > >
> > > > I am ready to make any kind of corrections in this example.
> > > >
> > > > Regards,
> > > > Alexander
> > > >

Re: Notebook example

Posted by moon soo Lee <le...@gmail.com>.
Althought it's not mendentory, creating issue helps track the changes such
as when code has chaged, which version of zeppelin includes the changes,
etc. So, please create if you don't mind.

Thanks,
moon
On Fri, 9 Dec 2016 at 11:05 AM Alexander Shoshin <Al...@epam.com>
wrote:

> Thanks for reply.
>
> And do I need to create an issue first? Or I can just make a pull request
> for adding a note to tutorial examples?
>
> Thanks,
> Alexander
>
> > -----Original Message-----
> > From: moon soo Lee [mailto:moon@apache.org]
> > Sent: Thursday, December 08, 2016 11:30 PM
> > To: dev@zeppelin.apache.org
> > Subject: Re: Notebook example
> >
> > Hi,
> >
> > Appreciate for sharing a notebook and considering contribution.
> > You can contribute your note as a tutorial under
> https://github.com/apache/zeppelin/tree/master/notebook by making
> pullrequest. So Zeppelin distribution can include notebook. Just sharing on
> the mailing list greatly helps as well if you prefer.
> >
> > Don't hesitate making pullrequest or asking questions.
> >
> > Thanks,
> > moon
> >
> > On Thu, Dec 8, 2016 at 10:26 AM Alexander Shoshin <
> Alexander_Shoshin@epam.com> wrote:
> >
> > > Hi everyone.
> > >
> > > I want to become a Zeppelin contributor. Before starting to fix issues
> > > I decided to make an example of a notebook to become understand
> > > Zeppelin better :). I chose Apache Flink as a main Interpreter for my
> > > example because there are not so many examples of "Zeppelin on Flink"
> > > usage. I think it also may be helpful for your community according to
> > > https://issues.apache.org/jira/browse/ZEPPELIN-684, so here is the
> link:
> > > https://github.com/AlexanderShoshin/zeppelin-example
> > >
> > > I am ready to make any kind of corrections in this example.
> > >
> > > Regards,
> > > Alexander
> > >
>

RE: Notebook example

Posted by Alexander Shoshin <Al...@epam.com>.
Thanks for reply.

And do I need to create an issue first? Or I can just make a pull request for adding a note to tutorial examples?

Thanks,
Alexander

> -----Original Message-----
> From: moon soo Lee [mailto:moon@apache.org] 
> Sent: Thursday, December 08, 2016 11:30 PM
> To: dev@zeppelin.apache.org
> Subject: Re: Notebook example
>
> Hi,
>
> Appreciate for sharing a notebook and considering contribution.
> You can contribute your note as a tutorial under https://github.com/apache/zeppelin/tree/master/notebook by making pullrequest. So Zeppelin distribution can include notebook. Just sharing on the mailing list greatly helps as well if you prefer.
> 
> Don't hesitate making pullrequest or asking questions.
>
> Thanks,
> moon
>
> On Thu, Dec 8, 2016 at 10:26 AM Alexander Shoshin < Alexander_Shoshin@epam.com> wrote:
>
> > Hi everyone.
> >
> > I want to become a Zeppelin contributor. Before starting to fix issues 
> > I decided to make an example of a notebook to become understand 
> > Zeppelin better :). I chose Apache Flink as a main Interpreter for my 
> > example because there are not so many examples of "Zeppelin on Flink" 
> > usage. I think it also may be helpful for your community according to 
> > https://issues.apache.org/jira/browse/ZEPPELIN-684, so here is the link:
> > https://github.com/AlexanderShoshin/zeppelin-example
> >
> > I am ready to make any kind of corrections in this example.
> >
> > Regards,
> > Alexander
> >

Re: Notebook example

Posted by moon soo Lee <mo...@apache.org>.
Hi,

Appreciate for sharing a notebook and considering contribution.
You can contribute your note as a tutorial under
https://github.com/apache/zeppelin/tree/master/notebook by making
pullrequest. So Zeppelin distribution can include notebook. Just sharing on
the mailing list greatly helps as well if you prefer.

Don't hesitate making pullrequest or asking questions.

Thanks,
moon

On Thu, Dec 8, 2016 at 10:26 AM Alexander Shoshin <
Alexander_Shoshin@epam.com> wrote:

> Hi everyone.
>
> I want to become a Zeppelin contributor. Before starting to fix issues I
> decided to make an example of a notebook to become understand Zeppelin
> better :). I chose Apache Flink as a main Interpreter for my example
> because there are not so many examples of "Zeppelin on Flink" usage. I
> think it also may be helpful for your community according to
> https://issues.apache.org/jira/browse/ZEPPELIN-684, so here is the link:
> https://github.com/AlexanderShoshin/zeppelin-example
>
> I am ready to make any kind of corrections in this example.
>
> Regards,
> Alexander
>