You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Alex B." <ab...@nflabs.com> on 2015/05/01 06:10:35 UTC
Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization
Congratulations, Madhuka!
Glad that you can make it and thank you for your contributions. So we will
go on with the initial plan of making more visualizations for Zeppelin then.
Meanwhile it is community bonding period [1] I would suggest you go on
participating at the dev@ and user@ mailing lists, helping people, sharing
your experience with Zeppelin and meanwhile you can also try doing a simple
PoC as Ilya suggested, by picking two different libraries or chart types
(1 existing, 1 new) and writing an implementation of the transformation
function to fit them together.
Please keep in touch and let us know who it goes every week or two in a
form of short email with your progress summary. We can also arrange
something like a regular call\IRC hours if you will.
Thanks again, please feel free to reach out in case of any further
questions!
[1]
http://googlesummerofcode.blogspot.kr/2007/04/so-what-is-this-community-bonding-all.html
On Thu, Apr 30, 2015 at 12:57 PM, madhuka udantha <ma...@gmail.com>
wrote:
> Hi,
>
> Thank you all for your participation in this thread and the support I got.
> My GSoC proposal for Zeppelin had been accepted. Hope you will continue to
> give the same support you have been giving me to see to the successful
> finishing of the project.
>
> Also Thanks to Corneau for spring cleaning zeppelin. I can too support
> this if needed. Please share any thread which will be discussing [1] so I
> can go through the code changes happening.
>
> Currently I'm using zeppelin/master on github. Is it alright? Do you have
> any ideas to what my first deliverable would need to contain?
>
> Thanks.
>
> [1] https://github.com/apache/incubator-zeppelin/pull/56
>
> On Wed, Apr 29, 2015 at 2:41 PM, Corneau Damien <co...@apache.org>
> wrote:
>
>> Hi Madhuka and dev mailing list,
>>
>> Since the code became quite a mess (didn't supervised it enough I guess :p
>> ), and GSOC 2015 will start soon,
>> I'm currently working on making things easier for people who would like to
>> participate in the front-end of Zeppelin.
>> Work in Progress in that Pull Request :
>> https://github.com/apache/incubator-zeppelin/pull/56
>>
>> It should be finished before the GSOC 2015 coding time start :)
>>
>> On Mon, Apr 27, 2015 at 2:00 PM, Ilya Malyanov <im...@gmail.com>
>> wrote:
>>
>> > Hi Madhuka,
>> >
>> > I’m not aware of any efforts in bridging different chart libraries. But
>> my
>> > guess is, we’ll have to do it ourselves. You can start by picking two
>> > different libraries or chart types and writing an implementation of the
>> > transformation function. It might help you to assess the scope of work.
>> >
>> > Regarding paragraph.js.
>> > I don’t think there is documentation for it.
>> > So the best way to understand the data flow it is to read the code.
>> > I know it’s not very helpful, but I don’t think anyone can help you in
>> > this situation.
>> >
>> > Regards,
>> > Ilya
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Thu, Apr 23, 2015 at 10:43 PM, madhuka udantha <
>> > madhukaudantha@gmail.com> wrote:
>> >
>> >> Hi,
>> >>
>> >> In different charting libraries the data template take different
>> formats.
>> >> Therefore to convert between these formats we use a data transformation
>> >> module. It converts the input data (JSON format) to different data
>> >> templates based on the chart library/ chart type selected. If chart
>> library
>> >> A and chart library B both use the same data template it will reuse the
>> >> data transformation algorithm.
>> >>
>> >> Please share your valuable ideas on this matter. Has any implementation
>> >> been done similar to this before?
>> >>
>> >> I also need to know the data flow within Paragraph.js. Please be kind
>> >> enough to share the required resources. What is the logging mechanism
>> that
>> >> is being used in zeppelin?
>> >>
>> >> I have written few articles[1] on zeppelin
>> >>
>> >> [1] http://madhukaudantha.blogspot.com/search/label/Apache%20Zeppelin
>> >>
>> >> On Mon, Apr 20, 2015 at 11:44 AM, madhuka udantha <
>> >> madhukaudantha@gmail.com> wrote:
>> >>
>> >>> Hi,
>> >>>
>> >>> Here are some blog posts[1] on AngularJS that I wrote last week and
>> >>> git-hub[2] repo on them
>> >>>
>> >>> [1]
>> >>>
>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=sidebar
>> >>> <
>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=classic>
>> >>> [2] https://github.com/Madhuka/angularjs-tutorial
>> >>>
>> >>>
>> >>> On Wed, Apr 15, 2015 at 12:20 PM, madhuka udantha <
>> >>> madhukaudantha@gmail.com> wrote:
>> >>>
>> >>>> Hi Alex,
>> >>>>
>> >>>> I ran the tests and they were fine. Yes I'm familiar with the code
>> >>>> layout/architecture. Basically I'm looking at AngularJS and
>> Typescript. I
>> >>>> have played around with those two technologies and ran some example
>> code
>> >>>> which worked fine. I'm writing few blog posts on them as well.
>> >>>>
>> >>>> Currently I'm looking at zeppelin-web\app\scripts\controllers\ and
>> I'm
>> >>>> getting familiarized with the Zeppelin Code Base. Also I'm hoping to
>> write
>> >>>> some blog posts on it.
>> >>>>
>> >>>> I'm also following paragraph.js functions mainly the two
>> >>>> functions pivot() and pivotDataToD3ChartFormat() for constructing d3
>> data.
>> >>>>
>> >>>> Further I'm finding what are the mainly used charting types by
>> Research
>> >>>> Teams of Universities all over the world. Also I'm researching on
>> the main
>> >>>> features that would be used in such graphs.
>> >>>>
>> >>>> Yes it will be great to have a call/meeting. This week or following
>> >>>> will be fine for me. IRC meeting or google hangout will be fine.
>> >>>>
>> >>>> On Tue, Apr 14, 2015 at 12:33 PM, Alex B. <ab...@nflabs.com>
>> wrote:
>> >>>>
>> >>>>> Hi Madhuka,
>> >>>>>
>> >>>>> how Zeppelin code-base exploration it going for you? Do you have any
>> >>>>> updates?
>> >>>>> I can see from
>> >>>>>
>> http://madhukaudantha.blogspot.kr/2015/03/building-apache-zeppelin.html
>> >>>>> that you were able to build it well.
>> >>>>>
>> >>>>> Were you able to run some tests? Are you familiar by now with code
>> >>>>> layout\client-server architecture?
>> >>>>>
>> >>>>> Asking because it is time for us now to rate the GSoC proposals that
>> >>>>> we'v
>> >>>>> got, so please let us know about the progress that you have made so
>> >>>>> fas, so
>> >>>>> we can use it as foundation.
>> >>>>>
>> >>>>> Will you be interested in making a quick call this early\next week
>> and
>> >>>>> also
>> >>>>> talk about your GSoC proposal a bit?
>> >>>>>
>> >>>>> That would be awesome and could help us a lot!
>> >>>>> Thanks in advance.
>> >>>>>
>> >>>>>
>> >>>>> On Wed, Apr 1, 2015 at 2:27 PM, madhuka udantha <
>> >>>>> madhukaudantha@gmail.com>
>> >>>>> wrote:
>> >>>>>
>> >>>>> > Hi Damien,
>> >>>>> >
>> >>>>> > Thanks for the quick and descriptive reply. I will go through each
>> >>>>> of them
>> >>>>> > and update you on those and I will share my experiences in my blog
>> >>>>> too. I
>> >>>>> > will go through the code-base with consideration for the above
>> files.
>> >>>>> >
>> >>>>> > Thanks
>> >>>>> >
>> >>>>> > On Wed, Apr 1, 2015 at 7:36 AM, Corneau Damien <
>> >>>>> corneadoug@apache.org>
>> >>>>> > wrote:
>> >>>>> >
>> >>>>> > > Hi,
>> >>>>> > >
>> >>>>> > > First of all we use angularjs so you might want to familiarize
>> >>>>> yourself
>> >>>>> > > with it.
>> >>>>> > > Currently the code is not well organized (big files), and not
>> >>>>> really
>> >>>>> > > angular friendly either, but we are working on fixing that.
>> >>>>> > >
>> >>>>> > > We also were preparing a switch to Typescript, so you might want
>> >>>>> to read
>> >>>>> > > about it too.
>> >>>>> > >
>> >>>>> > > You will find most of the web logic inside of
>> >>>>> > > zeppelin-web/app/scripts/controllers/
>> >>>>> > >
>> >>>>> > > Main controllers are: notebook.js and paragraph.js
>> >>>>> > >
>> >>>>> > > notebook.js take care of the full note, while paragraph.js is
>> for
>> >>>>> each
>> >>>>> > > paragraph of the notebook.
>> >>>>> > >
>> >>>>> > > In notebook.js will have functions that distributes actions to
>> all
>> >>>>> > > paragraphs, interpreter binding, note style etc...
>> >>>>> > > In paragraph.js you shall find everything about text-editor,
>> >>>>> running
>> >>>>> > > queries, pivot and visualization.
>> >>>>> > >
>> >>>>> > > Since the file is somewhere around 1600 lines in paragraph.js, I
>> >>>>> can help
>> >>>>> > > you find what you want with more precise questions.
>> >>>>> > >
>> >>>>> > > Some functions you might be interested in: 'pivot = function('
>> , '
>> >>>>> > > pivotDataToD3ChartFormat = function(', 'setD3Chart = function(',
>> >>>>> '$scope.
>> >>>>> > > loadTableData = function('
>> >>>>> > >
>> >>>>> > > This Pull request (typescript) wasn't ported to the incubator
>> >>>>> repository
>> >>>>> > > yet, but there was some work on splitting the paragraph into
>> >>>>> smaller
>> >>>>> > parts.
>> >>>>> > > It might help you understand or find what you want.
>> >>>>> > >
>> >>>>> > >
>> >>>>> > >
>> >>>>> > > On Wed, Apr 1, 2015 at 2:23 AM, madhuka udantha <
>> >>>>> > madhukaudantha@gmail.com>
>> >>>>> > > wrote:
>> >>>>> > >
>> >>>>> > > > Hi All,
>> >>>>> > > >
>> >>>>> > > > Can you point out some resources / tutorials to understand
>> the
>> >>>>> code
>> >>>>> > > base
>> >>>>> > > > of zeppelin?
>> >>>>> > > > Since I am trying to familiarize myself with the zeppelin
>> code
>> >>>>> > structure
>> >>>>> > > > and architecture
>> >>>>> > > >
>> >>>>> > > > Thanks
>> >>>>> > > >
>> >>>>> > > > On Fri, Mar 20, 2015 at 10:57 AM, madhuka udantha <
>> >>>>> > > > madhukaudantha@gmail.com> wrote:
>> >>>>> > > >
>> >>>>> > > >> Hi All,
>> >>>>> > > >>
>> >>>>> > > >> I'm Udantha, MSc. Student at University of Moratuwa. This
>> GSoC
>> >>>>> 2015
>> >>>>> > > >> project, 0COMDEV-1190 captures my interest.
>> >>>>> > > >>
>> >>>>> > > >> I have abundant experiences of visualization techniques
>> creating
>> >>>>> > > numerous
>> >>>>> > > >> dashboards[1,2] with javascript, html5, angularJS, d3
>> charting
>> >>>>> etc.
>> >>>>> > > >>
>> >>>>> > > >> My current research area comprises of big data where I have
>> >>>>> worked
>> >>>>> > with
>> >>>>> > > >> various types of data sets. Also I'm working with cluster
>> >>>>> > representation
>> >>>>> > > >> and classification techniques where visualization amounts to
>> a
>> >>>>> > > considerable
>> >>>>> > > >> part. I was following COMDEV-119 (jira) with Alexander
>> Bezzubov
>> >>>>> and
>> >>>>> > > CORNEAU
>> >>>>> > > >> Damien for more than week.
>> >>>>> > > >>
>> >>>>> > > >> Thanks
>> >>>>> > > >>
>> >>>>> > > >> [1] http://wso2.com/products/user-engagement-server/
>> >>>>> > > >> [2] https://github.com/wso2/jaggery
>> >>>>> > > >> --
>> >>>>> > > >> Cheers,
>> >>>>> > > >> Madhuka Udantha
>> >>>>> > > >> http://madhukaudantha.blogspot.com
>> >>>>> > > >>
>> >>>>> > > >
>> >>>>> > > >
>> >>>>> > > >
>> >>>>> > > > --
>> >>>>> > > > Cheers,
>> >>>>> > > > Madhuka Udantha
>> >>>>> > > > http://madhukaudantha.blogspot.com
>> >>>>> > > >
>> >>>>> > >
>> >>>>> >
>> >>>>> >
>> >>>>> >
>> >>>>> > --
>> >>>>> > Cheers,
>> >>>>> > Madhuka Udantha
>> >>>>> > http://madhukaudantha.blogspot.com
>> >>>>> >
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> --
>> >>>>> --
>> >>>>> Kind regards,
>> >>>>> Alexander.
>> >>>>>
>> >>>>
>> >>>>
>> >>>>
>> >>>> --
>> >>>> Cheers,
>> >>>> Madhuka Udantha
>> >>>> http://madhukaudantha.blogspot.com
>> >>>>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Cheers,
>> >>> Madhuka Udantha
>> >>> http://madhukaudantha.blogspot.com
>> >>>
>> >>
>> >>
>> >>
>> >> --
>> >> Cheers,
>> >> Madhuka Udantha
>> >> http://madhukaudantha.blogspot.com
>> >>
>> >
>> >
>>
>
>
>
> --
> Cheers,
> Madhuka Udantha
> http://madhukaudantha.blogspot.com
>
--
--
Kind regards,
Alexander.
Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization
Posted by madhuka udantha <ma...@gmail.com>.
Hi, Damien
Thanks for sharing information.
I will look in to 'Spring Cleaning PR' and start work in there.
On Thu, May 21, 2015 at 7:26 AM, Corneau Damien <co...@apache.org>
wrote:
> Hi madhuka,
>
> The Spring Cleaning PR will change the code base a lot, the way the code
> work will be the same (for 80% of the case), so you can familiarize
> yourself with it however keep in mind that the Spring Cleaning PR will
> change:
> * folder structure
> * Separate some code into multiple files
> * Refactor some code to be simpler/optimized
>
> The folder structure part is kinda set right now (just a few tiny changes
> more), and we are working on making some refactoring ready as fast as
> possible.
>
> I think that on Monday, you can get familiar with that PR new structure
> and work from there, it should help you understand better all the part of
> the zeppelin-web.
>
>
> On Thu, May 21, 2015 at 1:46 AM, madhuka udantha <madhukaudantha@gmail.com
> > wrote:
>
>> Hi All,
>>
>>
>> I went through google charts / d3 (chart-options, chart-types, chart-data
>> and chart-format) with angularJS. And I have written few blog
>> articles regard to the topics[1,2].
>> To Familiarize myself with Zepplin I wrote angular controller and new tab
>> for Zepplin-Web app.
>>
>> As 'spring cleaning of Zeppelin-web'[3] is in-progress, will this change
>> existing code base? I'm currently working on zepplin web app. Will the
>> change be significant? Shall I familiarize with the existing code base or
>> the resulting one of the 'spring cleaning of Zeppelin-web'
>>
>>
>>
>> [1] http://madhukaudantha.blogspot.com/search/label/Google%20Chart
>> [2] https://github.com/Madhuka/angularjs-tutorial
>> [3] https://github.com/apache/incubator-zeppelin/pull/56
>>
>> On Fri, May 1, 2015 at 9:40 AM, Alex B. <ab...@nflabs.com> wrote:
>>
>>> Congratulations, Madhuka!
>>>
>>> Glad that you can make it and thank you for your contributions. So we
>>> will go on with the initial plan of making more visualizations for Zeppelin
>>> then.
>>>
>>> Meanwhile it is community bonding period [1] I would suggest you go on
>>> participating at the dev@ and user@ mailing lists, helping people,
>>> sharing your experience with Zeppelin and meanwhile you can also try doing
>>> a simple PoC as Ilya suggested, by picking two different libraries or
>>> chart types (1 existing, 1 new) and writing an implementation of the
>>> transformation function to fit them together.
>>>
>>> Please keep in touch and let us know who it goes every week or two in a
>>> form of short email with your progress summary. We can also arrange
>>> something like a regular call\IRC hours if you will.
>>>
>>> Thanks again, please feel free to reach out in case of any further
>>> questions!
>>>
>>> [1]
>>> http://googlesummerofcode.blogspot.kr/2007/04/so-what-is-this-community-bonding-all.html
>>>
>>> On Thu, Apr 30, 2015 at 12:57 PM, madhuka udantha <
>>> madhukaudantha@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Thank you all for your participation in this thread and the support I
>>>> got. My GSoC proposal for Zeppelin had been accepted. Hope you will
>>>> continue to give the same support you have been giving me to see to the
>>>> successful finishing of the project.
>>>>
>>>> Also Thanks to Corneau for spring cleaning zeppelin. I can too support
>>>> this if needed. Please share any thread which will be discussing [1] so I
>>>> can go through the code changes happening.
>>>>
>>>> Currently I'm using zeppelin/master on github. Is it alright? Do you
>>>> have any ideas to what my first deliverable would need to contain?
>>>>
>>>> Thanks.
>>>>
>>>> [1] https://github.com/apache/incubator-zeppelin/pull/56
>>>>
>>>> On Wed, Apr 29, 2015 at 2:41 PM, Corneau Damien <co...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi Madhuka and dev mailing list,
>>>>>
>>>>> Since the code became quite a mess (didn't supervised it enough I
>>>>> guess :p
>>>>> ), and GSOC 2015 will start soon,
>>>>> I'm currently working on making things easier for people who would
>>>>> like to
>>>>> participate in the front-end of Zeppelin.
>>>>> Work in Progress in that Pull Request :
>>>>> https://github.com/apache/incubator-zeppelin/pull/56
>>>>>
>>>>> It should be finished before the GSOC 2015 coding time start :)
>>>>>
>>>>> On Mon, Apr 27, 2015 at 2:00 PM, Ilya Malyanov <im...@gmail.com>
>>>>> wrote:
>>>>>
>>>>> > Hi Madhuka,
>>>>> >
>>>>> > I’m not aware of any efforts in bridging different chart libraries.
>>>>> But my
>>>>> > guess is, we’ll have to do it ourselves. You can start by picking two
>>>>> > different libraries or chart types and writing an implementation of
>>>>> the
>>>>> > transformation function. It might help you to assess the scope of
>>>>> work.
>>>>> >
>>>>> > Regarding paragraph.js.
>>>>> > I don’t think there is documentation for it.
>>>>> > So the best way to understand the data flow it is to read the code.
>>>>> > I know it’s not very helpful, but I don’t think anyone can help you
>>>>> in
>>>>> > this situation.
>>>>> >
>>>>> > Regards,
>>>>> > Ilya
>>>>> >
>>>>> >
>>>>> >
>>>>> >
>>>>> >
>>>>> >
>>>>> > On Thu, Apr 23, 2015 at 10:43 PM, madhuka udantha <
>>>>> > madhukaudantha@gmail.com> wrote:
>>>>> >
>>>>> >> Hi,
>>>>> >>
>>>>> >> In different charting libraries the data template take different
>>>>> formats.
>>>>> >> Therefore to convert between these formats we use a data
>>>>> transformation
>>>>> >> module. It converts the input data (JSON format) to different data
>>>>> >> templates based on the chart library/ chart type selected. If chart
>>>>> library
>>>>> >> A and chart library B both use the same data template it will reuse
>>>>> the
>>>>> >> data transformation algorithm.
>>>>> >>
>>>>> >> Please share your valuable ideas on this matter. Has any
>>>>> implementation
>>>>> >> been done similar to this before?
>>>>> >>
>>>>> >> I also need to know the data flow within Paragraph.js. Please be
>>>>> kind
>>>>> >> enough to share the required resources. What is the logging
>>>>> mechanism that
>>>>> >> is being used in zeppelin?
>>>>> >>
>>>>> >> I have written few articles[1] on zeppelin
>>>>> >>
>>>>> >> [1]
>>>>> http://madhukaudantha.blogspot.com/search/label/Apache%20Zeppelin
>>>>> >>
>>>>> >> On Mon, Apr 20, 2015 at 11:44 AM, madhuka udantha <
>>>>> >> madhukaudantha@gmail.com> wrote:
>>>>> >>
>>>>> >>> Hi,
>>>>> >>>
>>>>> >>> Here are some blog posts[1] on AngularJS that I wrote last week and
>>>>> >>> git-hub[2] repo on them
>>>>> >>>
>>>>> >>> [1]
>>>>> >>>
>>>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=sidebar
>>>>> >>> <
>>>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=classic
>>>>> >
>>>>> >>> [2] https://github.com/Madhuka/angularjs-tutorial
>>>>> >>>
>>>>> >>>
>>>>> >>> On Wed, Apr 15, 2015 at 12:20 PM, madhuka udantha <
>>>>> >>> madhukaudantha@gmail.com> wrote:
>>>>> >>>
>>>>> >>>> Hi Alex,
>>>>> >>>>
>>>>> >>>> I ran the tests and they were fine. Yes I'm familiar with the code
>>>>> >>>> layout/architecture. Basically I'm looking at AngularJS and
>>>>> Typescript. I
>>>>> >>>> have played around with those two technologies and ran some
>>>>> example code
>>>>> >>>> which worked fine. I'm writing few blog posts on them as well.
>>>>> >>>>
>>>>> >>>> Currently I'm looking at zeppelin-web\app\scripts\controllers\
>>>>> and I'm
>>>>> >>>> getting familiarized with the Zeppelin Code Base. Also I'm hoping
>>>>> to write
>>>>> >>>> some blog posts on it.
>>>>> >>>>
>>>>> >>>> I'm also following paragraph.js functions mainly the two
>>>>> >>>> functions pivot() and pivotDataToD3ChartFormat() for constructing
>>>>> d3 data.
>>>>> >>>>
>>>>> >>>> Further I'm finding what are the mainly used charting types by
>>>>> Research
>>>>> >>>> Teams of Universities all over the world. Also I'm researching on
>>>>> the main
>>>>> >>>> features that would be used in such graphs.
>>>>> >>>>
>>>>> >>>> Yes it will be great to have a call/meeting. This week or
>>>>> following
>>>>> >>>> will be fine for me. IRC meeting or google hangout will be fine.
>>>>> >>>>
>>>>> >>>> On Tue, Apr 14, 2015 at 12:33 PM, Alex B. <ab...@nflabs.com>
>>>>> wrote:
>>>>> >>>>
>>>>> >>>>> Hi Madhuka,
>>>>> >>>>>
>>>>> >>>>> how Zeppelin code-base exploration it going for you? Do you have
>>>>> any
>>>>> >>>>> updates?
>>>>> >>>>> I can see from
>>>>> >>>>>
>>>>> http://madhukaudantha.blogspot.kr/2015/03/building-apache-zeppelin.html
>>>>> >>>>> that you were able to build it well.
>>>>> >>>>>
>>>>> >>>>> Were you able to run some tests? Are you familiar by now with
>>>>> code
>>>>> >>>>> layout\client-server architecture?
>>>>> >>>>>
>>>>> >>>>> Asking because it is time for us now to rate the GSoC proposals
>>>>> that
>>>>> >>>>> we'v
>>>>> >>>>> got, so please let us know about the progress that you have made
>>>>> so
>>>>> >>>>> fas, so
>>>>> >>>>> we can use it as foundation.
>>>>> >>>>>
>>>>> >>>>> Will you be interested in making a quick call this early\next
>>>>> week and
>>>>> >>>>> also
>>>>> >>>>> talk about your GSoC proposal a bit?
>>>>> >>>>>
>>>>> >>>>> That would be awesome and could help us a lot!
>>>>> >>>>> Thanks in advance.
>>>>> >>>>>
>>>>> >>>>>
>>>>> >>>>> On Wed, Apr 1, 2015 at 2:27 PM, madhuka udantha <
>>>>> >>>>> madhukaudantha@gmail.com>
>>>>> >>>>> wrote:
>>>>> >>>>>
>>>>> >>>>> > Hi Damien,
>>>>> >>>>> >
>>>>> >>>>> > Thanks for the quick and descriptive reply. I will go through
>>>>> each
>>>>> >>>>> of them
>>>>> >>>>> > and update you on those and I will share my experiences in my
>>>>> blog
>>>>> >>>>> too. I
>>>>> >>>>> > will go through the code-base with consideration for the above
>>>>> files.
>>>>> >>>>> >
>>>>> >>>>> > Thanks
>>>>> >>>>> >
>>>>> >>>>> > On Wed, Apr 1, 2015 at 7:36 AM, Corneau Damien <
>>>>> >>>>> corneadoug@apache.org>
>>>>> >>>>> > wrote:
>>>>> >>>>> >
>>>>> >>>>> > > Hi,
>>>>> >>>>> > >
>>>>> >>>>> > > First of all we use angularjs so you might want to
>>>>> familiarize
>>>>> >>>>> yourself
>>>>> >>>>> > > with it.
>>>>> >>>>> > > Currently the code is not well organized (big files), and not
>>>>> >>>>> really
>>>>> >>>>> > > angular friendly either, but we are working on fixing that.
>>>>> >>>>> > >
>>>>> >>>>> > > We also were preparing a switch to Typescript, so you might
>>>>> want
>>>>> >>>>> to read
>>>>> >>>>> > > about it too.
>>>>> >>>>> > >
>>>>> >>>>> > > You will find most of the web logic inside of
>>>>> >>>>> > > zeppelin-web/app/scripts/controllers/
>>>>> >>>>> > >
>>>>> >>>>> > > Main controllers are: notebook.js and paragraph.js
>>>>> >>>>> > >
>>>>> >>>>> > > notebook.js take care of the full note, while paragraph.js
>>>>> is for
>>>>> >>>>> each
>>>>> >>>>> > > paragraph of the notebook.
>>>>> >>>>> > >
>>>>> >>>>> > > In notebook.js will have functions that distributes actions
>>>>> to all
>>>>> >>>>> > > paragraphs, interpreter binding, note style etc...
>>>>> >>>>> > > In paragraph.js you shall find everything about text-editor,
>>>>> >>>>> running
>>>>> >>>>> > > queries, pivot and visualization.
>>>>> >>>>> > >
>>>>> >>>>> > > Since the file is somewhere around 1600 lines in
>>>>> paragraph.js, I
>>>>> >>>>> can help
>>>>> >>>>> > > you find what you want with more precise questions.
>>>>> >>>>> > >
>>>>> >>>>> > > Some functions you might be interested in: 'pivot =
>>>>> function(' , '
>>>>> >>>>> > > pivotDataToD3ChartFormat = function(', 'setD3Chart =
>>>>> function(',
>>>>> >>>>> '$scope.
>>>>> >>>>> > > loadTableData = function('
>>>>> >>>>> > >
>>>>> >>>>> > > This Pull request (typescript) wasn't ported to the incubator
>>>>> >>>>> repository
>>>>> >>>>> > > yet, but there was some work on splitting the paragraph into
>>>>> >>>>> smaller
>>>>> >>>>> > parts.
>>>>> >>>>> > > It might help you understand or find what you want.
>>>>> >>>>> > >
>>>>> >>>>> > >
>>>>> >>>>> > >
>>>>> >>>>> > > On Wed, Apr 1, 2015 at 2:23 AM, madhuka udantha <
>>>>> >>>>> > madhukaudantha@gmail.com>
>>>>> >>>>> > > wrote:
>>>>> >>>>> > >
>>>>> >>>>> > > > Hi All,
>>>>> >>>>> > > >
>>>>> >>>>> > > > Can you point out some resources / tutorials to
>>>>> understand the
>>>>> >>>>> code
>>>>> >>>>> > > base
>>>>> >>>>> > > > of zeppelin?
>>>>> >>>>> > > > Since I am trying to familiarize myself with the zeppelin
>>>>> code
>>>>> >>>>> > structure
>>>>> >>>>> > > > and architecture
>>>>> >>>>> > > >
>>>>> >>>>> > > > Thanks
>>>>> >>>>> > > >
>>>>> >>>>> > > > On Fri, Mar 20, 2015 at 10:57 AM, madhuka udantha <
>>>>> >>>>> > > > madhukaudantha@gmail.com> wrote:
>>>>> >>>>> > > >
>>>>> >>>>> > > >> Hi All,
>>>>> >>>>> > > >>
>>>>> >>>>> > > >> I'm Udantha, MSc. Student at University of Moratuwa. This
>>>>> GSoC
>>>>> >>>>> 2015
>>>>> >>>>> > > >> project, 0COMDEV-1190 captures my interest.
>>>>> >>>>> > > >>
>>>>> >>>>> > > >> I have abundant experiences of visualization techniques
>>>>> creating
>>>>> >>>>> > > numerous
>>>>> >>>>> > > >> dashboards[1,2] with javascript, html5, angularJS, d3
>>>>> charting
>>>>> >>>>> etc.
>>>>> >>>>> > > >>
>>>>> >>>>> > > >> My current research area comprises of big data where I
>>>>> have
>>>>> >>>>> worked
>>>>> >>>>> > with
>>>>> >>>>> > > >> various types of data sets. Also I'm working with cluster
>>>>> >>>>> > representation
>>>>> >>>>> > > >> and classification techniques where visualization amounts
>>>>> to a
>>>>> >>>>> > > considerable
>>>>> >>>>> > > >> part. I was following COMDEV-119 (jira) with Alexander
>>>>> Bezzubov
>>>>> >>>>> and
>>>>> >>>>> > > CORNEAU
>>>>> >>>>> > > >> Damien for more than week.
>>>>> >>>>> > > >>
>>>>> >>>>> > > >> Thanks
>>>>> >>>>> > > >>
>>>>> >>>>> > > >> [1] http://wso2.com/products/user-engagement-server/
>>>>> >>>>> > > >> [2] https://github.com/wso2/jaggery
>>>>> >>>>> > > >> --
>>>>> >>>>> > > >> Cheers,
>>>>> >>>>> > > >> Madhuka Udantha
>>>>> >>>>> > > >> http://madhukaudantha.blogspot.com
>>>>> >>>>> > > >>
>>>>> >>>>> > > >
>>>>> >>>>> > > >
>>>>> >>>>> > > >
>>>>> >>>>> > > > --
>>>>> >>>>> > > > Cheers,
>>>>> >>>>> > > > Madhuka Udantha
>>>>> >>>>> > > > http://madhukaudantha.blogspot.com
>>>>> >>>>> > > >
>>>>> >>>>> > >
>>>>> >>>>> >
>>>>> >>>>> >
>>>>> >>>>> >
>>>>> >>>>> > --
>>>>> >>>>> > Cheers,
>>>>> >>>>> > Madhuka Udantha
>>>>> >>>>> > http://madhukaudantha.blogspot.com
>>>>> >>>>> >
>>>>> >>>>>
>>>>> >>>>>
>>>>> >>>>>
>>>>> >>>>> --
>>>>> >>>>> --
>>>>> >>>>> Kind regards,
>>>>> >>>>> Alexander.
>>>>> >>>>>
>>>>> >>>>
>>>>> >>>>
>>>>> >>>>
>>>>> >>>> --
>>>>> >>>> Cheers,
>>>>> >>>> Madhuka Udantha
>>>>> >>>> http://madhukaudantha.blogspot.com
>>>>> >>>>
>>>>> >>>
>>>>> >>>
>>>>> >>>
>>>>> >>> --
>>>>> >>> Cheers,
>>>>> >>> Madhuka Udantha
>>>>> >>> http://madhukaudantha.blogspot.com
>>>>> >>>
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >> --
>>>>> >> Cheers,
>>>>> >> Madhuka Udantha
>>>>> >> http://madhukaudantha.blogspot.com
>>>>> >>
>>>>> >
>>>>> >
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Cheers,
>>>> Madhuka Udantha
>>>> http://madhukaudantha.blogspot.com
>>>>
>>>
>>>
>>>
>>> --
>>> --
>>> Kind regards,
>>> Alexander.
>>>
>>>
>>
>>
>> --
>> Cheers,
>> Madhuka Udantha
>> http://madhukaudantha.blogspot.com
>>
>
>
--
Cheers,
Madhuka Udantha
http://madhukaudantha.blogspot.com
Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization
Posted by Corneau Damien <co...@apache.org>.
Hi madhuka,
The Spring Cleaning PR will change the code base a lot, the way the code
work will be the same (for 80% of the case), so you can familiarize
yourself with it however keep in mind that the Spring Cleaning PR will
change:
* folder structure
* Separate some code into multiple files
* Refactor some code to be simpler/optimized
The folder structure part is kinda set right now (just a few tiny changes
more), and we are working on making some refactoring ready as fast as
possible.
I think that on Monday, you can get familiar with that PR new structure and
work from there, it should help you understand better all the part of the
zeppelin-web.
On Thu, May 21, 2015 at 1:46 AM, madhuka udantha <ma...@gmail.com>
wrote:
> Hi All,
>
>
> I went through google charts / d3 (chart-options, chart-types, chart-data
> and chart-format) with angularJS. And I have written few blog articles
> regard to the topics[1,2].
> To Familiarize myself with Zepplin I wrote angular controller and new tab
> for Zepplin-Web app.
>
> As 'spring cleaning of Zeppelin-web'[3] is in-progress, will this change
> existing code base? I'm currently working on zepplin web app. Will the
> change be significant? Shall I familiarize with the existing code base or
> the resulting one of the 'spring cleaning of Zeppelin-web'
>
>
>
> [1] http://madhukaudantha.blogspot.com/search/label/Google%20Chart
> [2] https://github.com/Madhuka/angularjs-tutorial
> [3] https://github.com/apache/incubator-zeppelin/pull/56
>
> On Fri, May 1, 2015 at 9:40 AM, Alex B. <ab...@nflabs.com> wrote:
>
>> Congratulations, Madhuka!
>>
>> Glad that you can make it and thank you for your contributions. So we
>> will go on with the initial plan of making more visualizations for Zeppelin
>> then.
>>
>> Meanwhile it is community bonding period [1] I would suggest you go on
>> participating at the dev@ and user@ mailing lists, helping people,
>> sharing your experience with Zeppelin and meanwhile you can also try doing
>> a simple PoC as Ilya suggested, by picking two different libraries or
>> chart types (1 existing, 1 new) and writing an implementation of the
>> transformation function to fit them together.
>>
>> Please keep in touch and let us know who it goes every week or two in a
>> form of short email with your progress summary. We can also arrange
>> something like a regular call\IRC hours if you will.
>>
>> Thanks again, please feel free to reach out in case of any further
>> questions!
>>
>> [1]
>> http://googlesummerofcode.blogspot.kr/2007/04/so-what-is-this-community-bonding-all.html
>>
>> On Thu, Apr 30, 2015 at 12:57 PM, madhuka udantha <
>> madhukaudantha@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you all for your participation in this thread and the support I
>>> got. My GSoC proposal for Zeppelin had been accepted. Hope you will
>>> continue to give the same support you have been giving me to see to the
>>> successful finishing of the project.
>>>
>>> Also Thanks to Corneau for spring cleaning zeppelin. I can too support
>>> this if needed. Please share any thread which will be discussing [1] so I
>>> can go through the code changes happening.
>>>
>>> Currently I'm using zeppelin/master on github. Is it alright? Do you
>>> have any ideas to what my first deliverable would need to contain?
>>>
>>> Thanks.
>>>
>>> [1] https://github.com/apache/incubator-zeppelin/pull/56
>>>
>>> On Wed, Apr 29, 2015 at 2:41 PM, Corneau Damien <co...@apache.org>
>>> wrote:
>>>
>>>> Hi Madhuka and dev mailing list,
>>>>
>>>> Since the code became quite a mess (didn't supervised it enough I guess
>>>> :p
>>>> ), and GSOC 2015 will start soon,
>>>> I'm currently working on making things easier for people who would like
>>>> to
>>>> participate in the front-end of Zeppelin.
>>>> Work in Progress in that Pull Request :
>>>> https://github.com/apache/incubator-zeppelin/pull/56
>>>>
>>>> It should be finished before the GSOC 2015 coding time start :)
>>>>
>>>> On Mon, Apr 27, 2015 at 2:00 PM, Ilya Malyanov <im...@gmail.com>
>>>> wrote:
>>>>
>>>> > Hi Madhuka,
>>>> >
>>>> > I’m not aware of any efforts in bridging different chart libraries.
>>>> But my
>>>> > guess is, we’ll have to do it ourselves. You can start by picking two
>>>> > different libraries or chart types and writing an implementation of
>>>> the
>>>> > transformation function. It might help you to assess the scope of
>>>> work.
>>>> >
>>>> > Regarding paragraph.js.
>>>> > I don’t think there is documentation for it.
>>>> > So the best way to understand the data flow it is to read the code.
>>>> > I know it’s not very helpful, but I don’t think anyone can help you in
>>>> > this situation.
>>>> >
>>>> > Regards,
>>>> > Ilya
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Thu, Apr 23, 2015 at 10:43 PM, madhuka udantha <
>>>> > madhukaudantha@gmail.com> wrote:
>>>> >
>>>> >> Hi,
>>>> >>
>>>> >> In different charting libraries the data template take different
>>>> formats.
>>>> >> Therefore to convert between these formats we use a data
>>>> transformation
>>>> >> module. It converts the input data (JSON format) to different data
>>>> >> templates based on the chart library/ chart type selected. If chart
>>>> library
>>>> >> A and chart library B both use the same data template it will reuse
>>>> the
>>>> >> data transformation algorithm.
>>>> >>
>>>> >> Please share your valuable ideas on this matter. Has any
>>>> implementation
>>>> >> been done similar to this before?
>>>> >>
>>>> >> I also need to know the data flow within Paragraph.js. Please be kind
>>>> >> enough to share the required resources. What is the logging
>>>> mechanism that
>>>> >> is being used in zeppelin?
>>>> >>
>>>> >> I have written few articles[1] on zeppelin
>>>> >>
>>>> >> [1]
>>>> http://madhukaudantha.blogspot.com/search/label/Apache%20Zeppelin
>>>> >>
>>>> >> On Mon, Apr 20, 2015 at 11:44 AM, madhuka udantha <
>>>> >> madhukaudantha@gmail.com> wrote:
>>>> >>
>>>> >>> Hi,
>>>> >>>
>>>> >>> Here are some blog posts[1] on AngularJS that I wrote last week and
>>>> >>> git-hub[2] repo on them
>>>> >>>
>>>> >>> [1]
>>>> >>>
>>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=sidebar
>>>> >>> <
>>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=classic>
>>>> >>> [2] https://github.com/Madhuka/angularjs-tutorial
>>>> >>>
>>>> >>>
>>>> >>> On Wed, Apr 15, 2015 at 12:20 PM, madhuka udantha <
>>>> >>> madhukaudantha@gmail.com> wrote:
>>>> >>>
>>>> >>>> Hi Alex,
>>>> >>>>
>>>> >>>> I ran the tests and they were fine. Yes I'm familiar with the code
>>>> >>>> layout/architecture. Basically I'm looking at AngularJS and
>>>> Typescript. I
>>>> >>>> have played around with those two technologies and ran some
>>>> example code
>>>> >>>> which worked fine. I'm writing few blog posts on them as well.
>>>> >>>>
>>>> >>>> Currently I'm looking at zeppelin-web\app\scripts\controllers\
>>>> and I'm
>>>> >>>> getting familiarized with the Zeppelin Code Base. Also I'm hoping
>>>> to write
>>>> >>>> some blog posts on it.
>>>> >>>>
>>>> >>>> I'm also following paragraph.js functions mainly the two
>>>> >>>> functions pivot() and pivotDataToD3ChartFormat() for constructing
>>>> d3 data.
>>>> >>>>
>>>> >>>> Further I'm finding what are the mainly used charting types by
>>>> Research
>>>> >>>> Teams of Universities all over the world. Also I'm researching on
>>>> the main
>>>> >>>> features that would be used in such graphs.
>>>> >>>>
>>>> >>>> Yes it will be great to have a call/meeting. This week or following
>>>> >>>> will be fine for me. IRC meeting or google hangout will be fine.
>>>> >>>>
>>>> >>>> On Tue, Apr 14, 2015 at 12:33 PM, Alex B. <ab...@nflabs.com>
>>>> wrote:
>>>> >>>>
>>>> >>>>> Hi Madhuka,
>>>> >>>>>
>>>> >>>>> how Zeppelin code-base exploration it going for you? Do you have
>>>> any
>>>> >>>>> updates?
>>>> >>>>> I can see from
>>>> >>>>>
>>>> http://madhukaudantha.blogspot.kr/2015/03/building-apache-zeppelin.html
>>>> >>>>> that you were able to build it well.
>>>> >>>>>
>>>> >>>>> Were you able to run some tests? Are you familiar by now with code
>>>> >>>>> layout\client-server architecture?
>>>> >>>>>
>>>> >>>>> Asking because it is time for us now to rate the GSoC proposals
>>>> that
>>>> >>>>> we'v
>>>> >>>>> got, so please let us know about the progress that you have made
>>>> so
>>>> >>>>> fas, so
>>>> >>>>> we can use it as foundation.
>>>> >>>>>
>>>> >>>>> Will you be interested in making a quick call this early\next
>>>> week and
>>>> >>>>> also
>>>> >>>>> talk about your GSoC proposal a bit?
>>>> >>>>>
>>>> >>>>> That would be awesome and could help us a lot!
>>>> >>>>> Thanks in advance.
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> On Wed, Apr 1, 2015 at 2:27 PM, madhuka udantha <
>>>> >>>>> madhukaudantha@gmail.com>
>>>> >>>>> wrote:
>>>> >>>>>
>>>> >>>>> > Hi Damien,
>>>> >>>>> >
>>>> >>>>> > Thanks for the quick and descriptive reply. I will go through
>>>> each
>>>> >>>>> of them
>>>> >>>>> > and update you on those and I will share my experiences in my
>>>> blog
>>>> >>>>> too. I
>>>> >>>>> > will go through the code-base with consideration for the above
>>>> files.
>>>> >>>>> >
>>>> >>>>> > Thanks
>>>> >>>>> >
>>>> >>>>> > On Wed, Apr 1, 2015 at 7:36 AM, Corneau Damien <
>>>> >>>>> corneadoug@apache.org>
>>>> >>>>> > wrote:
>>>> >>>>> >
>>>> >>>>> > > Hi,
>>>> >>>>> > >
>>>> >>>>> > > First of all we use angularjs so you might want to familiarize
>>>> >>>>> yourself
>>>> >>>>> > > with it.
>>>> >>>>> > > Currently the code is not well organized (big files), and not
>>>> >>>>> really
>>>> >>>>> > > angular friendly either, but we are working on fixing that.
>>>> >>>>> > >
>>>> >>>>> > > We also were preparing a switch to Typescript, so you might
>>>> want
>>>> >>>>> to read
>>>> >>>>> > > about it too.
>>>> >>>>> > >
>>>> >>>>> > > You will find most of the web logic inside of
>>>> >>>>> > > zeppelin-web/app/scripts/controllers/
>>>> >>>>> > >
>>>> >>>>> > > Main controllers are: notebook.js and paragraph.js
>>>> >>>>> > >
>>>> >>>>> > > notebook.js take care of the full note, while paragraph.js is
>>>> for
>>>> >>>>> each
>>>> >>>>> > > paragraph of the notebook.
>>>> >>>>> > >
>>>> >>>>> > > In notebook.js will have functions that distributes actions
>>>> to all
>>>> >>>>> > > paragraphs, interpreter binding, note style etc...
>>>> >>>>> > > In paragraph.js you shall find everything about text-editor,
>>>> >>>>> running
>>>> >>>>> > > queries, pivot and visualization.
>>>> >>>>> > >
>>>> >>>>> > > Since the file is somewhere around 1600 lines in
>>>> paragraph.js, I
>>>> >>>>> can help
>>>> >>>>> > > you find what you want with more precise questions.
>>>> >>>>> > >
>>>> >>>>> > > Some functions you might be interested in: 'pivot =
>>>> function(' , '
>>>> >>>>> > > pivotDataToD3ChartFormat = function(', 'setD3Chart =
>>>> function(',
>>>> >>>>> '$scope.
>>>> >>>>> > > loadTableData = function('
>>>> >>>>> > >
>>>> >>>>> > > This Pull request (typescript) wasn't ported to the incubator
>>>> >>>>> repository
>>>> >>>>> > > yet, but there was some work on splitting the paragraph into
>>>> >>>>> smaller
>>>> >>>>> > parts.
>>>> >>>>> > > It might help you understand or find what you want.
>>>> >>>>> > >
>>>> >>>>> > >
>>>> >>>>> > >
>>>> >>>>> > > On Wed, Apr 1, 2015 at 2:23 AM, madhuka udantha <
>>>> >>>>> > madhukaudantha@gmail.com>
>>>> >>>>> > > wrote:
>>>> >>>>> > >
>>>> >>>>> > > > Hi All,
>>>> >>>>> > > >
>>>> >>>>> > > > Can you point out some resources / tutorials to
>>>> understand the
>>>> >>>>> code
>>>> >>>>> > > base
>>>> >>>>> > > > of zeppelin?
>>>> >>>>> > > > Since I am trying to familiarize myself with the zeppelin
>>>> code
>>>> >>>>> > structure
>>>> >>>>> > > > and architecture
>>>> >>>>> > > >
>>>> >>>>> > > > Thanks
>>>> >>>>> > > >
>>>> >>>>> > > > On Fri, Mar 20, 2015 at 10:57 AM, madhuka udantha <
>>>> >>>>> > > > madhukaudantha@gmail.com> wrote:
>>>> >>>>> > > >
>>>> >>>>> > > >> Hi All,
>>>> >>>>> > > >>
>>>> >>>>> > > >> I'm Udantha, MSc. Student at University of Moratuwa. This
>>>> GSoC
>>>> >>>>> 2015
>>>> >>>>> > > >> project, 0COMDEV-1190 captures my interest.
>>>> >>>>> > > >>
>>>> >>>>> > > >> I have abundant experiences of visualization techniques
>>>> creating
>>>> >>>>> > > numerous
>>>> >>>>> > > >> dashboards[1,2] with javascript, html5, angularJS, d3
>>>> charting
>>>> >>>>> etc.
>>>> >>>>> > > >>
>>>> >>>>> > > >> My current research area comprises of big data where I have
>>>> >>>>> worked
>>>> >>>>> > with
>>>> >>>>> > > >> various types of data sets. Also I'm working with cluster
>>>> >>>>> > representation
>>>> >>>>> > > >> and classification techniques where visualization amounts
>>>> to a
>>>> >>>>> > > considerable
>>>> >>>>> > > >> part. I was following COMDEV-119 (jira) with Alexander
>>>> Bezzubov
>>>> >>>>> and
>>>> >>>>> > > CORNEAU
>>>> >>>>> > > >> Damien for more than week.
>>>> >>>>> > > >>
>>>> >>>>> > > >> Thanks
>>>> >>>>> > > >>
>>>> >>>>> > > >> [1] http://wso2.com/products/user-engagement-server/
>>>> >>>>> > > >> [2] https://github.com/wso2/jaggery
>>>> >>>>> > > >> --
>>>> >>>>> > > >> Cheers,
>>>> >>>>> > > >> Madhuka Udantha
>>>> >>>>> > > >> http://madhukaudantha.blogspot.com
>>>> >>>>> > > >>
>>>> >>>>> > > >
>>>> >>>>> > > >
>>>> >>>>> > > >
>>>> >>>>> > > > --
>>>> >>>>> > > > Cheers,
>>>> >>>>> > > > Madhuka Udantha
>>>> >>>>> > > > http://madhukaudantha.blogspot.com
>>>> >>>>> > > >
>>>> >>>>> > >
>>>> >>>>> >
>>>> >>>>> >
>>>> >>>>> >
>>>> >>>>> > --
>>>> >>>>> > Cheers,
>>>> >>>>> > Madhuka Udantha
>>>> >>>>> > http://madhukaudantha.blogspot.com
>>>> >>>>> >
>>>> >>>>>
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> --
>>>> >>>>> --
>>>> >>>>> Kind regards,
>>>> >>>>> Alexander.
>>>> >>>>>
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> --
>>>> >>>> Cheers,
>>>> >>>> Madhuka Udantha
>>>> >>>> http://madhukaudantha.blogspot.com
>>>> >>>>
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> --
>>>> >>> Cheers,
>>>> >>> Madhuka Udantha
>>>> >>> http://madhukaudantha.blogspot.com
>>>> >>>
>>>> >>
>>>> >>
>>>> >>
>>>> >> --
>>>> >> Cheers,
>>>> >> Madhuka Udantha
>>>> >> http://madhukaudantha.blogspot.com
>>>> >>
>>>> >
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> Cheers,
>>> Madhuka Udantha
>>> http://madhukaudantha.blogspot.com
>>>
>>
>>
>>
>> --
>> --
>> Kind regards,
>> Alexander.
>>
>>
>
>
> --
> Cheers,
> Madhuka Udantha
> http://madhukaudantha.blogspot.com
>
Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization
Posted by madhuka udantha <ma...@gmail.com>.
Hi All,
I went through google charts / d3 (chart-options, chart-types, chart-data
and chart-format) with angularJS. And I have written few blog articles
regard to the topics[1,2].
To Familiarize myself with Zepplin I wrote angular controller and new tab
for Zepplin-Web app.
As 'spring cleaning of Zeppelin-web'[3] is in-progress, will this change
existing code base? I'm currently working on zepplin web app. Will the
change be significant? Shall I familiarize with the existing code base or
the resulting one of the 'spring cleaning of Zeppelin-web'
[1] http://madhukaudantha.blogspot.com/search/label/Google%20Chart
[2] https://github.com/Madhuka/angularjs-tutorial
[3] https://github.com/apache/incubator-zeppelin/pull/56
On Fri, May 1, 2015 at 9:40 AM, Alex B. <ab...@nflabs.com> wrote:
> Congratulations, Madhuka!
>
> Glad that you can make it and thank you for your contributions. So we will
> go on with the initial plan of making more visualizations for Zeppelin then.
>
> Meanwhile it is community bonding period [1] I would suggest you go on
> participating at the dev@ and user@ mailing lists, helping people,
> sharing your experience with Zeppelin and meanwhile you can also try doing
> a simple PoC as Ilya suggested, by picking two different libraries or
> chart types (1 existing, 1 new) and writing an implementation of the
> transformation function to fit them together.
>
> Please keep in touch and let us know who it goes every week or two in a
> form of short email with your progress summary. We can also arrange
> something like a regular call\IRC hours if you will.
>
> Thanks again, please feel free to reach out in case of any further
> questions!
>
> [1]
> http://googlesummerofcode.blogspot.kr/2007/04/so-what-is-this-community-bonding-all.html
>
> On Thu, Apr 30, 2015 at 12:57 PM, madhuka udantha <
> madhukaudantha@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you all for your participation in this thread and the support I
>> got. My GSoC proposal for Zeppelin had been accepted. Hope you will
>> continue to give the same support you have been giving me to see to the
>> successful finishing of the project.
>>
>> Also Thanks to Corneau for spring cleaning zeppelin. I can too support
>> this if needed. Please share any thread which will be discussing [1] so I
>> can go through the code changes happening.
>>
>> Currently I'm using zeppelin/master on github. Is it alright? Do you have
>> any ideas to what my first deliverable would need to contain?
>>
>> Thanks.
>>
>> [1] https://github.com/apache/incubator-zeppelin/pull/56
>>
>> On Wed, Apr 29, 2015 at 2:41 PM, Corneau Damien <co...@apache.org>
>> wrote:
>>
>>> Hi Madhuka and dev mailing list,
>>>
>>> Since the code became quite a mess (didn't supervised it enough I guess
>>> :p
>>> ), and GSOC 2015 will start soon,
>>> I'm currently working on making things easier for people who would like
>>> to
>>> participate in the front-end of Zeppelin.
>>> Work in Progress in that Pull Request :
>>> https://github.com/apache/incubator-zeppelin/pull/56
>>>
>>> It should be finished before the GSOC 2015 coding time start :)
>>>
>>> On Mon, Apr 27, 2015 at 2:00 PM, Ilya Malyanov <im...@gmail.com>
>>> wrote:
>>>
>>> > Hi Madhuka,
>>> >
>>> > I’m not aware of any efforts in bridging different chart libraries.
>>> But my
>>> > guess is, we’ll have to do it ourselves. You can start by picking two
>>> > different libraries or chart types and writing an implementation of the
>>> > transformation function. It might help you to assess the scope of work.
>>> >
>>> > Regarding paragraph.js.
>>> > I don’t think there is documentation for it.
>>> > So the best way to understand the data flow it is to read the code.
>>> > I know it’s not very helpful, but I don’t think anyone can help you in
>>> > this situation.
>>> >
>>> > Regards,
>>> > Ilya
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Thu, Apr 23, 2015 at 10:43 PM, madhuka udantha <
>>> > madhukaudantha@gmail.com> wrote:
>>> >
>>> >> Hi,
>>> >>
>>> >> In different charting libraries the data template take different
>>> formats.
>>> >> Therefore to convert between these formats we use a data
>>> transformation
>>> >> module. It converts the input data (JSON format) to different data
>>> >> templates based on the chart library/ chart type selected. If chart
>>> library
>>> >> A and chart library B both use the same data template it will reuse
>>> the
>>> >> data transformation algorithm.
>>> >>
>>> >> Please share your valuable ideas on this matter. Has any
>>> implementation
>>> >> been done similar to this before?
>>> >>
>>> >> I also need to know the data flow within Paragraph.js. Please be kind
>>> >> enough to share the required resources. What is the logging mechanism
>>> that
>>> >> is being used in zeppelin?
>>> >>
>>> >> I have written few articles[1] on zeppelin
>>> >>
>>> >> [1] http://madhukaudantha.blogspot.com/search/label/Apache%20Zeppelin
>>> >>
>>> >> On Mon, Apr 20, 2015 at 11:44 AM, madhuka udantha <
>>> >> madhukaudantha@gmail.com> wrote:
>>> >>
>>> >>> Hi,
>>> >>>
>>> >>> Here are some blog posts[1] on AngularJS that I wrote last week and
>>> >>> git-hub[2] repo on them
>>> >>>
>>> >>> [1]
>>> >>>
>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=sidebar
>>> >>> <
>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=classic>
>>> >>> [2] https://github.com/Madhuka/angularjs-tutorial
>>> >>>
>>> >>>
>>> >>> On Wed, Apr 15, 2015 at 12:20 PM, madhuka udantha <
>>> >>> madhukaudantha@gmail.com> wrote:
>>> >>>
>>> >>>> Hi Alex,
>>> >>>>
>>> >>>> I ran the tests and they were fine. Yes I'm familiar with the code
>>> >>>> layout/architecture. Basically I'm looking at AngularJS and
>>> Typescript. I
>>> >>>> have played around with those two technologies and ran some example
>>> code
>>> >>>> which worked fine. I'm writing few blog posts on them as well.
>>> >>>>
>>> >>>> Currently I'm looking at zeppelin-web\app\scripts\controllers\ and
>>> I'm
>>> >>>> getting familiarized with the Zeppelin Code Base. Also I'm hoping
>>> to write
>>> >>>> some blog posts on it.
>>> >>>>
>>> >>>> I'm also following paragraph.js functions mainly the two
>>> >>>> functions pivot() and pivotDataToD3ChartFormat() for constructing
>>> d3 data.
>>> >>>>
>>> >>>> Further I'm finding what are the mainly used charting types by
>>> Research
>>> >>>> Teams of Universities all over the world. Also I'm researching on
>>> the main
>>> >>>> features that would be used in such graphs.
>>> >>>>
>>> >>>> Yes it will be great to have a call/meeting. This week or following
>>> >>>> will be fine for me. IRC meeting or google hangout will be fine.
>>> >>>>
>>> >>>> On Tue, Apr 14, 2015 at 12:33 PM, Alex B. <ab...@nflabs.com>
>>> wrote:
>>> >>>>
>>> >>>>> Hi Madhuka,
>>> >>>>>
>>> >>>>> how Zeppelin code-base exploration it going for you? Do you have
>>> any
>>> >>>>> updates?
>>> >>>>> I can see from
>>> >>>>>
>>> http://madhukaudantha.blogspot.kr/2015/03/building-apache-zeppelin.html
>>> >>>>> that you were able to build it well.
>>> >>>>>
>>> >>>>> Were you able to run some tests? Are you familiar by now with code
>>> >>>>> layout\client-server architecture?
>>> >>>>>
>>> >>>>> Asking because it is time for us now to rate the GSoC proposals
>>> that
>>> >>>>> we'v
>>> >>>>> got, so please let us know about the progress that you have made so
>>> >>>>> fas, so
>>> >>>>> we can use it as foundation.
>>> >>>>>
>>> >>>>> Will you be interested in making a quick call this early\next week
>>> and
>>> >>>>> also
>>> >>>>> talk about your GSoC proposal a bit?
>>> >>>>>
>>> >>>>> That would be awesome and could help us a lot!
>>> >>>>> Thanks in advance.
>>> >>>>>
>>> >>>>>
>>> >>>>> On Wed, Apr 1, 2015 at 2:27 PM, madhuka udantha <
>>> >>>>> madhukaudantha@gmail.com>
>>> >>>>> wrote:
>>> >>>>>
>>> >>>>> > Hi Damien,
>>> >>>>> >
>>> >>>>> > Thanks for the quick and descriptive reply. I will go through
>>> each
>>> >>>>> of them
>>> >>>>> > and update you on those and I will share my experiences in my
>>> blog
>>> >>>>> too. I
>>> >>>>> > will go through the code-base with consideration for the above
>>> files.
>>> >>>>> >
>>> >>>>> > Thanks
>>> >>>>> >
>>> >>>>> > On Wed, Apr 1, 2015 at 7:36 AM, Corneau Damien <
>>> >>>>> corneadoug@apache.org>
>>> >>>>> > wrote:
>>> >>>>> >
>>> >>>>> > > Hi,
>>> >>>>> > >
>>> >>>>> > > First of all we use angularjs so you might want to familiarize
>>> >>>>> yourself
>>> >>>>> > > with it.
>>> >>>>> > > Currently the code is not well organized (big files), and not
>>> >>>>> really
>>> >>>>> > > angular friendly either, but we are working on fixing that.
>>> >>>>> > >
>>> >>>>> > > We also were preparing a switch to Typescript, so you might
>>> want
>>> >>>>> to read
>>> >>>>> > > about it too.
>>> >>>>> > >
>>> >>>>> > > You will find most of the web logic inside of
>>> >>>>> > > zeppelin-web/app/scripts/controllers/
>>> >>>>> > >
>>> >>>>> > > Main controllers are: notebook.js and paragraph.js
>>> >>>>> > >
>>> >>>>> > > notebook.js take care of the full note, while paragraph.js is
>>> for
>>> >>>>> each
>>> >>>>> > > paragraph of the notebook.
>>> >>>>> > >
>>> >>>>> > > In notebook.js will have functions that distributes actions to
>>> all
>>> >>>>> > > paragraphs, interpreter binding, note style etc...
>>> >>>>> > > In paragraph.js you shall find everything about text-editor,
>>> >>>>> running
>>> >>>>> > > queries, pivot and visualization.
>>> >>>>> > >
>>> >>>>> > > Since the file is somewhere around 1600 lines in paragraph.js,
>>> I
>>> >>>>> can help
>>> >>>>> > > you find what you want with more precise questions.
>>> >>>>> > >
>>> >>>>> > > Some functions you might be interested in: 'pivot = function('
>>> , '
>>> >>>>> > > pivotDataToD3ChartFormat = function(', 'setD3Chart =
>>> function(',
>>> >>>>> '$scope.
>>> >>>>> > > loadTableData = function('
>>> >>>>> > >
>>> >>>>> > > This Pull request (typescript) wasn't ported to the incubator
>>> >>>>> repository
>>> >>>>> > > yet, but there was some work on splitting the paragraph into
>>> >>>>> smaller
>>> >>>>> > parts.
>>> >>>>> > > It might help you understand or find what you want.
>>> >>>>> > >
>>> >>>>> > >
>>> >>>>> > >
>>> >>>>> > > On Wed, Apr 1, 2015 at 2:23 AM, madhuka udantha <
>>> >>>>> > madhukaudantha@gmail.com>
>>> >>>>> > > wrote:
>>> >>>>> > >
>>> >>>>> > > > Hi All,
>>> >>>>> > > >
>>> >>>>> > > > Can you point out some resources / tutorials to understand
>>> the
>>> >>>>> code
>>> >>>>> > > base
>>> >>>>> > > > of zeppelin?
>>> >>>>> > > > Since I am trying to familiarize myself with the zeppelin
>>> code
>>> >>>>> > structure
>>> >>>>> > > > and architecture
>>> >>>>> > > >
>>> >>>>> > > > Thanks
>>> >>>>> > > >
>>> >>>>> > > > On Fri, Mar 20, 2015 at 10:57 AM, madhuka udantha <
>>> >>>>> > > > madhukaudantha@gmail.com> wrote:
>>> >>>>> > > >
>>> >>>>> > > >> Hi All,
>>> >>>>> > > >>
>>> >>>>> > > >> I'm Udantha, MSc. Student at University of Moratuwa. This
>>> GSoC
>>> >>>>> 2015
>>> >>>>> > > >> project, 0COMDEV-1190 captures my interest.
>>> >>>>> > > >>
>>> >>>>> > > >> I have abundant experiences of visualization techniques
>>> creating
>>> >>>>> > > numerous
>>> >>>>> > > >> dashboards[1,2] with javascript, html5, angularJS, d3
>>> charting
>>> >>>>> etc.
>>> >>>>> > > >>
>>> >>>>> > > >> My current research area comprises of big data where I have
>>> >>>>> worked
>>> >>>>> > with
>>> >>>>> > > >> various types of data sets. Also I'm working with cluster
>>> >>>>> > representation
>>> >>>>> > > >> and classification techniques where visualization amounts
>>> to a
>>> >>>>> > > considerable
>>> >>>>> > > >> part. I was following COMDEV-119 (jira) with Alexander
>>> Bezzubov
>>> >>>>> and
>>> >>>>> > > CORNEAU
>>> >>>>> > > >> Damien for more than week.
>>> >>>>> > > >>
>>> >>>>> > > >> Thanks
>>> >>>>> > > >>
>>> >>>>> > > >> [1] http://wso2.com/products/user-engagement-server/
>>> >>>>> > > >> [2] https://github.com/wso2/jaggery
>>> >>>>> > > >> --
>>> >>>>> > > >> Cheers,
>>> >>>>> > > >> Madhuka Udantha
>>> >>>>> > > >> http://madhukaudantha.blogspot.com
>>> >>>>> > > >>
>>> >>>>> > > >
>>> >>>>> > > >
>>> >>>>> > > >
>>> >>>>> > > > --
>>> >>>>> > > > Cheers,
>>> >>>>> > > > Madhuka Udantha
>>> >>>>> > > > http://madhukaudantha.blogspot.com
>>> >>>>> > > >
>>> >>>>> > >
>>> >>>>> >
>>> >>>>> >
>>> >>>>> >
>>> >>>>> > --
>>> >>>>> > Cheers,
>>> >>>>> > Madhuka Udantha
>>> >>>>> > http://madhukaudantha.blogspot.com
>>> >>>>> >
>>> >>>>>
>>> >>>>>
>>> >>>>>
>>> >>>>> --
>>> >>>>> --
>>> >>>>> Kind regards,
>>> >>>>> Alexander.
>>> >>>>>
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> --
>>> >>>> Cheers,
>>> >>>> Madhuka Udantha
>>> >>>> http://madhukaudantha.blogspot.com
>>> >>>>
>>> >>>
>>> >>>
>>> >>>
>>> >>> --
>>> >>> Cheers,
>>> >>> Madhuka Udantha
>>> >>> http://madhukaudantha.blogspot.com
>>> >>>
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Cheers,
>>> >> Madhuka Udantha
>>> >> http://madhukaudantha.blogspot.com
>>> >>
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> Cheers,
>> Madhuka Udantha
>> http://madhukaudantha.blogspot.com
>>
>
>
>
> --
> --
> Kind regards,
> Alexander.
>
>
--
Cheers,
Madhuka Udantha
http://madhukaudantha.blogspot.com
Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization
Posted by madhuka udantha <ma...@gmail.com>.
Thanks Alex
On Fri, May 1, 2015 at 9:40 AM, Alex B. <ab...@nflabs.com> wrote:
> Congratulations, Madhuka!
>
> Glad that you can make it and thank you for your contributions. So we will
> go on with the initial plan of making more visualizations for Zeppelin then.
>
> Meanwhile it is community bonding period [1] I would suggest you go on
> participating at the dev@ and user@ mailing lists, helping people,
> sharing your experience with Zeppelin
>
Yes sure. As it is community bonding period I will participate on them. I
will share my experiences in ML and my blog.
and meanwhile you can also try doing a simple PoC as Ilya suggested, by
> picking two different libraries or chart types (1 existing, 1 new) and
> writing an implementation of the transformation function to fit them
> together.
>
Yes, I will do the simple POC as llya suggested and I think it will be good
starting point for my task.
>
> Please keep in touch and let us know who it goes every week or two in a
> form of short email with your progress summary. We can also arrange
> something like a regular call\IRC hours if you will.
>
I will update my progress in ML and even call\IRC
>
> Thanks again, please feel free to reach out in case of any further
> questions!
>
> [1]
> http://googlesummerofcode.blogspot.kr/2007/04/so-what-is-this-community-bonding-all.html
>
> On Thu, Apr 30, 2015 at 12:57 PM, madhuka udantha <
> madhukaudantha@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you all for your participation in this thread and the support I
>> got. My GSoC proposal for Zeppelin had been accepted. Hope you will
>> continue to give the same support you have been giving me to see to the
>> successful finishing of the project.
>>
>> Also Thanks to Corneau for spring cleaning zeppelin. I can too support
>> this if needed. Please share any thread which will be discussing [1] so I
>> can go through the code changes happening.
>>
>> Currently I'm using zeppelin/master on github. Is it alright? Do you have
>> any ideas to what my first deliverable would need to contain?
>>
>> Thanks.
>>
>> [1] https://github.com/apache/incubator-zeppelin/pull/56
>>
>> On Wed, Apr 29, 2015 at 2:41 PM, Corneau Damien <co...@apache.org>
>> wrote:
>>
>>> Hi Madhuka and dev mailing list,
>>>
>>> Since the code became quite a mess (didn't supervised it enough I guess
>>> :p
>>> ), and GSOC 2015 will start soon,
>>> I'm currently working on making things easier for people who would like
>>> to
>>> participate in the front-end of Zeppelin.
>>> Work in Progress in that Pull Request :
>>> https://github.com/apache/incubator-zeppelin/pull/56
>>>
>>> It should be finished before the GSOC 2015 coding time start :)
>>>
>>> On Mon, Apr 27, 2015 at 2:00 PM, Ilya Malyanov <im...@gmail.com>
>>> wrote:
>>>
>>> > Hi Madhuka,
>>> >
>>> > I’m not aware of any efforts in bridging different chart libraries.
>>> But my
>>> > guess is, we’ll have to do it ourselves. You can start by picking two
>>> > different libraries or chart types and writing an implementation of the
>>> > transformation function. It might help you to assess the scope of work.
>>> >
>>> > Regarding paragraph.js.
>>> > I don’t think there is documentation for it.
>>> > So the best way to understand the data flow it is to read the code.
>>> > I know it’s not very helpful, but I don’t think anyone can help you in
>>> > this situation.
>>> >
>>> > Regards,
>>> > Ilya
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Thu, Apr 23, 2015 at 10:43 PM, madhuka udantha <
>>> > madhukaudantha@gmail.com> wrote:
>>> >
>>> >> Hi,
>>> >>
>>> >> In different charting libraries the data template take different
>>> formats.
>>> >> Therefore to convert between these formats we use a data
>>> transformation
>>> >> module. It converts the input data (JSON format) to different data
>>> >> templates based on the chart library/ chart type selected. If chart
>>> library
>>> >> A and chart library B both use the same data template it will reuse
>>> the
>>> >> data transformation algorithm.
>>> >>
>>> >> Please share your valuable ideas on this matter. Has any
>>> implementation
>>> >> been done similar to this before?
>>> >>
>>> >> I also need to know the data flow within Paragraph.js. Please be kind
>>> >> enough to share the required resources. What is the logging mechanism
>>> that
>>> >> is being used in zeppelin?
>>> >>
>>> >> I have written few articles[1] on zeppelin
>>> >>
>>> >> [1] http://madhukaudantha.blogspot.com/search/label/Apache%20Zeppelin
>>> >>
>>> >> On Mon, Apr 20, 2015 at 11:44 AM, madhuka udantha <
>>> >> madhukaudantha@gmail.com> wrote:
>>> >>
>>> >>> Hi,
>>> >>>
>>> >>> Here are some blog posts[1] on AngularJS that I wrote last week and
>>> >>> git-hub[2] repo on them
>>> >>>
>>> >>> [1]
>>> >>>
>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=sidebar
>>> >>> <
>>> http://madhukaudantha.blogspot.com/search/label/AngularJS?view=classic>
>>> >>> [2] https://github.com/Madhuka/angularjs-tutorial
>>> >>>
>>> >>>
>>> >>> On Wed, Apr 15, 2015 at 12:20 PM, madhuka udantha <
>>> >>> madhukaudantha@gmail.com> wrote:
>>> >>>
>>> >>>> Hi Alex,
>>> >>>>
>>> >>>> I ran the tests and they were fine. Yes I'm familiar with the code
>>> >>>> layout/architecture. Basically I'm looking at AngularJS and
>>> Typescript. I
>>> >>>> have played around with those two technologies and ran some example
>>> code
>>> >>>> which worked fine. I'm writing few blog posts on them as well.
>>> >>>>
>>> >>>> Currently I'm looking at zeppelin-web\app\scripts\controllers\ and
>>> I'm
>>> >>>> getting familiarized with the Zeppelin Code Base. Also I'm hoping
>>> to write
>>> >>>> some blog posts on it.
>>> >>>>
>>> >>>> I'm also following paragraph.js functions mainly the two
>>> >>>> functions pivot() and pivotDataToD3ChartFormat() for constructing
>>> d3 data.
>>> >>>>
>>> >>>> Further I'm finding what are the mainly used charting types by
>>> Research
>>> >>>> Teams of Universities all over the world. Also I'm researching on
>>> the main
>>> >>>> features that would be used in such graphs.
>>> >>>>
>>> >>>> Yes it will be great to have a call/meeting. This week or following
>>> >>>> will be fine for me. IRC meeting or google hangout will be fine.
>>> >>>>
>>> >>>> On Tue, Apr 14, 2015 at 12:33 PM, Alex B. <ab...@nflabs.com>
>>> wrote:
>>> >>>>
>>> >>>>> Hi Madhuka,
>>> >>>>>
>>> >>>>> how Zeppelin code-base exploration it going for you? Do you have
>>> any
>>> >>>>> updates?
>>> >>>>> I can see from
>>> >>>>>
>>> http://madhukaudantha.blogspot.kr/2015/03/building-apache-zeppelin.html
>>> >>>>> that you were able to build it well.
>>> >>>>>
>>> >>>>> Were you able to run some tests? Are you familiar by now with code
>>> >>>>> layout\client-server architecture?
>>> >>>>>
>>> >>>>> Asking because it is time for us now to rate the GSoC proposals
>>> that
>>> >>>>> we'v
>>> >>>>> got, so please let us know about the progress that you have made so
>>> >>>>> fas, so
>>> >>>>> we can use it as foundation.
>>> >>>>>
>>> >>>>> Will you be interested in making a quick call this early\next week
>>> and
>>> >>>>> also
>>> >>>>> talk about your GSoC proposal a bit?
>>> >>>>>
>>> >>>>> That would be awesome and could help us a lot!
>>> >>>>> Thanks in advance.
>>> >>>>>
>>> >>>>>
>>> >>>>> On Wed, Apr 1, 2015 at 2:27 PM, madhuka udantha <
>>> >>>>> madhukaudantha@gmail.com>
>>> >>>>> wrote:
>>> >>>>>
>>> >>>>> > Hi Damien,
>>> >>>>> >
>>> >>>>> > Thanks for the quick and descriptive reply. I will go through
>>> each
>>> >>>>> of them
>>> >>>>> > and update you on those and I will share my experiences in my
>>> blog
>>> >>>>> too. I
>>> >>>>> > will go through the code-base with consideration for the above
>>> files.
>>> >>>>> >
>>> >>>>> > Thanks
>>> >>>>> >
>>> >>>>> > On Wed, Apr 1, 2015 at 7:36 AM, Corneau Damien <
>>> >>>>> corneadoug@apache.org>
>>> >>>>> > wrote:
>>> >>>>> >
>>> >>>>> > > Hi,
>>> >>>>> > >
>>> >>>>> > > First of all we use angularjs so you might want to familiarize
>>> >>>>> yourself
>>> >>>>> > > with it.
>>> >>>>> > > Currently the code is not well organized (big files), and not
>>> >>>>> really
>>> >>>>> > > angular friendly either, but we are working on fixing that.
>>> >>>>> > >
>>> >>>>> > > We also were preparing a switch to Typescript, so you might
>>> want
>>> >>>>> to read
>>> >>>>> > > about it too.
>>> >>>>> > >
>>> >>>>> > > You will find most of the web logic inside of
>>> >>>>> > > zeppelin-web/app/scripts/controllers/
>>> >>>>> > >
>>> >>>>> > > Main controllers are: notebook.js and paragraph.js
>>> >>>>> > >
>>> >>>>> > > notebook.js take care of the full note, while paragraph.js is
>>> for
>>> >>>>> each
>>> >>>>> > > paragraph of the notebook.
>>> >>>>> > >
>>> >>>>> > > In notebook.js will have functions that distributes actions to
>>> all
>>> >>>>> > > paragraphs, interpreter binding, note style etc...
>>> >>>>> > > In paragraph.js you shall find everything about text-editor,
>>> >>>>> running
>>> >>>>> > > queries, pivot and visualization.
>>> >>>>> > >
>>> >>>>> > > Since the file is somewhere around 1600 lines in paragraph.js,
>>> I
>>> >>>>> can help
>>> >>>>> > > you find what you want with more precise questions.
>>> >>>>> > >
>>> >>>>> > > Some functions you might be interested in: 'pivot = function('
>>> , '
>>> >>>>> > > pivotDataToD3ChartFormat = function(', 'setD3Chart =
>>> function(',
>>> >>>>> '$scope.
>>> >>>>> > > loadTableData = function('
>>> >>>>> > >
>>> >>>>> > > This Pull request (typescript) wasn't ported to the incubator
>>> >>>>> repository
>>> >>>>> > > yet, but there was some work on splitting the paragraph into
>>> >>>>> smaller
>>> >>>>> > parts.
>>> >>>>> > > It might help you understand or find what you want.
>>> >>>>> > >
>>> >>>>> > >
>>> >>>>> > >
>>> >>>>> > > On Wed, Apr 1, 2015 at 2:23 AM, madhuka udantha <
>>> >>>>> > madhukaudantha@gmail.com>
>>> >>>>> > > wrote:
>>> >>>>> > >
>>> >>>>> > > > Hi All,
>>> >>>>> > > >
>>> >>>>> > > > Can you point out some resources / tutorials to understand
>>> the
>>> >>>>> code
>>> >>>>> > > base
>>> >>>>> > > > of zeppelin?
>>> >>>>> > > > Since I am trying to familiarize myself with the zeppelin
>>> code
>>> >>>>> > structure
>>> >>>>> > > > and architecture
>>> >>>>> > > >
>>> >>>>> > > > Thanks
>>> >>>>> > > >
>>> >>>>> > > > On Fri, Mar 20, 2015 at 10:57 AM, madhuka udantha <
>>> >>>>> > > > madhukaudantha@gmail.com> wrote:
>>> >>>>> > > >
>>> >>>>> > > >> Hi All,
>>> >>>>> > > >>
>>> >>>>> > > >> I'm Udantha, MSc. Student at University of Moratuwa. This
>>> GSoC
>>> >>>>> 2015
>>> >>>>> > > >> project, 0COMDEV-1190 captures my interest.
>>> >>>>> > > >>
>>> >>>>> > > >> I have abundant experiences of visualization techniques
>>> creating
>>> >>>>> > > numerous
>>> >>>>> > > >> dashboards[1,2] with javascript, html5, angularJS, d3
>>> charting
>>> >>>>> etc.
>>> >>>>> > > >>
>>> >>>>> > > >> My current research area comprises of big data where I have
>>> >>>>> worked
>>> >>>>> > with
>>> >>>>> > > >> various types of data sets. Also I'm working with cluster
>>> >>>>> > representation
>>> >>>>> > > >> and classification techniques where visualization amounts
>>> to a
>>> >>>>> > > considerable
>>> >>>>> > > >> part. I was following COMDEV-119 (jira) with Alexander
>>> Bezzubov
>>> >>>>> and
>>> >>>>> > > CORNEAU
>>> >>>>> > > >> Damien for more than week.
>>> >>>>> > > >>
>>> >>>>> > > >> Thanks
>>> >>>>> > > >>
>>> >>>>> > > >> [1] http://wso2.com/products/user-engagement-server/
>>> >>>>> > > >> [2] https://github.com/wso2/jaggery
>>> >>>>> > > >> --
>>> >>>>> > > >> Cheers,
>>> >>>>> > > >> Madhuka Udantha
>>> >>>>> > > >> http://madhukaudantha.blogspot.com
>>> >>>>> > > >>
>>> >>>>> > > >
>>> >>>>> > > >
>>> >>>>> > > >
>>> >>>>> > > > --
>>> >>>>> > > > Cheers,
>>> >>>>> > > > Madhuka Udantha
>>> >>>>> > > > http://madhukaudantha.blogspot.com
>>> >>>>> > > >
>>> >>>>> > >
>>> >>>>> >
>>> >>>>> >
>>> >>>>> >
>>> >>>>> > --
>>> >>>>> > Cheers,
>>> >>>>> > Madhuka Udantha
>>> >>>>> > http://madhukaudantha.blogspot.com
>>> >>>>> >
>>> >>>>>
>>> >>>>>
>>> >>>>>
>>> >>>>> --
>>> >>>>> --
>>> >>>>> Kind regards,
>>> >>>>> Alexander.
>>> >>>>>
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> --
>>> >>>> Cheers,
>>> >>>> Madhuka Udantha
>>> >>>> http://madhukaudantha.blogspot.com
>>> >>>>
>>> >>>
>>> >>>
>>> >>>
>>> >>> --
>>> >>> Cheers,
>>> >>> Madhuka Udantha
>>> >>> http://madhukaudantha.blogspot.com
>>> >>>
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Cheers,
>>> >> Madhuka Udantha
>>> >> http://madhukaudantha.blogspot.com
>>> >>
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> Cheers,
>> Madhuka Udantha
>> http://madhukaudantha.blogspot.com
>>
>
>
>
> --
> --
> Kind regards,
> Alexander.
>
>
--
Cheers,
Madhuka Udantha
http://madhukaudantha.blogspot.com