You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Kruse, Sebastian" <Se...@hpi.de> on 2014/11/24 16:05:34 UTC
Projects page on Flink web page
Hi everyone,
at HPI, we recently had the idea of a projects page on the Flink web site. Such a page could present programs that have been implemented atop of Flink, ideally with a link to a github repository of the respective project's code. This could bring benefits for both the Flink maintainers and users with it.
At first, these projects could promote the versatility of the Flink platform if the Flink programs are concerned with quite different problems (graph algorithms, machine learning, data analytics, ...). Moreover, a lot of projects underline the relevance of Flink as a GP data processing platform. Last but not least, given a set of readily implemented use cases, a rather non-technical audience (i.e., w/o programming background) could try out Flink without having to write any code (ideally).
Also, such a projects page would be beneficial for the people that write new Flink programs. Without a distribution platform for Flink programs, it is likely that every program written in Flink is only used by its own authors. The project page would be a good place to promote own Flink programs but also to exchange programs, best practices or even subplans and operators.
As I think, that this idea addresses an important issue, I am putting it here for discussion and looking forward to your feedback. :)
Cheers,
Sebastian
Re: Projects page on Flink web page
Posted by Robert Metzger <rm...@apache.org>.
I've created a wiki page for the projects list:
https://cwiki.apache.org/confluence/display/FLINK/Projects+List
Let me know if something is not working with the Wiki, in particular the
permissions.
On Tue, Nov 25, 2014 at 10:55 PM, Henry Saputra <he...@gmail.com>
wrote:
> +1
>
> Lets do wiki page to get things up quickly then either provide links
> or migrate to website when it is settle.
>
> - Henry
>
> On Tue, Nov 25, 2014 at 6:34 AM, Kostas Tzoumas <kt...@apache.org>
> wrote:
> > Very nice idea!
> >
> > How about starting with a wiki page and move/mirror to the website once
> > some content is there?
> >
> > Asking people to push their stuff to one github repository will probably
> > not work IMO
> >
> > On Mon, Nov 24, 2014 at 6:23 PM, Markl, Volker, Prof. Dr. <
> > volker.markl@tu-berlin.de> wrote:
> >
> >> Dear all,
> >>
> >> we should be able to host and organize that via the Berlin Big Data
> >> Center, as we will use Apache Flink as platform there and plan to
> develop
> >> an open, extensible repository of data anaylsis algorithms in this
> context
> >> anyways.
> >>
> >> In this context, I would indeed suggest some form of Github.
> >>
> >> Herzliche Grüße
> >> Volker Markl
> >>
> >> Von meinem iPad gesendet, daher evtl. kurz und knappe Nachricht
> >>
> >> > Am 24.11.2014 um 18:18 schrieb "Stephan Ewen" <se...@apache.org>:
> >> >
> >> > I some sense the wiki would be nice, but to me, wiki pages feel like
> "we
> >> > did not find a better place for that"...
> >> >
> >> >> On Mon, Nov 24, 2014 at 6:00 PM, Robert Metzger <rmetzger@apache.org
> >
> >> wrote:
> >> >>
> >> >> Hi,
> >> >>
> >> >> great idea!
> >> >> Maybe we should use the Wiki for such a list? It would make it easier
> >> for
> >> >> users to just drop a link to a github repo of an algorithm
> >> implementation.
> >> >>
> >> >>
> >> >>
> >> >> On Mon, Nov 24, 2014 at 4:05 PM, Kruse, Sebastian <
> >> Sebastian.Kruse@hpi.de>
> >> >> wrote:
> >> >>
> >> >>> Hi everyone,
> >> >>>
> >> >>> at HPI, we recently had the idea of a projects page on the Flink web
> >> >> site.
> >> >>> Such a page could present programs that have been implemented atop
> of
> >> >>> Flink, ideally with a link to a github repository of the respective
> >> >>> project's code. This could bring benefits for both the Flink
> >> maintainers
> >> >>> and users with it.
> >> >>>
> >> >>> At first, these projects could promote the versatility of the Flink
> >> >>> platform if the Flink programs are concerned with quite different
> >> >> problems
> >> >>> (graph algorithms, machine learning, data analytics, ...).
> Moreover, a
> >> >> lot
> >> >>> of projects underline the relevance of Flink as a GP data processing
> >> >>> platform. Last but not least, given a set of readily implemented use
> >> >> cases,
> >> >>> a rather non-technical audience (i.e., w/o programming background)
> >> could
> >> >>> try out Flink without having to write any code (ideally).
> >> >>>
> >> >>> Also, such a projects page would be beneficial for the people that
> >> write
> >> >>> new Flink programs. Without a distribution platform for Flink
> programs,
> >> >> it
> >> >>> is likely that every program written in Flink is only used by its
> own
> >> >>> authors. The project page would be a good place to promote own Flink
> >> >>> programs but also to exchange programs, best practices or even
> subplans
> >> >> and
> >> >>> operators.
> >> >>>
> >> >>> As I think, that this idea addresses an important issue, I am
> putting
> >> it
> >> >>> here for discussion and looking forward to your feedback. :)
> >> >>>
> >> >>> Cheers,
> >> >>> Sebastian
> >> >>
> >>
>
Re: Projects page on Flink web page
Posted by Henry Saputra <he...@gmail.com>.
+1
Lets do wiki page to get things up quickly then either provide links
or migrate to website when it is settle.
- Henry
On Tue, Nov 25, 2014 at 6:34 AM, Kostas Tzoumas <kt...@apache.org> wrote:
> Very nice idea!
>
> How about starting with a wiki page and move/mirror to the website once
> some content is there?
>
> Asking people to push their stuff to one github repository will probably
> not work IMO
>
> On Mon, Nov 24, 2014 at 6:23 PM, Markl, Volker, Prof. Dr. <
> volker.markl@tu-berlin.de> wrote:
>
>> Dear all,
>>
>> we should be able to host and organize that via the Berlin Big Data
>> Center, as we will use Apache Flink as platform there and plan to develop
>> an open, extensible repository of data anaylsis algorithms in this context
>> anyways.
>>
>> In this context, I would indeed suggest some form of Github.
>>
>> Herzliche Grüße
>> Volker Markl
>>
>> Von meinem iPad gesendet, daher evtl. kurz und knappe Nachricht
>>
>> > Am 24.11.2014 um 18:18 schrieb "Stephan Ewen" <se...@apache.org>:
>> >
>> > I some sense the wiki would be nice, but to me, wiki pages feel like "we
>> > did not find a better place for that"...
>> >
>> >> On Mon, Nov 24, 2014 at 6:00 PM, Robert Metzger <rm...@apache.org>
>> wrote:
>> >>
>> >> Hi,
>> >>
>> >> great idea!
>> >> Maybe we should use the Wiki for such a list? It would make it easier
>> for
>> >> users to just drop a link to a github repo of an algorithm
>> implementation.
>> >>
>> >>
>> >>
>> >> On Mon, Nov 24, 2014 at 4:05 PM, Kruse, Sebastian <
>> Sebastian.Kruse@hpi.de>
>> >> wrote:
>> >>
>> >>> Hi everyone,
>> >>>
>> >>> at HPI, we recently had the idea of a projects page on the Flink web
>> >> site.
>> >>> Such a page could present programs that have been implemented atop of
>> >>> Flink, ideally with a link to a github repository of the respective
>> >>> project's code. This could bring benefits for both the Flink
>> maintainers
>> >>> and users with it.
>> >>>
>> >>> At first, these projects could promote the versatility of the Flink
>> >>> platform if the Flink programs are concerned with quite different
>> >> problems
>> >>> (graph algorithms, machine learning, data analytics, ...). Moreover, a
>> >> lot
>> >>> of projects underline the relevance of Flink as a GP data processing
>> >>> platform. Last but not least, given a set of readily implemented use
>> >> cases,
>> >>> a rather non-technical audience (i.e., w/o programming background)
>> could
>> >>> try out Flink without having to write any code (ideally).
>> >>>
>> >>> Also, such a projects page would be beneficial for the people that
>> write
>> >>> new Flink programs. Without a distribution platform for Flink programs,
>> >> it
>> >>> is likely that every program written in Flink is only used by its own
>> >>> authors. The project page would be a good place to promote own Flink
>> >>> programs but also to exchange programs, best practices or even subplans
>> >> and
>> >>> operators.
>> >>>
>> >>> As I think, that this idea addresses an important issue, I am putting
>> it
>> >>> here for discussion and looking forward to your feedback. :)
>> >>>
>> >>> Cheers,
>> >>> Sebastian
>> >>
>>
Re: Projects page on Flink web page
Posted by Kostas Tzoumas <kt...@apache.org>.
Very nice idea!
How about starting with a wiki page and move/mirror to the website once
some content is there?
Asking people to push their stuff to one github repository will probably
not work IMO
On Mon, Nov 24, 2014 at 6:23 PM, Markl, Volker, Prof. Dr. <
volker.markl@tu-berlin.de> wrote:
> Dear all,
>
> we should be able to host and organize that via the Berlin Big Data
> Center, as we will use Apache Flink as platform there and plan to develop
> an open, extensible repository of data anaylsis algorithms in this context
> anyways.
>
> In this context, I would indeed suggest some form of Github.
>
> Herzliche Grüße
> Volker Markl
>
> Von meinem iPad gesendet, daher evtl. kurz und knappe Nachricht
>
> > Am 24.11.2014 um 18:18 schrieb "Stephan Ewen" <se...@apache.org>:
> >
> > I some sense the wiki would be nice, but to me, wiki pages feel like "we
> > did not find a better place for that"...
> >
> >> On Mon, Nov 24, 2014 at 6:00 PM, Robert Metzger <rm...@apache.org>
> wrote:
> >>
> >> Hi,
> >>
> >> great idea!
> >> Maybe we should use the Wiki for such a list? It would make it easier
> for
> >> users to just drop a link to a github repo of an algorithm
> implementation.
> >>
> >>
> >>
> >> On Mon, Nov 24, 2014 at 4:05 PM, Kruse, Sebastian <
> Sebastian.Kruse@hpi.de>
> >> wrote:
> >>
> >>> Hi everyone,
> >>>
> >>> at HPI, we recently had the idea of a projects page on the Flink web
> >> site.
> >>> Such a page could present programs that have been implemented atop of
> >>> Flink, ideally with a link to a github repository of the respective
> >>> project's code. This could bring benefits for both the Flink
> maintainers
> >>> and users with it.
> >>>
> >>> At first, these projects could promote the versatility of the Flink
> >>> platform if the Flink programs are concerned with quite different
> >> problems
> >>> (graph algorithms, machine learning, data analytics, ...). Moreover, a
> >> lot
> >>> of projects underline the relevance of Flink as a GP data processing
> >>> platform. Last but not least, given a set of readily implemented use
> >> cases,
> >>> a rather non-technical audience (i.e., w/o programming background)
> could
> >>> try out Flink without having to write any code (ideally).
> >>>
> >>> Also, such a projects page would be beneficial for the people that
> write
> >>> new Flink programs. Without a distribution platform for Flink programs,
> >> it
> >>> is likely that every program written in Flink is only used by its own
> >>> authors. The project page would be a good place to promote own Flink
> >>> programs but also to exchange programs, best practices or even subplans
> >> and
> >>> operators.
> >>>
> >>> As I think, that this idea addresses an important issue, I am putting
> it
> >>> here for discussion and looking forward to your feedback. :)
> >>>
> >>> Cheers,
> >>> Sebastian
> >>
>
Re: Projects page on Flink web page
Posted by "Markl, Volker, Prof. Dr." <vo...@tu-berlin.de>.
Dear all,
we should be able to host and organize that via the Berlin Big Data Center, as we will use Apache Flink as platform there and plan to develop an open, extensible repository of data anaylsis algorithms in this context anyways.
In this context, I would indeed suggest some form of Github.
Herzliche Grüße
Volker Markl
Von meinem iPad gesendet, daher evtl. kurz und knappe Nachricht
> Am 24.11.2014 um 18:18 schrieb "Stephan Ewen" <se...@apache.org>:
>
> I some sense the wiki would be nice, but to me, wiki pages feel like "we
> did not find a better place for that"...
>
>> On Mon, Nov 24, 2014 at 6:00 PM, Robert Metzger <rm...@apache.org> wrote:
>>
>> Hi,
>>
>> great idea!
>> Maybe we should use the Wiki for such a list? It would make it easier for
>> users to just drop a link to a github repo of an algorithm implementation.
>>
>>
>>
>> On Mon, Nov 24, 2014 at 4:05 PM, Kruse, Sebastian <Se...@hpi.de>
>> wrote:
>>
>>> Hi everyone,
>>>
>>> at HPI, we recently had the idea of a projects page on the Flink web
>> site.
>>> Such a page could present programs that have been implemented atop of
>>> Flink, ideally with a link to a github repository of the respective
>>> project's code. This could bring benefits for both the Flink maintainers
>>> and users with it.
>>>
>>> At first, these projects could promote the versatility of the Flink
>>> platform if the Flink programs are concerned with quite different
>> problems
>>> (graph algorithms, machine learning, data analytics, ...). Moreover, a
>> lot
>>> of projects underline the relevance of Flink as a GP data processing
>>> platform. Last but not least, given a set of readily implemented use
>> cases,
>>> a rather non-technical audience (i.e., w/o programming background) could
>>> try out Flink without having to write any code (ideally).
>>>
>>> Also, such a projects page would be beneficial for the people that write
>>> new Flink programs. Without a distribution platform for Flink programs,
>> it
>>> is likely that every program written in Flink is only used by its own
>>> authors. The project page would be a good place to promote own Flink
>>> programs but also to exchange programs, best practices or even subplans
>> and
>>> operators.
>>>
>>> As I think, that this idea addresses an important issue, I am putting it
>>> here for discussion and looking forward to your feedback. :)
>>>
>>> Cheers,
>>> Sebastian
>>
Re: Projects page on Flink web page
Posted by Stephan Ewen <se...@apache.org>.
I some sense the wiki would be nice, but to me, wiki pages feel like "we
did not find a better place for that"...
On Mon, Nov 24, 2014 at 6:00 PM, Robert Metzger <rm...@apache.org> wrote:
> Hi,
>
> great idea!
> Maybe we should use the Wiki for such a list? It would make it easier for
> users to just drop a link to a github repo of an algorithm implementation.
>
>
>
> On Mon, Nov 24, 2014 at 4:05 PM, Kruse, Sebastian <Se...@hpi.de>
> wrote:
>
> > Hi everyone,
> >
> > at HPI, we recently had the idea of a projects page on the Flink web
> site.
> > Such a page could present programs that have been implemented atop of
> > Flink, ideally with a link to a github repository of the respective
> > project's code. This could bring benefits for both the Flink maintainers
> > and users with it.
> >
> > At first, these projects could promote the versatility of the Flink
> > platform if the Flink programs are concerned with quite different
> problems
> > (graph algorithms, machine learning, data analytics, ...). Moreover, a
> lot
> > of projects underline the relevance of Flink as a GP data processing
> > platform. Last but not least, given a set of readily implemented use
> cases,
> > a rather non-technical audience (i.e., w/o programming background) could
> > try out Flink without having to write any code (ideally).
> >
> > Also, such a projects page would be beneficial for the people that write
> > new Flink programs. Without a distribution platform for Flink programs,
> it
> > is likely that every program written in Flink is only used by its own
> > authors. The project page would be a good place to promote own Flink
> > programs but also to exchange programs, best practices or even subplans
> and
> > operators.
> >
> > As I think, that this idea addresses an important issue, I am putting it
> > here for discussion and looking forward to your feedback. :)
> >
> > Cheers,
> > Sebastian
> >
>
Re: Projects page on Flink web page
Posted by Robert Metzger <rm...@apache.org>.
Hi,
great idea!
Maybe we should use the Wiki for such a list? It would make it easier for
users to just drop a link to a github repo of an algorithm implementation.
On Mon, Nov 24, 2014 at 4:05 PM, Kruse, Sebastian <Se...@hpi.de>
wrote:
> Hi everyone,
>
> at HPI, we recently had the idea of a projects page on the Flink web site.
> Such a page could present programs that have been implemented atop of
> Flink, ideally with a link to a github repository of the respective
> project's code. This could bring benefits for both the Flink maintainers
> and users with it.
>
> At first, these projects could promote the versatility of the Flink
> platform if the Flink programs are concerned with quite different problems
> (graph algorithms, machine learning, data analytics, ...). Moreover, a lot
> of projects underline the relevance of Flink as a GP data processing
> platform. Last but not least, given a set of readily implemented use cases,
> a rather non-technical audience (i.e., w/o programming background) could
> try out Flink without having to write any code (ideally).
>
> Also, such a projects page would be beneficial for the people that write
> new Flink programs. Without a distribution platform for Flink programs, it
> is likely that every program written in Flink is only used by its own
> authors. The project page would be a good place to promote own Flink
> programs but also to exchange programs, best practices or even subplans and
> operators.
>
> As I think, that this idea addresses an important issue, I am putting it
> here for discussion and looking forward to your feedback. :)
>
> Cheers,
> Sebastian
>