[DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Hi folks,

I would like to start a discussion thread about creating a Flink ecosystem
website. The website aims to help contributors who have developed projects
around Flink share their work with the community.

Please see the following doc for more details.
https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#

Thanks,

Jiangjie (Becket) Qin

Re: [DISCUSS] Create a Flink ecosystem website

[vino yang <ya...@gmail.com>]

Hi Becket,

Great idea!
+1 for this proposal.

Best,
Vino

Bowen Li <bo...@gmail.com> 于2019年3月6日周三 上午6:24写道：

> Thanks for bring it up, Becket. That sounds very good to me. Spark also
> has such a page for ecosystem project
> https://spark.apache.org/third-party-projects.html and a hosted website
> https://spark-packages.org/ with metadata, categories/tags and stats
> mentioned in the doc.
>
> Bowen
>
> On Tue, Mar 5, 2019 at 9:36 AM Robert Metzger <rm...@apache.org> wrote:
>
>> Hey Becket,
>>
>> This is a great idea!
>> For this to be successful, we need to make sure the page is placed
>> prominently so that the people submitting something will get attention for
>> their contributions.
>> I think a dynamic site would probably be better, if we want features such
>> as up and downvoting or comments.
>> I would also like this to be hosted on Apache infra, and endorsed by the
>> community.
>>
>> Does anybody here know any existing software that we could use?
>> The only think I was able to find is AUR: https://aur.archlinux.org/
>> (which is a community packages site for Arch Linux. The source code of this
>> portal is open source, but the layout and structure is not an ideal fit for
>> our requirements)
>>
>> Best,
>> Robert
>>
>>
>>
>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>>
>>> Hi folks,
>>>
>>> I would like to start a discussion thread about creating a Flink
>>> ecosystem website. The website aims to help contributors who have developed
>>> projects around Flink share their work with the community.
>>>
>>> Please see the following doc for more details.
>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[vino yang <ya...@gmail.com>]

Hi Becket,

Great idea!
+1 for this proposal.

Best,
Vino

Bowen Li <bo...@gmail.com> 于2019年3月6日周三 上午6:24写道：

> Thanks for bring it up, Becket. That sounds very good to me. Spark also
> has such a page for ecosystem project
> https://spark.apache.org/third-party-projects.html and a hosted website
> https://spark-packages.org/ with metadata, categories/tags and stats
> mentioned in the doc.
>
> Bowen
>
> On Tue, Mar 5, 2019 at 9:36 AM Robert Metzger <rm...@apache.org> wrote:
>
>> Hey Becket,
>>
>> This is a great idea!
>> For this to be successful, we need to make sure the page is placed
>> prominently so that the people submitting something will get attention for
>> their contributions.
>> I think a dynamic site would probably be better, if we want features such
>> as up and downvoting or comments.
>> I would also like this to be hosted on Apache infra, and endorsed by the
>> community.
>>
>> Does anybody here know any existing software that we could use?
>> The only think I was able to find is AUR: https://aur.archlinux.org/
>> (which is a community packages site for Arch Linux. The source code of this
>> portal is open source, but the layout and structure is not an ideal fit for
>> our requirements)
>>
>> Best,
>> Robert
>>
>>
>>
>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>>
>>> Hi folks,
>>>
>>> I would like to start a discussion thread about creating a Flink
>>> ecosystem website. The website aims to help contributors who have developed
>>> projects around Flink share their work with the community.
>>>
>>> Please see the following doc for more details.
>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Bowen Li <bo...@gmail.com>]

Thanks for bring it up, Becket. That sounds very good to me. Spark also has
such a page for ecosystem project
https://spark.apache.org/third-party-projects.html and a hosted website
https://spark-packages.org/ with metadata, categories/tags and stats
mentioned in the doc.

Bowen

On Tue, Mar 5, 2019 at 9:36 AM Robert Metzger <rm...@apache.org> wrote:

> Hey Becket,
>
> This is a great idea!
> For this to be successful, we need to make sure the page is placed
> prominently so that the people submitting something will get attention for
> their contributions.
> I think a dynamic site would probably be better, if we want features such
> as up and downvoting or comments.
> I would also like this to be hosted on Apache infra, and endorsed by the
> community.
>
> Does anybody here know any existing software that we could use?
> The only think I was able to find is AUR: https://aur.archlinux.org/
> (which is a community packages site for Arch Linux. The source code of this
> portal is open source, but the layout and structure is not an ideal fit for
> our requirements)
>
> Best,
> Robert
>
>
>
> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>
>> Hi folks,
>>
>> I would like to start a discussion thread about creating a Flink
>> ecosystem website. The website aims to help contributors who have developed
>> projects around Flink share their work with the community.
>>
>> Please see the following doc for more details.
>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Bowen Li <bo...@gmail.com>]

Thanks for bring it up, Becket. That sounds very good to me. Spark also has
such a page for ecosystem project
https://spark.apache.org/third-party-projects.html and a hosted website
https://spark-packages.org/ with metadata, categories/tags and stats
mentioned in the doc.

Bowen

On Tue, Mar 5, 2019 at 9:36 AM Robert Metzger <rm...@apache.org> wrote:

> Hey Becket,
>
> This is a great idea!
> For this to be successful, we need to make sure the page is placed
> prominently so that the people submitting something will get attention for
> their contributions.
> I think a dynamic site would probably be better, if we want features such
> as up and downvoting or comments.
> I would also like this to be hosted on Apache infra, and endorsed by the
> community.
>
> Does anybody here know any existing software that we could use?
> The only think I was able to find is AUR: https://aur.archlinux.org/
> (which is a community packages site for Arch Linux. The source code of this
> portal is open source, but the layout and structure is not an ideal fit for
> our requirements)
>
> Best,
> Robert
>
>
>
> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>
>> Hi folks,
>>
>> I would like to start a discussion thread about creating a Flink
>> ecosystem website. The website aims to help contributors who have developed
>> projects around Flink share their work with the community.
>>
>> Please see the following doc for more details.
>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Oytun Tez <oy...@motaword.com>]

I agree with Robert – localization (this is what we do at MotaWord) is a
maintenance work. If not maintained as well as mainstream, it will only
damage and distant devs that use those local websites.

Re: comments, I don't think people will really discuss furiously. But we at
least need a system where we understand the popularity of a package, it
helps to pick among similar packages if any. Something like the popularity
figure here that we can fetch from somewhere:
https://mvnrepository.com/popular

---
Oytun Tez

*M O T A W O R D*
The World's Fastest Human Translation Platform.
oytun@motaword.com — www.motaword.com


On Tue, Jul 23, 2019 at 5:07 AM Robert Metzger <rm...@apache.org> wrote:

> Thanks a lot Marta for offering to write a blog post about the community
> site!
>
> I'm not sure if multi-language support for the site is a good idea. I see
> the packages site as something similar to GitHub or Jira. The page itself
> contains very view things we could actually translate. The package owners
> usually are only able to provide one or two languages for their package
> description.
> For the comments, we don't want disjoint discussions to happen.
>
> I've also kicked off a discussion with Apache legal on the initiative [1].
> We might not be able to host this at Apache, but let's see where the
> discussion goes.
>
>
> [1]
> https://lists.apache.org/thread.html/ee76a02257b51292ab61f6ac8d3d69307e83cc569cdeebde80596207@%3Clegal-discuss.apache.org%3E
>
>
> On Sat, Jul 20, 2019 at 5:25 AM Becket Qin <be...@gmail.com> wrote:
>
>> [Sorry for the incomplete message. Clicked send by mistake...]
>>
>> I agree with Marta that it might be good to have multi-language support
>> as a mid-term goal.
>>
>> Jiangjie (Becket) Qin
>>
>> On Sat, Jul 20, 2019 at 11:22 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> The website is awesome! I really like its conciseness and yet fairly
>>> useful information and functionalities. I cannot think of much to improve
>>> at the moment. Just one thought, do we need an "others" category, just in
>>> case a package does not fit into any of the current given categories?
>>>
>>> Thanks Robert and Daryl for the great effort. Looking forward to seeing
>>> this get published soon!!
>>>
>>> I agree with Marta that
>>>
>>> Jiangjie (Becket) Qin
>>>
>>> On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
>>> wrote:
>>>
>>>> Hey, Robert.
>>>>
>>>> I will keep an eye on the overall progress and get started on the blog
>>>> post
>>>> to make the community announcement. Are there (mid-term) plans to
>>>> translate/localize this website as well? It might be a point worth
>>>> mentioning in the blogpost.
>>>>
>>>> Hats off to you and Daryl — this turned out amazing!
>>>>
>>>> Marta
>>>>
>>>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
>>>> wrote:
>>>>
>>>> > Robert and Daryl, thanks for the great work, I tried the website and
>>>> filed
>>>> > some issues on Github.
>>>> > Best,
>>>> > Congxian
>>>> >
>>>> >
>>>> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>>>> >
>>>> >> Hey all,
>>>> >>
>>>> >> Daryl and I have great news to share. We are about to finish adding
>>>> the
>>>> >> basic features to the ecosystem page.
>>>> >> We are at a stage where it is ready to be reviewed and made public.
>>>> >>
>>>> >> You can either check out a development instance of the ecosystem page
>>>> >> here: https://flink-ecosystem-demo.flink-resources.org/
>>>> >> Or you run it locally, with the instructions from the README.md:
>>>> >> https://github.com/sorahn/flink-ecosystem
>>>> >>
>>>> >> Please report all issues you find here:
>>>> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>>>> >>
>>>> >> The next steps in this project are the following:
>>>> >> - We fix all issues reported through this testing
>>>> >> - We set up the site on the INFRA resources Becket has secured [1],
>>>> do
>>>> >> some further testing (including email notifications) and pre-fill
>>>> the page
>>>> >> with some packages.
>>>> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
>>>> >> domain
>>>> >> - We announce the packages through a short blog post
>>>> >>
>>>> >> Happy testing!
>>>> >>
>>>> >> Best,
>>>> >> Robert
>>>> >>
>>>> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>> >>
>>>> >>
>>>> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >>
>>>> >>> Thanks for the update, Robert. Looking forward to the website. If
>>>> there
>>>> >>> is already a list of software we need to run the website, we can
>>>> ask Apache
>>>> >>> infra team to prepare the VM for us, as that may also take some
>>>> time.
>>>> >>>
>>>> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>> wrote:
>>>> >>>
>>>> >>>> Hey all,
>>>> >>>>
>>>> >>>> quick update on this project: The frontend and backend code have
>>>> been
>>>> >>>> put together into this repository:
>>>> >>>> https://github.com/sorahn/flink-ecosystem
>>>> >>>> We also just agreed on an API specification, and will now work on
>>>> >>>> finishing the backend.
>>>> >>>>
>>>> >>>> It will probably take a few more weeks for this to finish, but we
>>>> are
>>>> >>>> making progress :)
>>>> >>>>
>>>> >>>> Best,
>>>> >>>> Robert
>>>> >>>>
>>>> >>>>
>>>> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>>> wrote:
>>>> >>>>
>>>> >>>>> Hey Daryl,
>>>> >>>>>
>>>> >>>>> thanks a lot for posting a link to this first prototype on the
>>>> mailing
>>>> >>>>> list! I really like it!
>>>> >>>>>
>>>> >>>>> Becket: Our plan forward is that Congxian is implementing the
>>>> backend
>>>> >>>>> for the website. He has already started with the work, but needs
>>>> at least
>>>> >>>>> one more week.
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> [Re-sending this email because the first one was blocked on
>>>> dev@f.a.o]
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>>> >>>>> wrote:
>>>> >>>>>
>>>> >>>>>> Hi Daryl,
>>>> >>>>>>
>>>> >>>>>> Thanks a lot for the update. The site looks awesome! This is a
>>>> great
>>>> >>>>>> progress. I really like the conciseness of GUI.
>>>> >>>>>>
>>>> >>>>>> One minor suggestion is that for the same library, there might be
>>>> >>>>>> multiple versions compatible with different Flink versions. It
>>>> would be
>>>> >>>>>> good to show that somewhere in the project page as it seems
>>>> important to
>>>> >>>>>> the users.
>>>> >>>>>>
>>>> >>>>>> BTW, will you share the plan to move forward? Would additional
>>>> hands
>>>> >>>>>> help?
>>>> >>>>>>
>>>> >>>>>> Thanks,
>>>> >>>>>>
>>>> >>>>>> Jiangjie (Becket) Qin
>>>> >>>>>>
>>>> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <
>>>> daryl@ververica.com>
>>>> >>>>>> wrote:
>>>> >>>>>>
>>>> >>>>>>> > Shall we add a guide page to show people how to publish their
>>>> >>>>>>> projects to the website? The exact rules can be discussed and
>>>> drafted in a
>>>> >>>>>>> separate email thread IMO
>>>> >>>>>>>
>>>> >>>>>>> This is a good idea. (Both the guise, and separate thread), I
>>>> think
>>>> >>>>>>> once there is an actual packed in place we’ll be in a lot
>>>> better position
>>>> >>>>>>> to discuss this.
>>>> >>>>>>>
>>>> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will
>>>> it
>>>> >>>>>>> only allow login for admins and publishers, or for everyone?
>>>> >>>>>>>
>>>> >>>>>>> Correct, all the oauth stuff requires a real server. We are
>>>> >>>>>>> currently just faking everything.
>>>> >>>>>>>
>>>> >>>>>>> I will add a mock-login page (username/password that just
>>>> accepts
>>>> >>>>>>> anything and displays whatever username you type in) so we can
>>>> see the
>>>> >>>>>>> add-comment field and add-packages page once they exist.
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Oytun Tez <oy...@motaword.com>]

I agree with Robert – localization (this is what we do at MotaWord) is a
maintenance work. If not maintained as well as mainstream, it will only
damage and distant devs that use those local websites.

Re: comments, I don't think people will really discuss furiously. But we at
least need a system where we understand the popularity of a package, it
helps to pick among similar packages if any. Something like the popularity
figure here that we can fetch from somewhere:
https://mvnrepository.com/popular

---
Oytun Tez

*M O T A W O R D*
The World's Fastest Human Translation Platform.
oytun@motaword.com — www.motaword.com


On Tue, Jul 23, 2019 at 5:07 AM Robert Metzger <rm...@apache.org> wrote:

> Thanks a lot Marta for offering to write a blog post about the community
> site!
>
> I'm not sure if multi-language support for the site is a good idea. I see
> the packages site as something similar to GitHub or Jira. The page itself
> contains very view things we could actually translate. The package owners
> usually are only able to provide one or two languages for their package
> description.
> For the comments, we don't want disjoint discussions to happen.
>
> I've also kicked off a discussion with Apache legal on the initiative [1].
> We might not be able to host this at Apache, but let's see where the
> discussion goes.
>
>
> [1]
> https://lists.apache.org/thread.html/ee76a02257b51292ab61f6ac8d3d69307e83cc569cdeebde80596207@%3Clegal-discuss.apache.org%3E
>
>
> On Sat, Jul 20, 2019 at 5:25 AM Becket Qin <be...@gmail.com> wrote:
>
>> [Sorry for the incomplete message. Clicked send by mistake...]
>>
>> I agree with Marta that it might be good to have multi-language support
>> as a mid-term goal.
>>
>> Jiangjie (Becket) Qin
>>
>> On Sat, Jul 20, 2019 at 11:22 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> The website is awesome! I really like its conciseness and yet fairly
>>> useful information and functionalities. I cannot think of much to improve
>>> at the moment. Just one thought, do we need an "others" category, just in
>>> case a package does not fit into any of the current given categories?
>>>
>>> Thanks Robert and Daryl for the great effort. Looking forward to seeing
>>> this get published soon!!
>>>
>>> I agree with Marta that
>>>
>>> Jiangjie (Becket) Qin
>>>
>>> On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
>>> wrote:
>>>
>>>> Hey, Robert.
>>>>
>>>> I will keep an eye on the overall progress and get started on the blog
>>>> post
>>>> to make the community announcement. Are there (mid-term) plans to
>>>> translate/localize this website as well? It might be a point worth
>>>> mentioning in the blogpost.
>>>>
>>>> Hats off to you and Daryl — this turned out amazing!
>>>>
>>>> Marta
>>>>
>>>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
>>>> wrote:
>>>>
>>>> > Robert and Daryl, thanks for the great work, I tried the website and
>>>> filed
>>>> > some issues on Github.
>>>> > Best,
>>>> > Congxian
>>>> >
>>>> >
>>>> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>>>> >
>>>> >> Hey all,
>>>> >>
>>>> >> Daryl and I have great news to share. We are about to finish adding
>>>> the
>>>> >> basic features to the ecosystem page.
>>>> >> We are at a stage where it is ready to be reviewed and made public.
>>>> >>
>>>> >> You can either check out a development instance of the ecosystem page
>>>> >> here: https://flink-ecosystem-demo.flink-resources.org/
>>>> >> Or you run it locally, with the instructions from the README.md:
>>>> >> https://github.com/sorahn/flink-ecosystem
>>>> >>
>>>> >> Please report all issues you find here:
>>>> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>>>> >>
>>>> >> The next steps in this project are the following:
>>>> >> - We fix all issues reported through this testing
>>>> >> - We set up the site on the INFRA resources Becket has secured [1],
>>>> do
>>>> >> some further testing (including email notifications) and pre-fill
>>>> the page
>>>> >> with some packages.
>>>> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
>>>> >> domain
>>>> >> - We announce the packages through a short blog post
>>>> >>
>>>> >> Happy testing!
>>>> >>
>>>> >> Best,
>>>> >> Robert
>>>> >>
>>>> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>> >>
>>>> >>
>>>> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >>
>>>> >>> Thanks for the update, Robert. Looking forward to the website. If
>>>> there
>>>> >>> is already a list of software we need to run the website, we can
>>>> ask Apache
>>>> >>> infra team to prepare the VM for us, as that may also take some
>>>> time.
>>>> >>>
>>>> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>> wrote:
>>>> >>>
>>>> >>>> Hey all,
>>>> >>>>
>>>> >>>> quick update on this project: The frontend and backend code have
>>>> been
>>>> >>>> put together into this repository:
>>>> >>>> https://github.com/sorahn/flink-ecosystem
>>>> >>>> We also just agreed on an API specification, and will now work on
>>>> >>>> finishing the backend.
>>>> >>>>
>>>> >>>> It will probably take a few more weeks for this to finish, but we
>>>> are
>>>> >>>> making progress :)
>>>> >>>>
>>>> >>>> Best,
>>>> >>>> Robert
>>>> >>>>
>>>> >>>>
>>>> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>>> wrote:
>>>> >>>>
>>>> >>>>> Hey Daryl,
>>>> >>>>>
>>>> >>>>> thanks a lot for posting a link to this first prototype on the
>>>> mailing
>>>> >>>>> list! I really like it!
>>>> >>>>>
>>>> >>>>> Becket: Our plan forward is that Congxian is implementing the
>>>> backend
>>>> >>>>> for the website. He has already started with the work, but needs
>>>> at least
>>>> >>>>> one more week.
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> [Re-sending this email because the first one was blocked on
>>>> dev@f.a.o]
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>>> >>>>> wrote:
>>>> >>>>>
>>>> >>>>>> Hi Daryl,
>>>> >>>>>>
>>>> >>>>>> Thanks a lot for the update. The site looks awesome! This is a
>>>> great
>>>> >>>>>> progress. I really like the conciseness of GUI.
>>>> >>>>>>
>>>> >>>>>> One minor suggestion is that for the same library, there might be
>>>> >>>>>> multiple versions compatible with different Flink versions. It
>>>> would be
>>>> >>>>>> good to show that somewhere in the project page as it seems
>>>> important to
>>>> >>>>>> the users.
>>>> >>>>>>
>>>> >>>>>> BTW, will you share the plan to move forward? Would additional
>>>> hands
>>>> >>>>>> help?
>>>> >>>>>>
>>>> >>>>>> Thanks,
>>>> >>>>>>
>>>> >>>>>> Jiangjie (Becket) Qin
>>>> >>>>>>
>>>> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <
>>>> daryl@ververica.com>
>>>> >>>>>> wrote:
>>>> >>>>>>
>>>> >>>>>>> > Shall we add a guide page to show people how to publish their
>>>> >>>>>>> projects to the website? The exact rules can be discussed and
>>>> drafted in a
>>>> >>>>>>> separate email thread IMO
>>>> >>>>>>>
>>>> >>>>>>> This is a good idea. (Both the guise, and separate thread), I
>>>> think
>>>> >>>>>>> once there is an actual packed in place we’ll be in a lot
>>>> better position
>>>> >>>>>>> to discuss this.
>>>> >>>>>>>
>>>> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will
>>>> it
>>>> >>>>>>> only allow login for admins and publishers, or for everyone?
>>>> >>>>>>>
>>>> >>>>>>> Correct, all the oauth stuff requires a real server. We are
>>>> >>>>>>> currently just faking everything.
>>>> >>>>>>>
>>>> >>>>>>> I will add a mock-login page (username/password that just
>>>> accepts
>>>> >>>>>>> anything and displays whatever username you type in) so we can
>>>> see the
>>>> >>>>>>> add-comment field and add-packages page once they exist.
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>>>>>>>>>>
>>>> >>>>>>>>>>>>>>>
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Thanks a lot Marta for offering to write a blog post about the community
site!

I'm not sure if multi-language support for the site is a good idea. I see
the packages site as something similar to GitHub or Jira. The page itself
contains very view things we could actually translate. The package owners
usually are only able to provide one or two languages for their package
description.
For the comments, we don't want disjoint discussions to happen.

I've also kicked off a discussion with Apache legal on the initiative [1].
We might not be able to host this at Apache, but let's see where the
discussion goes.


[1]
https://lists.apache.org/thread.html/ee76a02257b51292ab61f6ac8d3d69307e83cc569cdeebde80596207@%3Clegal-discuss.apache.org%3E


On Sat, Jul 20, 2019 at 5:25 AM Becket Qin <be...@gmail.com> wrote:

> [Sorry for the incomplete message. Clicked send by mistake...]
>
> I agree with Marta that it might be good to have multi-language support as
> a mid-term goal.
>
> Jiangjie (Becket) Qin
>
> On Sat, Jul 20, 2019 at 11:22 AM Becket Qin <be...@gmail.com> wrote:
>
>> The website is awesome! I really like its conciseness and yet fairly
>> useful information and functionalities. I cannot think of much to improve
>> at the moment. Just one thought, do we need an "others" category, just in
>> case a package does not fit into any of the current given categories?
>>
>> Thanks Robert and Daryl for the great effort. Looking forward to seeing
>> this get published soon!!
>>
>> I agree with Marta that
>>
>> Jiangjie (Becket) Qin
>>
>> On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
>> wrote:
>>
>>> Hey, Robert.
>>>
>>> I will keep an eye on the overall progress and get started on the blog
>>> post
>>> to make the community announcement. Are there (mid-term) plans to
>>> translate/localize this website as well? It might be a point worth
>>> mentioning in the blogpost.
>>>
>>> Hats off to you and Daryl — this turned out amazing!
>>>
>>> Marta
>>>
>>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
>>> wrote:
>>>
>>> > Robert and Daryl, thanks for the great work, I tried the website and
>>> filed
>>> > some issues on Github.
>>> > Best,
>>> > Congxian
>>> >
>>> >
>>> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>>> >
>>> >> Hey all,
>>> >>
>>> >> Daryl and I have great news to share. We are about to finish adding
>>> the
>>> >> basic features to the ecosystem page.
>>> >> We are at a stage where it is ready to be reviewed and made public.
>>> >>
>>> >> You can either check out a development instance of the ecosystem page
>>> >> here: https://flink-ecosystem-demo.flink-resources.org/
>>> >> Or you run it locally, with the instructions from the README.md:
>>> >> https://github.com/sorahn/flink-ecosystem
>>> >>
>>> >> Please report all issues you find here:
>>> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>>> >>
>>> >> The next steps in this project are the following:
>>> >> - We fix all issues reported through this testing
>>> >> - We set up the site on the INFRA resources Becket has secured [1], do
>>> >> some further testing (including email notifications) and pre-fill the
>>> page
>>> >> with some packages.
>>> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
>>> >> domain
>>> >> - We announce the packages through a short blog post
>>> >>
>>> >> Happy testing!
>>> >>
>>> >> Best,
>>> >> Robert
>>> >>
>>> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>> >>
>>> >>
>>> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >>
>>> >>> Thanks for the update, Robert. Looking forward to the website. If
>>> there
>>> >>> is already a list of software we need to run the website, we can ask
>>> Apache
>>> >>> infra team to prepare the VM for us, as that may also take some time.
>>> >>>
>>> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rmetzger@apache.org
>>> >
>>> >>> wrote:
>>> >>>
>>> >>>> Hey all,
>>> >>>>
>>> >>>> quick update on this project: The frontend and backend code have
>>> been
>>> >>>> put together into this repository:
>>> >>>> https://github.com/sorahn/flink-ecosystem
>>> >>>> We also just agreed on an API specification, and will now work on
>>> >>>> finishing the backend.
>>> >>>>
>>> >>>> It will probably take a few more weeks for this to finish, but we
>>> are
>>> >>>> making progress :)
>>> >>>>
>>> >>>> Best,
>>> >>>> Robert
>>> >>>>
>>> >>>>
>>> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <
>>> rmetzger@apache.org>
>>> >>>> wrote:
>>> >>>>
>>> >>>>> Hey Daryl,
>>> >>>>>
>>> >>>>> thanks a lot for posting a link to this first prototype on the
>>> mailing
>>> >>>>> list! I really like it!
>>> >>>>>
>>> >>>>> Becket: Our plan forward is that Congxian is implementing the
>>> backend
>>> >>>>> for the website. He has already started with the work, but needs
>>> at least
>>> >>>>> one more week.
>>> >>>>>
>>> >>>>>
>>> >>>>> [Re-sending this email because the first one was blocked on
>>> dev@f.a.o]
>>> >>>>>
>>> >>>>>
>>> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>> >>>>> wrote:
>>> >>>>>
>>> >>>>>> Hi Daryl,
>>> >>>>>>
>>> >>>>>> Thanks a lot for the update. The site looks awesome! This is a
>>> great
>>> >>>>>> progress. I really like the conciseness of GUI.
>>> >>>>>>
>>> >>>>>> One minor suggestion is that for the same library, there might be
>>> >>>>>> multiple versions compatible with different Flink versions. It
>>> would be
>>> >>>>>> good to show that somewhere in the project page as it seems
>>> important to
>>> >>>>>> the users.
>>> >>>>>>
>>> >>>>>> BTW, will you share the plan to move forward? Would additional
>>> hands
>>> >>>>>> help?
>>> >>>>>>
>>> >>>>>> Thanks,
>>> >>>>>>
>>> >>>>>> Jiangjie (Becket) Qin
>>> >>>>>>
>>> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <
>>> daryl@ververica.com>
>>> >>>>>> wrote:
>>> >>>>>>
>>> >>>>>>> > Shall we add a guide page to show people how to publish their
>>> >>>>>>> projects to the website? The exact rules can be discussed and
>>> drafted in a
>>> >>>>>>> separate email thread IMO
>>> >>>>>>>
>>> >>>>>>> This is a good idea. (Both the guise, and separate thread), I
>>> think
>>> >>>>>>> once there is an actual packed in place we’ll be in a lot better
>>> position
>>> >>>>>>> to discuss this.
>>> >>>>>>>
>>> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>>> >>>>>>> only allow login for admins and publishers, or for everyone?
>>> >>>>>>>
>>> >>>>>>> Correct, all the oauth stuff requires a real server. We are
>>> >>>>>>> currently just faking everything.
>>> >>>>>>>
>>> >>>>>>> I will add a mock-login page (username/password that just accepts
>>> >>>>>>> anything and displays whatever username you type in) so we can
>>> see the
>>> >>>>>>> add-comment field and add-packages page once they exist.
>>> >>>>>>>
>>> >>>>>>>
>>> >>>>>>>>>>>>>>>
>>> >>>>>>>>>>>>>>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Thanks a lot Marta for offering to write a blog post about the community
site!

I'm not sure if multi-language support for the site is a good idea. I see
the packages site as something similar to GitHub or Jira. The page itself
contains very view things we could actually translate. The package owners
usually are only able to provide one or two languages for their package
description.
For the comments, we don't want disjoint discussions to happen.

I've also kicked off a discussion with Apache legal on the initiative [1].
We might not be able to host this at Apache, but let's see where the
discussion goes.


[1]
https://lists.apache.org/thread.html/ee76a02257b51292ab61f6ac8d3d69307e83cc569cdeebde80596207@%3Clegal-discuss.apache.org%3E


On Sat, Jul 20, 2019 at 5:25 AM Becket Qin <be...@gmail.com> wrote:

> [Sorry for the incomplete message. Clicked send by mistake...]
>
> I agree with Marta that it might be good to have multi-language support as
> a mid-term goal.
>
> Jiangjie (Becket) Qin
>
> On Sat, Jul 20, 2019 at 11:22 AM Becket Qin <be...@gmail.com> wrote:
>
>> The website is awesome! I really like its conciseness and yet fairly
>> useful information and functionalities. I cannot think of much to improve
>> at the moment. Just one thought, do we need an "others" category, just in
>> case a package does not fit into any of the current given categories?
>>
>> Thanks Robert and Daryl for the great effort. Looking forward to seeing
>> this get published soon!!
>>
>> I agree with Marta that
>>
>> Jiangjie (Becket) Qin
>>
>> On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
>> wrote:
>>
>>> Hey, Robert.
>>>
>>> I will keep an eye on the overall progress and get started on the blog
>>> post
>>> to make the community announcement. Are there (mid-term) plans to
>>> translate/localize this website as well? It might be a point worth
>>> mentioning in the blogpost.
>>>
>>> Hats off to you and Daryl — this turned out amazing!
>>>
>>> Marta
>>>
>>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
>>> wrote:
>>>
>>> > Robert and Daryl, thanks for the great work, I tried the website and
>>> filed
>>> > some issues on Github.
>>> > Best,
>>> > Congxian
>>> >
>>> >
>>> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>>> >
>>> >> Hey all,
>>> >>
>>> >> Daryl and I have great news to share. We are about to finish adding
>>> the
>>> >> basic features to the ecosystem page.
>>> >> We are at a stage where it is ready to be reviewed and made public.
>>> >>
>>> >> You can either check out a development instance of the ecosystem page
>>> >> here: https://flink-ecosystem-demo.flink-resources.org/
>>> >> Or you run it locally, with the instructions from the README.md:
>>> >> https://github.com/sorahn/flink-ecosystem
>>> >>
>>> >> Please report all issues you find here:
>>> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>>> >>
>>> >> The next steps in this project are the following:
>>> >> - We fix all issues reported through this testing
>>> >> - We set up the site on the INFRA resources Becket has secured [1], do
>>> >> some further testing (including email notifications) and pre-fill the
>>> page
>>> >> with some packages.
>>> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
>>> >> domain
>>> >> - We announce the packages through a short blog post
>>> >>
>>> >> Happy testing!
>>> >>
>>> >> Best,
>>> >> Robert
>>> >>
>>> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>> >>
>>> >>
>>> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >>
>>> >>> Thanks for the update, Robert. Looking forward to the website. If
>>> there
>>> >>> is already a list of software we need to run the website, we can ask
>>> Apache
>>> >>> infra team to prepare the VM for us, as that may also take some time.
>>> >>>
>>> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rmetzger@apache.org
>>> >
>>> >>> wrote:
>>> >>>
>>> >>>> Hey all,
>>> >>>>
>>> >>>> quick update on this project: The frontend and backend code have
>>> been
>>> >>>> put together into this repository:
>>> >>>> https://github.com/sorahn/flink-ecosystem
>>> >>>> We also just agreed on an API specification, and will now work on
>>> >>>> finishing the backend.
>>> >>>>
>>> >>>> It will probably take a few more weeks for this to finish, but we
>>> are
>>> >>>> making progress :)
>>> >>>>
>>> >>>> Best,
>>> >>>> Robert
>>> >>>>
>>> >>>>
>>> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <
>>> rmetzger@apache.org>
>>> >>>> wrote:
>>> >>>>
>>> >>>>> Hey Daryl,
>>> >>>>>
>>> >>>>> thanks a lot for posting a link to this first prototype on the
>>> mailing
>>> >>>>> list! I really like it!
>>> >>>>>
>>> >>>>> Becket: Our plan forward is that Congxian is implementing the
>>> backend
>>> >>>>> for the website. He has already started with the work, but needs
>>> at least
>>> >>>>> one more week.
>>> >>>>>
>>> >>>>>
>>> >>>>> [Re-sending this email because the first one was blocked on
>>> dev@f.a.o]
>>> >>>>>
>>> >>>>>
>>> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>> >>>>> wrote:
>>> >>>>>
>>> >>>>>> Hi Daryl,
>>> >>>>>>
>>> >>>>>> Thanks a lot for the update. The site looks awesome! This is a
>>> great
>>> >>>>>> progress. I really like the conciseness of GUI.
>>> >>>>>>
>>> >>>>>> One minor suggestion is that for the same library, there might be
>>> >>>>>> multiple versions compatible with different Flink versions. It
>>> would be
>>> >>>>>> good to show that somewhere in the project page as it seems
>>> important to
>>> >>>>>> the users.
>>> >>>>>>
>>> >>>>>> BTW, will you share the plan to move forward? Would additional
>>> hands
>>> >>>>>> help?
>>> >>>>>>
>>> >>>>>> Thanks,
>>> >>>>>>
>>> >>>>>> Jiangjie (Becket) Qin
>>> >>>>>>
>>> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <
>>> daryl@ververica.com>
>>> >>>>>> wrote:
>>> >>>>>>
>>> >>>>>>> > Shall we add a guide page to show people how to publish their
>>> >>>>>>> projects to the website? The exact rules can be discussed and
>>> drafted in a
>>> >>>>>>> separate email thread IMO
>>> >>>>>>>
>>> >>>>>>> This is a good idea. (Both the guise, and separate thread), I
>>> think
>>> >>>>>>> once there is an actual packed in place we’ll be in a lot better
>>> position
>>> >>>>>>> to discuss this.
>>> >>>>>>>
>>> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>>> >>>>>>> only allow login for admins and publishers, or for everyone?
>>> >>>>>>>
>>> >>>>>>> Correct, all the oauth stuff requires a real server. We are
>>> >>>>>>> currently just faking everything.
>>> >>>>>>>
>>> >>>>>>> I will add a mock-login page (username/password that just accepts
>>> >>>>>>> anything and displays whatever username you type in) so we can
>>> see the
>>> >>>>>>> add-comment field and add-packages page once they exist.
>>> >>>>>>>
>>> >>>>>>>
>>> >>>>>>>>>>>>>>>
>>> >>>>>>>>>>>>>>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

[Sorry for the incomplete message. Clicked send by mistake...]

I agree with Marta that it might be good to have multi-language support as
a mid-term goal.

Jiangjie (Becket) Qin

On Sat, Jul 20, 2019 at 11:22 AM Becket Qin <be...@gmail.com> wrote:

> The website is awesome! I really like its conciseness and yet fairly
> useful information and functionalities. I cannot think of much to improve
> at the moment. Just one thought, do we need an "others" category, just in
> case a package does not fit into any of the current given categories?
>
> Thanks Robert and Daryl for the great effort. Looking forward to seeing
> this get published soon!!
>
> I agree with Marta that
>
> Jiangjie (Becket) Qin
>
> On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
> wrote:
>
>> Hey, Robert.
>>
>> I will keep an eye on the overall progress and get started on the blog
>> post
>> to make the community announcement. Are there (mid-term) plans to
>> translate/localize this website as well? It might be a point worth
>> mentioning in the blogpost.
>>
>> Hats off to you and Daryl — this turned out amazing!
>>
>> Marta
>>
>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
>> wrote:
>>
>> > Robert and Daryl, thanks for the great work, I tried the website and
>> filed
>> > some issues on Github.
>> > Best,
>> > Congxian
>> >
>> >
>> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>> >
>> >> Hey all,
>> >>
>> >> Daryl and I have great news to share. We are about to finish adding the
>> >> basic features to the ecosystem page.
>> >> We are at a stage where it is ready to be reviewed and made public.
>> >>
>> >> You can either check out a development instance of the ecosystem page
>> >> here: https://flink-ecosystem-demo.flink-resources.org/
>> >> Or you run it locally, with the instructions from the README.md:
>> >> https://github.com/sorahn/flink-ecosystem
>> >>
>> >> Please report all issues you find here:
>> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>> >>
>> >> The next steps in this project are the following:
>> >> - We fix all issues reported through this testing
>> >> - We set up the site on the INFRA resources Becket has secured [1], do
>> >> some further testing (including email notifications) and pre-fill the
>> page
>> >> with some packages.
>> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
>> >> domain
>> >> - We announce the packages through a short blog post
>> >>
>> >> Happy testing!
>> >>
>> >> Best,
>> >> Robert
>> >>
>> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
>> >>
>> >>
>> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
>> wrote:
>> >>
>> >>> Thanks for the update, Robert. Looking forward to the website. If
>> there
>> >>> is already a list of software we need to run the website, we can ask
>> Apache
>> >>> infra team to prepare the VM for us, as that may also take some time.
>> >>>
>> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
>> >>> wrote:
>> >>>
>> >>>> Hey all,
>> >>>>
>> >>>> quick update on this project: The frontend and backend code have been
>> >>>> put together into this repository:
>> >>>> https://github.com/sorahn/flink-ecosystem
>> >>>> We also just agreed on an API specification, and will now work on
>> >>>> finishing the backend.
>> >>>>
>> >>>> It will probably take a few more weeks for this to finish, but we are
>> >>>> making progress :)
>> >>>>
>> >>>> Best,
>> >>>> Robert
>> >>>>
>> >>>>
>> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rmetzger@apache.org
>> >
>> >>>> wrote:
>> >>>>
>> >>>>> Hey Daryl,
>> >>>>>
>> >>>>> thanks a lot for posting a link to this first prototype on the
>> mailing
>> >>>>> list! I really like it!
>> >>>>>
>> >>>>> Becket: Our plan forward is that Congxian is implementing the
>> backend
>> >>>>> for the website. He has already started with the work, but needs at
>> least
>> >>>>> one more week.
>> >>>>>
>> >>>>>
>> >>>>> [Re-sending this email because the first one was blocked on
>> dev@f.a.o]
>> >>>>>
>> >>>>>
>> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>> >>>>> wrote:
>> >>>>>
>> >>>>>> Hi Daryl,
>> >>>>>>
>> >>>>>> Thanks a lot for the update. The site looks awesome! This is a
>> great
>> >>>>>> progress. I really like the conciseness of GUI.
>> >>>>>>
>> >>>>>> One minor suggestion is that for the same library, there might be
>> >>>>>> multiple versions compatible with different Flink versions. It
>> would be
>> >>>>>> good to show that somewhere in the project page as it seems
>> important to
>> >>>>>> the users.
>> >>>>>>
>> >>>>>> BTW, will you share the plan to move forward? Would additional
>> hands
>> >>>>>> help?
>> >>>>>>
>> >>>>>> Thanks,
>> >>>>>>
>> >>>>>> Jiangjie (Becket) Qin
>> >>>>>>
>> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <daryl@ververica.com
>> >
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> > Shall we add a guide page to show people how to publish their
>> >>>>>>> projects to the website? The exact rules can be discussed and
>> drafted in a
>> >>>>>>> separate email thread IMO
>> >>>>>>>
>> >>>>>>> This is a good idea. (Both the guise, and separate thread), I
>> think
>> >>>>>>> once there is an actual packed in place we’ll be in a lot better
>> position
>> >>>>>>> to discuss this.
>> >>>>>>>
>> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>> >>>>>>> only allow login for admins and publishers, or for everyone?
>> >>>>>>>
>> >>>>>>> Correct, all the oauth stuff requires a real server. We are
>> >>>>>>> currently just faking everything.
>> >>>>>>>
>> >>>>>>> I will add a mock-login page (username/password that just accepts
>> >>>>>>> anything and displays whatever username you type in) so we can
>> see the
>> >>>>>>> add-comment field and add-packages page once they exist.
>> >>>>>>>
>> >>>>>>>
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

[Sorry for the incomplete message. Clicked send by mistake...]

I agree with Marta that it might be good to have multi-language support as
a mid-term goal.

Jiangjie (Becket) Qin

On Sat, Jul 20, 2019 at 11:22 AM Becket Qin <be...@gmail.com> wrote:

> The website is awesome! I really like its conciseness and yet fairly
> useful information and functionalities. I cannot think of much to improve
> at the moment. Just one thought, do we need an "others" category, just in
> case a package does not fit into any of the current given categories?
>
> Thanks Robert and Daryl for the great effort. Looking forward to seeing
> this get published soon!!
>
> I agree with Marta that
>
> Jiangjie (Becket) Qin
>
> On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
> wrote:
>
>> Hey, Robert.
>>
>> I will keep an eye on the overall progress and get started on the blog
>> post
>> to make the community announcement. Are there (mid-term) plans to
>> translate/localize this website as well? It might be a point worth
>> mentioning in the blogpost.
>>
>> Hats off to you and Daryl — this turned out amazing!
>>
>> Marta
>>
>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
>> wrote:
>>
>> > Robert and Daryl, thanks for the great work, I tried the website and
>> filed
>> > some issues on Github.
>> > Best,
>> > Congxian
>> >
>> >
>> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>> >
>> >> Hey all,
>> >>
>> >> Daryl and I have great news to share. We are about to finish adding the
>> >> basic features to the ecosystem page.
>> >> We are at a stage where it is ready to be reviewed and made public.
>> >>
>> >> You can either check out a development instance of the ecosystem page
>> >> here: https://flink-ecosystem-demo.flink-resources.org/
>> >> Or you run it locally, with the instructions from the README.md:
>> >> https://github.com/sorahn/flink-ecosystem
>> >>
>> >> Please report all issues you find here:
>> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>> >>
>> >> The next steps in this project are the following:
>> >> - We fix all issues reported through this testing
>> >> - We set up the site on the INFRA resources Becket has secured [1], do
>> >> some further testing (including email notifications) and pre-fill the
>> page
>> >> with some packages.
>> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
>> >> domain
>> >> - We announce the packages through a short blog post
>> >>
>> >> Happy testing!
>> >>
>> >> Best,
>> >> Robert
>> >>
>> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
>> >>
>> >>
>> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
>> wrote:
>> >>
>> >>> Thanks for the update, Robert. Looking forward to the website. If
>> there
>> >>> is already a list of software we need to run the website, we can ask
>> Apache
>> >>> infra team to prepare the VM for us, as that may also take some time.
>> >>>
>> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
>> >>> wrote:
>> >>>
>> >>>> Hey all,
>> >>>>
>> >>>> quick update on this project: The frontend and backend code have been
>> >>>> put together into this repository:
>> >>>> https://github.com/sorahn/flink-ecosystem
>> >>>> We also just agreed on an API specification, and will now work on
>> >>>> finishing the backend.
>> >>>>
>> >>>> It will probably take a few more weeks for this to finish, but we are
>> >>>> making progress :)
>> >>>>
>> >>>> Best,
>> >>>> Robert
>> >>>>
>> >>>>
>> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rmetzger@apache.org
>> >
>> >>>> wrote:
>> >>>>
>> >>>>> Hey Daryl,
>> >>>>>
>> >>>>> thanks a lot for posting a link to this first prototype on the
>> mailing
>> >>>>> list! I really like it!
>> >>>>>
>> >>>>> Becket: Our plan forward is that Congxian is implementing the
>> backend
>> >>>>> for the website. He has already started with the work, but needs at
>> least
>> >>>>> one more week.
>> >>>>>
>> >>>>>
>> >>>>> [Re-sending this email because the first one was blocked on
>> dev@f.a.o]
>> >>>>>
>> >>>>>
>> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>> >>>>> wrote:
>> >>>>>
>> >>>>>> Hi Daryl,
>> >>>>>>
>> >>>>>> Thanks a lot for the update. The site looks awesome! This is a
>> great
>> >>>>>> progress. I really like the conciseness of GUI.
>> >>>>>>
>> >>>>>> One minor suggestion is that for the same library, there might be
>> >>>>>> multiple versions compatible with different Flink versions. It
>> would be
>> >>>>>> good to show that somewhere in the project page as it seems
>> important to
>> >>>>>> the users.
>> >>>>>>
>> >>>>>> BTW, will you share the plan to move forward? Would additional
>> hands
>> >>>>>> help?
>> >>>>>>
>> >>>>>> Thanks,
>> >>>>>>
>> >>>>>> Jiangjie (Becket) Qin
>> >>>>>>
>> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <daryl@ververica.com
>> >
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> > Shall we add a guide page to show people how to publish their
>> >>>>>>> projects to the website? The exact rules can be discussed and
>> drafted in a
>> >>>>>>> separate email thread IMO
>> >>>>>>>
>> >>>>>>> This is a good idea. (Both the guise, and separate thread), I
>> think
>> >>>>>>> once there is an actual packed in place we’ll be in a lot better
>> position
>> >>>>>>> to discuss this.
>> >>>>>>>
>> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>> >>>>>>> only allow login for admins and publishers, or for everyone?
>> >>>>>>>
>> >>>>>>> Correct, all the oauth stuff requires a real server. We are
>> >>>>>>> currently just faking everything.
>> >>>>>>>
>> >>>>>>> I will add a mock-login page (username/password that just accepts
>> >>>>>>> anything and displays whatever username you type in) so we can
>> see the
>> >>>>>>> add-comment field and add-packages page once they exist.
>> >>>>>>>
>> >>>>>>>
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

The website is awesome! I really like its conciseness and yet fairly useful
information and functionalities. I cannot think of much to improve at the
moment. Just one thought, do we need an "others" category, just in case a
package does not fit into any of the current given categories?

Thanks Robert and Daryl for the great effort. Looking forward to seeing
this get published soon!!

I agree with Marta that

Jiangjie (Becket) Qin

On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
wrote:

> Hey, Robert.
>
> I will keep an eye on the overall progress and get started on the blog post
> to make the community announcement. Are there (mid-term) plans to
> translate/localize this website as well? It might be a point worth
> mentioning in the blogpost.
>
> Hats off to you and Daryl — this turned out amazing!
>
> Marta
>
> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
> wrote:
>
> > Robert and Daryl, thanks for the great work, I tried the website and
> filed
> > some issues on Github.
> > Best,
> > Congxian
> >
> >
> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
> >
> >> Hey all,
> >>
> >> Daryl and I have great news to share. We are about to finish adding the
> >> basic features to the ecosystem page.
> >> We are at a stage where it is ready to be reviewed and made public.
> >>
> >> You can either check out a development instance of the ecosystem page
> >> here: https://flink-ecosystem-demo.flink-resources.org/
> >> Or you run it locally, with the instructions from the README.md:
> >> https://github.com/sorahn/flink-ecosystem
> >>
> >> Please report all issues you find here:
> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
> >>
> >> The next steps in this project are the following:
> >> - We fix all issues reported through this testing
> >> - We set up the site on the INFRA resources Becket has secured [1], do
> >> some further testing (including email notifications) and pre-fill the
> page
> >> with some packages.
> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
> >> domain
> >> - We announce the packages through a short blog post
> >>
> >> Happy testing!
> >>
> >> Best,
> >> Robert
> >>
> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
> >>
> >>
> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
> wrote:
> >>
> >>> Thanks for the update, Robert. Looking forward to the website. If there
> >>> is already a list of software we need to run the website, we can ask
> Apache
> >>> infra team to prepare the VM for us, as that may also take some time.
> >>>
> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
> >>> wrote:
> >>>
> >>>> Hey all,
> >>>>
> >>>> quick update on this project: The frontend and backend code have been
> >>>> put together into this repository:
> >>>> https://github.com/sorahn/flink-ecosystem
> >>>> We also just agreed on an API specification, and will now work on
> >>>> finishing the backend.
> >>>>
> >>>> It will probably take a few more weeks for this to finish, but we are
> >>>> making progress :)
> >>>>
> >>>> Best,
> >>>> Robert
> >>>>
> >>>>
> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hey Daryl,
> >>>>>
> >>>>> thanks a lot for posting a link to this first prototype on the
> mailing
> >>>>> list! I really like it!
> >>>>>
> >>>>> Becket: Our plan forward is that Congxian is implementing the backend
> >>>>> for the website. He has already started with the work, but needs at
> least
> >>>>> one more week.
> >>>>>
> >>>>>
> >>>>> [Re-sending this email because the first one was blocked on dev@f.a.o
> ]
> >>>>>
> >>>>>
> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> Hi Daryl,
> >>>>>>
> >>>>>> Thanks a lot for the update. The site looks awesome! This is a great
> >>>>>> progress. I really like the conciseness of GUI.
> >>>>>>
> >>>>>> One minor suggestion is that for the same library, there might be
> >>>>>> multiple versions compatible with different Flink versions. It
> would be
> >>>>>> good to show that somewhere in the project page as it seems
> important to
> >>>>>> the users.
> >>>>>>
> >>>>>> BTW, will you share the plan to move forward? Would additional hands
> >>>>>> help?
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> Jiangjie (Becket) Qin
> >>>>>>
> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> > Shall we add a guide page to show people how to publish their
> >>>>>>> projects to the website? The exact rules can be discussed and
> drafted in a
> >>>>>>> separate email thread IMO
> >>>>>>>
> >>>>>>> This is a good idea. (Both the guise, and separate thread), I think
> >>>>>>> once there is an actual packed in place we’ll be in a lot better
> position
> >>>>>>> to discuss this.
> >>>>>>>
> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
> >>>>>>> only allow login for admins and publishers, or for everyone?
> >>>>>>>
> >>>>>>> Correct, all the oauth stuff requires a real server. We are
> >>>>>>> currently just faking everything.
> >>>>>>>
> >>>>>>> I will add a mock-login page (username/password that just accepts
> >>>>>>> anything and displays whatever username you type in) so we can see
> the
> >>>>>>> add-comment field and add-packages page once they exist.
> >>>>>>>
> >>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

The website is awesome! I really like its conciseness and yet fairly useful
information and functionalities. I cannot think of much to improve at the
moment. Just one thought, do we need an "others" category, just in case a
package does not fit into any of the current given categories?

Thanks Robert and Daryl for the great effort. Looking forward to seeing
this get published soon!!

I agree with Marta that

Jiangjie (Becket) Qin

On Sat, Jul 20, 2019 at 1:34 AM Marta Paes Moreira <ma...@ververica.com>
wrote:

> Hey, Robert.
>
> I will keep an eye on the overall progress and get started on the blog post
> to make the community announcement. Are there (mid-term) plans to
> translate/localize this website as well? It might be a point worth
> mentioning in the blogpost.
>
> Hats off to you and Daryl — this turned out amazing!
>
> Marta
>
> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
> wrote:
>
> > Robert and Daryl, thanks for the great work, I tried the website and
> filed
> > some issues on Github.
> > Best,
> > Congxian
> >
> >
> > Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
> >
> >> Hey all,
> >>
> >> Daryl and I have great news to share. We are about to finish adding the
> >> basic features to the ecosystem page.
> >> We are at a stage where it is ready to be reviewed and made public.
> >>
> >> You can either check out a development instance of the ecosystem page
> >> here: https://flink-ecosystem-demo.flink-resources.org/
> >> Or you run it locally, with the instructions from the README.md:
> >> https://github.com/sorahn/flink-ecosystem
> >>
> >> Please report all issues you find here:
> >> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
> >>
> >> The next steps in this project are the following:
> >> - We fix all issues reported through this testing
> >> - We set up the site on the INFRA resources Becket has secured [1], do
> >> some further testing (including email notifications) and pre-fill the
> page
> >> with some packages.
> >> - We set up a packages.flink.apache.org or flink.apache.org/packages
> >> domain
> >> - We announce the packages through a short blog post
> >>
> >> Happy testing!
> >>
> >> Best,
> >> Robert
> >>
> >> [1] https://issues.apache.org/jira/browse/INFRA-18010
> >>
> >>
> >> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com>
> wrote:
> >>
> >>> Thanks for the update, Robert. Looking forward to the website. If there
> >>> is already a list of software we need to run the website, we can ask
> Apache
> >>> infra team to prepare the VM for us, as that may also take some time.
> >>>
> >>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
> >>> wrote:
> >>>
> >>>> Hey all,
> >>>>
> >>>> quick update on this project: The frontend and backend code have been
> >>>> put together into this repository:
> >>>> https://github.com/sorahn/flink-ecosystem
> >>>> We also just agreed on an API specification, and will now work on
> >>>> finishing the backend.
> >>>>
> >>>> It will probably take a few more weeks for this to finish, but we are
> >>>> making progress :)
> >>>>
> >>>> Best,
> >>>> Robert
> >>>>
> >>>>
> >>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hey Daryl,
> >>>>>
> >>>>> thanks a lot for posting a link to this first prototype on the
> mailing
> >>>>> list! I really like it!
> >>>>>
> >>>>> Becket: Our plan forward is that Congxian is implementing the backend
> >>>>> for the website. He has already started with the work, but needs at
> least
> >>>>> one more week.
> >>>>>
> >>>>>
> >>>>> [Re-sending this email because the first one was blocked on dev@f.a.o
> ]
> >>>>>
> >>>>>
> >>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> Hi Daryl,
> >>>>>>
> >>>>>> Thanks a lot for the update. The site looks awesome! This is a great
> >>>>>> progress. I really like the conciseness of GUI.
> >>>>>>
> >>>>>> One minor suggestion is that for the same library, there might be
> >>>>>> multiple versions compatible with different Flink versions. It
> would be
> >>>>>> good to show that somewhere in the project page as it seems
> important to
> >>>>>> the users.
> >>>>>>
> >>>>>> BTW, will you share the plan to move forward? Would additional hands
> >>>>>> help?
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> Jiangjie (Becket) Qin
> >>>>>>
> >>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> > Shall we add a guide page to show people how to publish their
> >>>>>>> projects to the website? The exact rules can be discussed and
> drafted in a
> >>>>>>> separate email thread IMO
> >>>>>>>
> >>>>>>> This is a good idea. (Both the guise, and separate thread), I think
> >>>>>>> once there is an actual packed in place we’ll be in a lot better
> position
> >>>>>>> to discuss this.
> >>>>>>>
> >>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
> >>>>>>> only allow login for admins and publishers, or for everyone?
> >>>>>>>
> >>>>>>> Correct, all the oauth stuff requires a real server. We are
> >>>>>>> currently just faking everything.
> >>>>>>>
> >>>>>>> I will add a mock-login page (username/password that just accepts
> >>>>>>> anything and displays whatever username you type in) so we can see
> the
> >>>>>>> add-comment field and add-packages page once they exist.
> >>>>>>>
> >>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Marta Paes Moreira <ma...@ververica.com>]

Hey, Robert.

I will keep an eye on the overall progress and get started on the blog post
to make the community announcement. Are there (mid-term) plans to
translate/localize this website as well? It might be a point worth
mentioning in the blogpost.

Hats off to you and Daryl — this turned out amazing!

Marta

On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
wrote:

> Robert and Daryl, thanks for the great work, I tried the website and filed
> some issues on Github.
> Best,
> Congxian
>
>
> Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>
>> Hey all,
>>
>> Daryl and I have great news to share. We are about to finish adding the
>> basic features to the ecosystem page.
>> We are at a stage where it is ready to be reviewed and made public.
>>
>> You can either check out a development instance of the ecosystem page
>> here: https://flink-ecosystem-demo.flink-resources.org/
>> Or you run it locally, with the instructions from the README.md:
>> https://github.com/sorahn/flink-ecosystem
>>
>> Please report all issues you find here:
>> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>>
>> The next steps in this project are the following:
>> - We fix all issues reported through this testing
>> - We set up the site on the INFRA resources Becket has secured [1], do
>> some further testing (including email notifications) and pre-fill the page
>> with some packages.
>> - We set up a packages.flink.apache.org or flink.apache.org/packages
>> domain
>> - We announce the packages through a short blog post
>>
>> Happy testing!
>>
>> Best,
>> Robert
>>
>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>
>>
>> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> Thanks for the update, Robert. Looking forward to the website. If there
>>> is already a list of software we need to run the website, we can ask Apache
>>> infra team to prepare the VM for us, as that may also take some time.
>>>
>>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Hey all,
>>>>
>>>> quick update on this project: The frontend and backend code have been
>>>> put together into this repository:
>>>> https://github.com/sorahn/flink-ecosystem
>>>> We also just agreed on an API specification, and will now work on
>>>> finishing the backend.
>>>>
>>>> It will probably take a few more weeks for this to finish, but we are
>>>> making progress :)
>>>>
>>>> Best,
>>>> Robert
>>>>
>>>>
>>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>>> Hey Daryl,
>>>>>
>>>>> thanks a lot for posting a link to this first prototype on the mailing
>>>>> list! I really like it!
>>>>>
>>>>> Becket: Our plan forward is that Congxian is implementing the backend
>>>>> for the website. He has already started with the work, but needs at least
>>>>> one more week.
>>>>>
>>>>>
>>>>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>>>>
>>>>>
>>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Daryl,
>>>>>>
>>>>>> Thanks a lot for the update. The site looks awesome! This is a great
>>>>>> progress. I really like the conciseness of GUI.
>>>>>>
>>>>>> One minor suggestion is that for the same library, there might be
>>>>>> multiple versions compatible with different Flink versions. It would be
>>>>>> good to show that somewhere in the project page as it seems important to
>>>>>> the users.
>>>>>>
>>>>>> BTW, will you share the plan to move forward? Would additional hands
>>>>>> help?
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Jiangjie (Becket) Qin
>>>>>>
>>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>>>>> wrote:
>>>>>>
>>>>>>> > Shall we add a guide page to show people how to publish their
>>>>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>>>>> separate email thread IMO
>>>>>>>
>>>>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>>>>> once there is an actual packed in place we’ll be in a lot better position
>>>>>>> to discuss this.
>>>>>>>
>>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>>>>>>> only allow login for admins and publishers, or for everyone?
>>>>>>>
>>>>>>> Correct, all the oauth stuff requires a real server. We are
>>>>>>> currently just faking everything.
>>>>>>>
>>>>>>> I will add a mock-login page (username/password that just accepts
>>>>>>> anything and displays whatever username you type in) so we can see the
>>>>>>> add-comment field and add-packages page once they exist.
>>>>>>>
>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Marta Paes Moreira <ma...@ververica.com>]

Hey, Robert.

I will keep an eye on the overall progress and get started on the blog post
to make the community announcement. Are there (mid-term) plans to
translate/localize this website as well? It might be a point worth
mentioning in the blogpost.

Hats off to you and Daryl — this turned out amazing!

Marta

On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu <qc...@gmail.com>
wrote:

> Robert and Daryl, thanks for the great work, I tried the website and filed
> some issues on Github.
> Best,
> Congxian
>
>
> Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：
>
>> Hey all,
>>
>> Daryl and I have great news to share. We are about to finish adding the
>> basic features to the ecosystem page.
>> We are at a stage where it is ready to be reviewed and made public.
>>
>> You can either check out a development instance of the ecosystem page
>> here: https://flink-ecosystem-demo.flink-resources.org/
>> Or you run it locally, with the instructions from the README.md:
>> https://github.com/sorahn/flink-ecosystem
>>
>> Please report all issues you find here:
>> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>>
>> The next steps in this project are the following:
>> - We fix all issues reported through this testing
>> - We set up the site on the INFRA resources Becket has secured [1], do
>> some further testing (including email notifications) and pre-fill the page
>> with some packages.
>> - We set up a packages.flink.apache.org or flink.apache.org/packages
>> domain
>> - We announce the packages through a short blog post
>>
>> Happy testing!
>>
>> Best,
>> Robert
>>
>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>
>>
>> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> Thanks for the update, Robert. Looking forward to the website. If there
>>> is already a list of software we need to run the website, we can ask Apache
>>> infra team to prepare the VM for us, as that may also take some time.
>>>
>>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Hey all,
>>>>
>>>> quick update on this project: The frontend and backend code have been
>>>> put together into this repository:
>>>> https://github.com/sorahn/flink-ecosystem
>>>> We also just agreed on an API specification, and will now work on
>>>> finishing the backend.
>>>>
>>>> It will probably take a few more weeks for this to finish, but we are
>>>> making progress :)
>>>>
>>>> Best,
>>>> Robert
>>>>
>>>>
>>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>>> Hey Daryl,
>>>>>
>>>>> thanks a lot for posting a link to this first prototype on the mailing
>>>>> list! I really like it!
>>>>>
>>>>> Becket: Our plan forward is that Congxian is implementing the backend
>>>>> for the website. He has already started with the work, but needs at least
>>>>> one more week.
>>>>>
>>>>>
>>>>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>>>>
>>>>>
>>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Daryl,
>>>>>>
>>>>>> Thanks a lot for the update. The site looks awesome! This is a great
>>>>>> progress. I really like the conciseness of GUI.
>>>>>>
>>>>>> One minor suggestion is that for the same library, there might be
>>>>>> multiple versions compatible with different Flink versions. It would be
>>>>>> good to show that somewhere in the project page as it seems important to
>>>>>> the users.
>>>>>>
>>>>>> BTW, will you share the plan to move forward? Would additional hands
>>>>>> help?
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Jiangjie (Becket) Qin
>>>>>>
>>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>>>>> wrote:
>>>>>>
>>>>>>> > Shall we add a guide page to show people how to publish their
>>>>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>>>>> separate email thread IMO
>>>>>>>
>>>>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>>>>> once there is an actual packed in place we’ll be in a lot better position
>>>>>>> to discuss this.
>>>>>>>
>>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>>>>>>> only allow login for admins and publishers, or for everyone?
>>>>>>>
>>>>>>> Correct, all the oauth stuff requires a real server. We are
>>>>>>> currently just faking everything.
>>>>>>>
>>>>>>> I will add a mock-login page (username/password that just accepts
>>>>>>> anything and displays whatever username you type in) so we can see the
>>>>>>> add-comment field and add-packages page once they exist.
>>>>>>>
>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Congxian Qiu <qc...@gmail.com>]

Robert and Daryl, thanks for the great work, I tried the website and filed
some issues on Github.
Best,
Congxian


Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：

> Hey all,
>
> Daryl and I have great news to share. We are about to finish adding the
> basic features to the ecosystem page.
> We are at a stage where it is ready to be reviewed and made public.
>
> You can either check out a development instance of the ecosystem page
> here: https://flink-ecosystem-demo.flink-resources.org/
> Or you run it locally, with the instructions from the README.md:
> https://github.com/sorahn/flink-ecosystem
>
> Please report all issues you find here:
> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>
> The next steps in this project are the following:
> - We fix all issues reported through this testing
> - We set up the site on the INFRA resources Becket has secured [1], do
> some further testing (including email notifications) and pre-fill the page
> with some packages.
> - We set up a packages.flink.apache.org or flink.apache.org/packages
> domain
> - We announce the packages through a short blog post
>
> Happy testing!
>
> Best,
> Robert
>
> [1] https://issues.apache.org/jira/browse/INFRA-18010
>
>
> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com> wrote:
>
>> Thanks for the update, Robert. Looking forward to the website. If there
>> is already a list of software we need to run the website, we can ask Apache
>> infra team to prepare the VM for us, as that may also take some time.
>>
>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Hey all,
>>>
>>> quick update on this project: The frontend and backend code have been
>>> put together into this repository:
>>> https://github.com/sorahn/flink-ecosystem
>>> We also just agreed on an API specification, and will now work on
>>> finishing the backend.
>>>
>>> It will probably take a few more weeks for this to finish, but we are
>>> making progress :)
>>>
>>> Best,
>>> Robert
>>>
>>>
>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Hey Daryl,
>>>>
>>>> thanks a lot for posting a link to this first prototype on the mailing
>>>> list! I really like it!
>>>>
>>>> Becket: Our plan forward is that Congxian is implementing the backend
>>>> for the website. He has already started with the work, but needs at least
>>>> one more week.
>>>>
>>>>
>>>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>>>
>>>>
>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Daryl,
>>>>>
>>>>> Thanks a lot for the update. The site looks awesome! This is a great
>>>>> progress. I really like the conciseness of GUI.
>>>>>
>>>>> One minor suggestion is that for the same library, there might be
>>>>> multiple versions compatible with different Flink versions. It would be
>>>>> good to show that somewhere in the project page as it seems important to
>>>>> the users.
>>>>>
>>>>> BTW, will you share the plan to move forward? Would additional hands
>>>>> help?
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Jiangjie (Becket) Qin
>>>>>
>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>>>> wrote:
>>>>>
>>>>>> > Shall we add a guide page to show people how to publish their
>>>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>>>> separate email thread IMO
>>>>>>
>>>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>>>> once there is an actual packed in place we’ll be in a lot better position
>>>>>> to discuss this.
>>>>>>
>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>>>>>> only allow login for admins and publishers, or for everyone?
>>>>>>
>>>>>> Correct, all the oauth stuff requires a real server. We are currently
>>>>>> just faking everything.
>>>>>>
>>>>>> I will add a mock-login page (username/password that just accepts
>>>>>> anything and displays whatever username you type in) so we can see the
>>>>>> add-comment field and add-packages page once they exist.
>>>>>>
>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Congxian Qiu <qc...@gmail.com>]

Robert and Daryl, thanks for the great work, I tried the website and filed
some issues on Github.
Best,
Congxian


Robert Metzger <rm...@apache.org> 于2019年7月17日周三 下午11:28写道：

> Hey all,
>
> Daryl and I have great news to share. We are about to finish adding the
> basic features to the ecosystem page.
> We are at a stage where it is ready to be reviewed and made public.
>
> You can either check out a development instance of the ecosystem page
> here: https://flink-ecosystem-demo.flink-resources.org/
> Or you run it locally, with the instructions from the README.md:
> https://github.com/sorahn/flink-ecosystem
>
> Please report all issues you find here:
> https://github.com/sorahn/flink-ecosystem/issues or in this thread.
>
> The next steps in this project are the following:
> - We fix all issues reported through this testing
> - We set up the site on the INFRA resources Becket has secured [1], do
> some further testing (including email notifications) and pre-fill the page
> with some packages.
> - We set up a packages.flink.apache.org or flink.apache.org/packages
> domain
> - We announce the packages through a short blog post
>
> Happy testing!
>
> Best,
> Robert
>
> [1] https://issues.apache.org/jira/browse/INFRA-18010
>
>
> On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com> wrote:
>
>> Thanks for the update, Robert. Looking forward to the website. If there
>> is already a list of software we need to run the website, we can ask Apache
>> infra team to prepare the VM for us, as that may also take some time.
>>
>> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Hey all,
>>>
>>> quick update on this project: The frontend and backend code have been
>>> put together into this repository:
>>> https://github.com/sorahn/flink-ecosystem
>>> We also just agreed on an API specification, and will now work on
>>> finishing the backend.
>>>
>>> It will probably take a few more weeks for this to finish, but we are
>>> making progress :)
>>>
>>> Best,
>>> Robert
>>>
>>>
>>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Hey Daryl,
>>>>
>>>> thanks a lot for posting a link to this first prototype on the mailing
>>>> list! I really like it!
>>>>
>>>> Becket: Our plan forward is that Congxian is implementing the backend
>>>> for the website. He has already started with the work, but needs at least
>>>> one more week.
>>>>
>>>>
>>>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>>>
>>>>
>>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Daryl,
>>>>>
>>>>> Thanks a lot for the update. The site looks awesome! This is a great
>>>>> progress. I really like the conciseness of GUI.
>>>>>
>>>>> One minor suggestion is that for the same library, there might be
>>>>> multiple versions compatible with different Flink versions. It would be
>>>>> good to show that somewhere in the project page as it seems important to
>>>>> the users.
>>>>>
>>>>> BTW, will you share the plan to move forward? Would additional hands
>>>>> help?
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Jiangjie (Becket) Qin
>>>>>
>>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>>>> wrote:
>>>>>
>>>>>> > Shall we add a guide page to show people how to publish their
>>>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>>>> separate email thread IMO
>>>>>>
>>>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>>>> once there is an actual packed in place we’ll be in a lot better position
>>>>>> to discuss this.
>>>>>>
>>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it
>>>>>> only allow login for admins and publishers, or for everyone?
>>>>>>
>>>>>> Correct, all the oauth stuff requires a real server. We are currently
>>>>>> just faking everything.
>>>>>>
>>>>>> I will add a mock-login page (username/password that just accepts
>>>>>> anything and displays whatever username you type in) so we can see the
>>>>>> add-comment field and add-packages page once they exist.
>>>>>>
>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey all,

Daryl and I have great news to share. We are about to finish adding the
basic features to the ecosystem page.
We are at a stage where it is ready to be reviewed and made public.

You can either check out a development instance of the ecosystem page here:
https://flink-ecosystem-demo.flink-resources.org/
Or you run it locally, with the instructions from the README.md:
https://github.com/sorahn/flink-ecosystem

Please report all issues you find here:
https://github.com/sorahn/flink-ecosystem/issues or in this thread.

The next steps in this project are the following:
- We fix all issues reported through this testing
- We set up the site on the INFRA resources Becket has secured [1], do some
further testing (including email notifications) and pre-fill the page with
some packages.
- We set up a packages.flink.apache.org or flink.apache.org/packages domain
- We announce the packages through a short blog post

Happy testing!

Best,
Robert

[1] https://issues.apache.org/jira/browse/INFRA-18010


On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com> wrote:

> Thanks for the update, Robert. Looking forward to the website. If there is
> already a list of software we need to run the website, we can ask Apache
> infra team to prepare the VM for us, as that may also take some time.
>
> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Hey all,
>>
>> quick update on this project: The frontend and backend code have been put
>> together into this repository: https://github.com/sorahn/flink-ecosystem
>> We also just agreed on an API specification, and will now work on
>> finishing the backend.
>>
>> It will probably take a few more weeks for this to finish, but we are
>> making progress :)
>>
>> Best,
>> Robert
>>
>>
>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Hey Daryl,
>>>
>>> thanks a lot for posting a link to this first prototype on the mailing
>>> list! I really like it!
>>>
>>> Becket: Our plan forward is that Congxian is implementing the backend
>>> for the website. He has already started with the work, but needs at least
>>> one more week.
>>>
>>>
>>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>>
>>>
>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> Hi Daryl,
>>>>
>>>> Thanks a lot for the update. The site looks awesome! This is a great
>>>> progress. I really like the conciseness of GUI.
>>>>
>>>> One minor suggestion is that for the same library, there might be
>>>> multiple versions compatible with different Flink versions. It would be
>>>> good to show that somewhere in the project page as it seems important to
>>>> the users.
>>>>
>>>> BTW, will you share the plan to move forward? Would additional hands
>>>> help?
>>>>
>>>> Thanks,
>>>>
>>>> Jiangjie (Becket) Qin
>>>>
>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>>> wrote:
>>>>
>>>>> > Shall we add a guide page to show people how to publish their
>>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>>> separate email thread IMO
>>>>>
>>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>>> once there is an actual packed in place we’ll be in a lot better position
>>>>> to discuss this.
>>>>>
>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>>>>> allow login for admins and publishers, or for everyone?
>>>>>
>>>>> Correct, all the oauth stuff requires a real server. We are currently
>>>>> just faking everything.
>>>>>
>>>>> I will add a mock-login page (username/password that just accepts
>>>>> anything and displays whatever username you type in) so we can see the
>>>>> add-comment field and add-packages page once they exist.
>>>>>
>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey all,

Daryl and I have great news to share. We are about to finish adding the
basic features to the ecosystem page.
We are at a stage where it is ready to be reviewed and made public.

You can either check out a development instance of the ecosystem page here:
https://flink-ecosystem-demo.flink-resources.org/
Or you run it locally, with the instructions from the README.md:
https://github.com/sorahn/flink-ecosystem

Please report all issues you find here:
https://github.com/sorahn/flink-ecosystem/issues or in this thread.

The next steps in this project are the following:
- We fix all issues reported through this testing
- We set up the site on the INFRA resources Becket has secured [1], do some
further testing (including email notifications) and pre-fill the page with
some packages.
- We set up a packages.flink.apache.org or flink.apache.org/packages domain
- We announce the packages through a short blog post

Happy testing!

Best,
Robert

[1] https://issues.apache.org/jira/browse/INFRA-18010


On Thu, Apr 25, 2019 at 6:23 AM Becket Qin <be...@gmail.com> wrote:

> Thanks for the update, Robert. Looking forward to the website. If there is
> already a list of software we need to run the website, we can ask Apache
> infra team to prepare the VM for us, as that may also take some time.
>
> On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Hey all,
>>
>> quick update on this project: The frontend and backend code have been put
>> together into this repository: https://github.com/sorahn/flink-ecosystem
>> We also just agreed on an API specification, and will now work on
>> finishing the backend.
>>
>> It will probably take a few more weeks for this to finish, but we are
>> making progress :)
>>
>> Best,
>> Robert
>>
>>
>> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Hey Daryl,
>>>
>>> thanks a lot for posting a link to this first prototype on the mailing
>>> list! I really like it!
>>>
>>> Becket: Our plan forward is that Congxian is implementing the backend
>>> for the website. He has already started with the work, but needs at least
>>> one more week.
>>>
>>>
>>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>>
>>>
>>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> Hi Daryl,
>>>>
>>>> Thanks a lot for the update. The site looks awesome! This is a great
>>>> progress. I really like the conciseness of GUI.
>>>>
>>>> One minor suggestion is that for the same library, there might be
>>>> multiple versions compatible with different Flink versions. It would be
>>>> good to show that somewhere in the project page as it seems important to
>>>> the users.
>>>>
>>>> BTW, will you share the plan to move forward? Would additional hands
>>>> help?
>>>>
>>>> Thanks,
>>>>
>>>> Jiangjie (Becket) Qin
>>>>
>>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>>> wrote:
>>>>
>>>>> > Shall we add a guide page to show people how to publish their
>>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>>> separate email thread IMO
>>>>>
>>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>>> once there is an actual packed in place we’ll be in a lot better position
>>>>> to discuss this.
>>>>>
>>>>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>>>>> allow login for admins and publishers, or for everyone?
>>>>>
>>>>> Correct, all the oauth stuff requires a real server. We are currently
>>>>> just faking everything.
>>>>>
>>>>> I will add a mock-login page (username/password that just accepts
>>>>> anything and displays whatever username you type in) so we can see the
>>>>> add-comment field and add-packages page once they exist.
>>>>>
>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Thanks for the update, Robert. Looking forward to the website. If there is
already a list of software we need to run the website, we can ask Apache
infra team to prepare the VM for us, as that may also take some time.

On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org> wrote:

> Hey all,
>
> quick update on this project: The frontend and backend code have been put
> together into this repository: https://github.com/sorahn/flink-ecosystem
> We also just agreed on an API specification, and will now work on
> finishing the backend.
>
> It will probably take a few more weeks for this to finish, but we are
> making progress :)
>
> Best,
> Robert
>
>
> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Hey Daryl,
>>
>> thanks a lot for posting a link to this first prototype on the mailing
>> list! I really like it!
>>
>> Becket: Our plan forward is that Congxian is implementing the backend for
>> the website. He has already started with the work, but needs at least one
>> more week.
>>
>>
>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>
>>
>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> Hi Daryl,
>>>
>>> Thanks a lot for the update. The site looks awesome! This is a great
>>> progress. I really like the conciseness of GUI.
>>>
>>> One minor suggestion is that for the same library, there might be
>>> multiple versions compatible with different Flink versions. It would be
>>> good to show that somewhere in the project page as it seems important to
>>> the users.
>>>
>>> BTW, will you share the plan to move forward? Would additional hands
>>> help?
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>> wrote:
>>>
>>>> > Shall we add a guide page to show people how to publish their
>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>> separate email thread IMO
>>>>
>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>> once there is an actual packed in place we’ll be in a lot better position
>>>> to discuss this.
>>>>
>>>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>>>> allow login for admins and publishers, or for everyone?
>>>>
>>>> Correct, all the oauth stuff requires a real server. We are currently
>>>> just faking everything.
>>>>
>>>> I will add a mock-login page (username/password that just accepts
>>>> anything and displays whatever username you type in) so we can see the
>>>> add-comment field and add-packages page once they exist.
>>>>
>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Thanks for the update, Robert. Looking forward to the website. If there is
already a list of software we need to run the website, we can ask Apache
infra team to prepare the VM for us, as that may also take some time.

On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger <rm...@apache.org> wrote:

> Hey all,
>
> quick update on this project: The frontend and backend code have been put
> together into this repository: https://github.com/sorahn/flink-ecosystem
> We also just agreed on an API specification, and will now work on
> finishing the backend.
>
> It will probably take a few more weeks for this to finish, but we are
> making progress :)
>
> Best,
> Robert
>
>
> On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Hey Daryl,
>>
>> thanks a lot for posting a link to this first prototype on the mailing
>> list! I really like it!
>>
>> Becket: Our plan forward is that Congxian is implementing the backend for
>> the website. He has already started with the work, but needs at least one
>> more week.
>>
>>
>> [Re-sending this email because the first one was blocked on dev@f.a.o]
>>
>>
>> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> Hi Daryl,
>>>
>>> Thanks a lot for the update. The site looks awesome! This is a great
>>> progress. I really like the conciseness of GUI.
>>>
>>> One minor suggestion is that for the same library, there might be
>>> multiple versions compatible with different Flink versions. It would be
>>> good to show that somewhere in the project page as it seems important to
>>> the users.
>>>
>>> BTW, will you share the plan to move forward? Would additional hands
>>> help?
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>>> wrote:
>>>
>>>> > Shall we add a guide page to show people how to publish their
>>>> projects to the website? The exact rules can be discussed and drafted in a
>>>> separate email thread IMO
>>>>
>>>> This is a good idea. (Both the guise, and separate thread), I think
>>>> once there is an actual packed in place we’ll be in a lot better position
>>>> to discuss this.
>>>>
>>>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>>>> allow login for admins and publishers, or for everyone?
>>>>
>>>> Correct, all the oauth stuff requires a real server. We are currently
>>>> just faking everything.
>>>>
>>>> I will add a mock-login page (username/password that just accepts
>>>> anything and displays whatever username you type in) so we can see the
>>>> add-comment field and add-packages page once they exist.
>>>>
>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey all,

quick update on this project: The frontend and backend code have been put
together into this repository: https://github.com/sorahn/flink-ecosystem
We also just agreed on an API specification, and will now work on finishing
the backend.

It will probably take a few more weeks for this to finish, but we are
making progress :)

Best,
Robert


On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org> wrote:

> Hey Daryl,
>
> thanks a lot for posting a link to this first prototype on the mailing
> list! I really like it!
>
> Becket: Our plan forward is that Congxian is implementing the backend for
> the website. He has already started with the work, but needs at least one
> more week.
>
>
> [Re-sending this email because the first one was blocked on dev@f.a.o]
>
>
> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:
>
>> Hi Daryl,
>>
>> Thanks a lot for the update. The site looks awesome! This is a great
>> progress. I really like the conciseness of GUI.
>>
>> One minor suggestion is that for the same library, there might be
>> multiple versions compatible with different Flink versions. It would be
>> good to show that somewhere in the project page as it seems important to
>> the users.
>>
>> BTW, will you share the plan to move forward? Would additional hands help?
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>> wrote:
>>
>>> > Shall we add a guide page to show people how to publish their projects
>>> to the website? The exact rules can be discussed and drafted in a separate
>>> email thread IMO
>>>
>>> This is a good idea. (Both the guise, and separate thread), I think once
>>> there is an actual packed in place we’ll be in a lot better position to
>>> discuss this.
>>>
>>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>>> allow login for admins and publishers, or for everyone?
>>>
>>> Correct, all the oauth stuff requires a real server. We are currently
>>> just faking everything.
>>>
>>> I will add a mock-login page (username/password that just accepts
>>> anything and displays whatever username you type in) so we can see the
>>> add-comment field and add-packages page once they exist.
>>>
>>>
>>>>>>>>>>>
>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey all,

quick update on this project: The frontend and backend code have been put
together into this repository: https://github.com/sorahn/flink-ecosystem
We also just agreed on an API specification, and will now work on finishing
the backend.

It will probably take a few more weeks for this to finish, but we are
making progress :)

Best,
Robert


On Mon, Apr 15, 2019 at 11:18 AM Robert Metzger <rm...@apache.org> wrote:

> Hey Daryl,
>
> thanks a lot for posting a link to this first prototype on the mailing
> list! I really like it!
>
> Becket: Our plan forward is that Congxian is implementing the backend for
> the website. He has already started with the work, but needs at least one
> more week.
>
>
> [Re-sending this email because the first one was blocked on dev@f.a.o]
>
>
> On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:
>
>> Hi Daryl,
>>
>> Thanks a lot for the update. The site looks awesome! This is a great
>> progress. I really like the conciseness of GUI.
>>
>> One minor suggestion is that for the same library, there might be
>> multiple versions compatible with different Flink versions. It would be
>> good to show that somewhere in the project page as it seems important to
>> the users.
>>
>> BTW, will you share the plan to move forward? Would additional hands help?
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com>
>> wrote:
>>
>>> > Shall we add a guide page to show people how to publish their projects
>>> to the website? The exact rules can be discussed and drafted in a separate
>>> email thread IMO
>>>
>>> This is a good idea. (Both the guise, and separate thread), I think once
>>> there is an actual packed in place we’ll be in a lot better position to
>>> discuss this.
>>>
>>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>>> allow login for admins and publishers, or for everyone?
>>>
>>> Correct, all the oauth stuff requires a real server. We are currently
>>> just faking everything.
>>>
>>> I will add a mock-login page (username/password that just accepts
>>> anything and displays whatever username you type in) so we can see the
>>> add-comment field and add-packages page once they exist.
>>>
>>>
>>>>>>>>>>>
>>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey Daryl,

thanks a lot for posting a link to this first prototype on the mailing
list! I really like it!

Becket: Our plan forward is that Congxian is implementing the backend for
the website. He has already started with the work, but needs at least one
more week.


[Re-sending this email because the first one was blocked on dev@f.a.o]


On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:

> Hi Daryl,
>
> Thanks a lot for the update. The site looks awesome! This is a great
> progress. I really like the conciseness of GUI.
>
> One minor suggestion is that for the same library, there might be multiple
> versions compatible with different Flink versions. It would be good to show
> that somewhere in the project page as it seems important to the users.
>
> BTW, will you share the plan to move forward? Would additional hands help?
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com> wrote:
>
>> > Shall we add a guide page to show people how to publish their projects
>> to the website? The exact rules can be discussed and drafted in a separate
>> email thread IMO
>>
>> This is a good idea. (Both the guise, and separate thread), I think once
>> there is an actual packed in place we’ll be in a lot better position to
>> discuss this.
>>
>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>> allow login for admins and publishers, or for everyone?
>>
>> Correct, all the oauth stuff requires a real server. We are currently
>> just faking everything.
>>
>> I will add a mock-login page (username/password that just accepts
>> anything and displays whatever username you type in) so we can see the
>> add-comment field and add-packages page once they exist.
>>
>>
>>>>>>>>>>
>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey Daryl,

thanks a lot for posting a link to this first prototype on the mailing
list! I really like it!

Becket: Our plan forward is that Congxian is implementing the backend for
the website.
@Congxian: Do you need any help?



On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:

> Hi Daryl,
>
> Thanks a lot for the update. The site looks awesome! This is a great
> progress. I really like the conciseness of GUI.
>
> One minor suggestion is that for the same library, there might be multiple
> versions compatible with different Flink versions. It would be good to show
> that somewhere in the project page as it seems important to the users.
>
> BTW, will you share the plan to move forward? Would additional hands help?
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com> wrote:
>
>> > Shall we add a guide page to show people how to publish their projects
>> to the website? The exact rules can be discussed and drafted in a separate
>> email thread IMO
>>
>> This is a good idea. (Both the guise, and separate thread), I think once
>> there is an actual packed in place we’ll be in a lot better position to
>> discuss this.
>>
>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>> allow login for admins and publishers, or for everyone?
>>
>> Correct, all the oauth stuff requires a real server. We are currently
>> just faking everything.
>>
>> I will add a mock-login page (username/password that just accepts
>> anything and displays whatever username you type in) so we can see the
>> add-comment field and add-packages page once they exist.
>>
>> On Fri, Apr 12, 2019 at 18:45 Bowen Li <bo...@gmail.com> wrote:
>>
>>> Fancy, thanks Daryl! I can definitely tell Fresh Bacon and Frozen Tuna
>>> gonna be some big killer connectors :)
>>>
>>> A couple feedbacks:
>>>
>>>    - Shall we add a guide page to show people how to publish their
>>>    projects to the website? The exact rules can be discussed and drafted in a
>>>    separate email thread IMO
>>>    - The "Log in with Github" link doesn't seem to work yet. Will it
>>>    only allow login for admins and publishers, or for everyone?
>>>
>>> Cheers! Bowen
>>>
>>>
>>>
>>> On Fri, Apr 12, 2019 at 6:28 AM Oytun Tez <oy...@motaword.com> wrote:
>>>
>>>> Yep, I guessed so... Good luck! :)
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> ---
>>>> Oytun Tez
>>>>
>>>> *M O T A W O R D*
>>>> The World's Fastest Human Translation Platform.
>>>> oytun@motaword.com — www.motaword.com
>>>>
>>>>
>>>> On Fri, Apr 12, 2019 at 9:22 AM Daryl Roberts <da...@ververica.com>
>>>> wrote:
>>>>
>>>>> I can definitely tweak the new on to come closer to matching the
>>>>> styles of the other 2.
>>>>>
>>>>> I think all 3 sites are built with different UI frameworks, so to make
>>>>> them all identical might be a bit difficult, but we can get them closer :)
>>>>>
>>>>> On Fri, Apr 12, 2019 at 3:17 PM Oytun Tez <oy...@motaword.com> wrote:
>>>>>
>>>>>> Daryl, looks very good, thank you!
>>>>>>
>>>>>> Only one feedback, I am attaching an image with 3 screenshots of the
>>>>>> left sidebar from 3 sites:
>>>>>>
>>>>>>    - https://flink.apache.org/
>>>>>>    - https://ci.apache.org/projects/flink/flink-docs-release-1.8/
>>>>>>    - https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>>>>
>>>>>> SS:
>>>>>> [image: 1.png]
>>>>>>
>>>>>> Maybe we can try to consolidate the sidebar in all 3 sites? This may
>>>>>> be overreaching to homepage and doc maintainers as well. If that's a too
>>>>>> involved process, perhaps the sidebar can at least have a gray background.
>>>>>>
>>>>>> Thank you again!
>>>>>>
>>>>>>
>>>>>>
>>>>>> ---
>>>>>> Oytun Tez
>>>>>>
>>>>>> *M O T A W O R D*
>>>>>> The World's Fastest Human Translation Platform.
>>>>>> oytun@motaword.com — www.motaword.com
>>>>>>
>>>>>>
>>>>>> On Fri, Apr 12, 2019 at 8:52 AM Daryl Roberts <da...@ververica.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hello all,
>>>>>>>
>>>>>>> We have deployed the first version of the UI prototype to the
>>>>>>> following URL:
>>>>>>> https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>>>>>
>>>>>>> It has some very basic functionality:
>>>>>>> * list packages
>>>>>>> * list packages by 'category'
>>>>>>> * show a single package
>>>>>>> * search that will take you to a search page
>>>>>>>
>>>>>>> The data is all fake, and generated new every time, so even if you
>>>>>>> click on a package name, and the URL says one thing, the package data
>>>>>>> itself will be different (and change every time you refresh).
>>>>>>>
>>>>>>> [image: Screenshot_2019-04-12_14_44_19.png]
>>>>>>>
>>>>>>> None of this is final, but we thought it would be a good idea for
>>>>>>> you all to see what we have so far.
>>>>>>>
>>>>>>> If you have any feedback, please let us know.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> -daryl
>>>>>>>
>>>>>>> On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Thank you, all! If there are operational tasks about the ecosystem
>>>>>>>> page(s), let me know (organizing the content etc, whatever).
>>>>>>>>
>>>>>>>> ---
>>>>>>>> Oytun Tez
>>>>>>>>
>>>>>>>> *M O T A W O R D*
>>>>>>>> The World's Fastest Human Translation Platform.
>>>>>>>> oytun@motaword.com — www.motaword.com
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Thanks for the update Robert! Looking forward to the prototype!
>>>>>>>>>
>>>>>>>>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <
>>>>>>>>> rmetzger@apache.org> wrote:
>>>>>>>>>
>>>>>>>>>> Quick summary of our call:
>>>>>>>>>> Daryl will soon start with a front end, build against a very
>>>>>>>>>> simple
>>>>>>>>>> mock-backend.
>>>>>>>>>> Congxian will start implementing the Spring-based backend early
>>>>>>>>>> April.
>>>>>>>>>>
>>>>>>>>>> As soon as the first prototype of the UI is ready, we'll share it
>>>>>>>>>> here for
>>>>>>>>>> feedback.
>>>>>>>>>>
>>>>>>>>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <
>>>>>>>>>> rmetzger@apache.org> wrote:
>>>>>>>>>>
>>>>>>>>>> > Okay, great.
>>>>>>>>>> >
>>>>>>>>>> > Congxian Qiu, Daryl and I have a kick-off call later today at
>>>>>>>>>> 2pm CET, 9pm
>>>>>>>>>> > China time about the design of the ecosystem page (see:
>>>>>>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>>>>>>>>> > Please let me know if others want to join as well, I can add
>>>>>>>>>> them to the
>>>>>>>>>> > invite.
>>>>>>>>>> >
>>>>>>>>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <
>>>>>>>>>> becket.qin@gmail.com> wrote:
>>>>>>>>>> >
>>>>>>>>>> >> I agree. We can start with english-only and see how it goes.
>>>>>>>>>> The comments
>>>>>>>>>> >> and descriptions can always be multi-lingual but that is up to
>>>>>>>>>> the package
>>>>>>>>>> >> owners.
>>>>>>>>>> >>
>>>>>>>>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <
>>>>>>>>>> rmetzger@apache.org>
>>>>>>>>>> >> wrote:
>>>>>>>>>> >>
>>>>>>>>>> >>> Thanks.
>>>>>>>>>> >>>
>>>>>>>>>> >>> Do we actually want this page to be multi-language?
>>>>>>>>>> >>>
>>>>>>>>>> >>> I propose to make the website english-only, but maybe
>>>>>>>>>> consider allowing
>>>>>>>>>> >>> comments in different languages.
>>>>>>>>>> >>> If we would make it multi-language, then we might have
>>>>>>>>>> problems with
>>>>>>>>>> >>> people submitting packages in non-english languages.
>>>>>>>>>> >>>
>>>>>>>>>> >>>
>>>>>>>>>> >>>
>>>>>>>>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <
>>>>>>>>>> becket.qin@gmail.com> wrote:
>>>>>>>>>> >>>
>>>>>>>>>> >>>> Done. The writeup looks great!
>>>>>>>>>> >>>>
>>>>>>>>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <
>>>>>>>>>> rmetzger@apache.org>
>>>>>>>>>> >>>> wrote:
>>>>>>>>>> >>>>
>>>>>>>>>> >>>>> Nice, really good news on the INFRA front!
>>>>>>>>>> >>>>> I think the hardware specs sound reasonable. And a periodic
>>>>>>>>>> backup of
>>>>>>>>>> >>>>> the website's database to Infra's backup solution sounds
>>>>>>>>>> reasonable too.
>>>>>>>>>> >>>>>
>>>>>>>>>> >>>>> Can you accept and review my proposal for the website?
>>>>>>>>>> >>>>>
>>>>>>>>>> >>>>>
>>>>>>>>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <
>>>>>>>>>> becket.qin@gmail.com>
>>>>>>>>>> >>>>> wrote:
>>>>>>>>>> >>>>>
>>>>>>>>>> >>>>>> >
>>>>>>>>>> >>>>>> > I have a very capable and motivated frontend developer
>>>>>>>>>> who would be
>>>>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>> That is awesome!
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the
>>>>>>>>>> reply. It
>>>>>>>>>> >>>>>> looks that
>>>>>>>>>> >>>>>> Apache infra team could provide a decent VM. The last
>>>>>>>>>> piece is how to
>>>>>>>>>> >>>>>> ensure the data is persisted so we won't lose the project
>>>>>>>>>> info / user
>>>>>>>>>> >>>>>> feedbacks when the VM is down. If Apache infra does not
>>>>>>>>>> provide a
>>>>>>>>>> >>>>>> persistent storage for DB backup, we can always ask for
>>>>>>>>>> multiple VMs
>>>>>>>>>> >>>>>> and do
>>>>>>>>>> >>>>>> the fault tolerance by ourselves. It seems we can almost
>>>>>>>>>> say the
>>>>>>>>>> >>>>>> hardware
>>>>>>>>>> >>>>>> side is also ready.
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>> Thanks,
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>> Jiangjie (Becket) Qin
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>>>>>>>>> rmetzger@apache.org>
>>>>>>>>>> >>>>>> wrote:
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>>>>>>> >>>>>> > When I first saw the Ember repository, I thought it is
>>>>>>>>>> the whole
>>>>>>>>>> >>>>>> thing
>>>>>>>>>> >>>>>> > (frontend and backend), but while testing it, I realized
>>>>>>>>>> it is
>>>>>>>>>> >>>>>> "only" the
>>>>>>>>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the
>>>>>>>>>> Ember
>>>>>>>>>> >>>>>> observer
>>>>>>>>>> >>>>>> > client, or just write a simple UI from scratch.
>>>>>>>>>> >>>>>> > I have a very capable and motivated frontend developer
>>>>>>>>>> who would be
>>>>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>>>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems
>>>>>>>>>> to be eager
>>>>>>>>>> >>>>>> to help
>>>>>>>>>> >>>>>> > with this project for the backend:
>>>>>>>>>> >>>>>> >
>>>>>>>>>> https://github.com/rmetzger/flink-community-tools/issues/4
>>>>>>>>>> >>>>>> >
>>>>>>>>>> >>>>>> > For Infra: I made the same experience when asking for
>>>>>>>>>> more GitHub
>>>>>>>>>> >>>>>> > permissions for "flinkbot": They didn't respond on their
>>>>>>>>>> mailing
>>>>>>>>>> >>>>>> list, only
>>>>>>>>>> >>>>>> > on Jira.
>>>>>>>>>> >>>>>> >
>>>>>>>>>> >>>>>> >
>>>>>>>>>> >>>>>> >
>>>>>>>>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>>>>>>>>> becket.qin@gmail.com>
>>>>>>>>>> >>>>>> wrote:
>>>>>>>>>> >>>>>> >
>>>>>>>>>> >>>>>> >> Thanks for writing up the specifications.
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >> Regarding the website source code, Austin found a
>>>>>>>>>> website[1] whose
>>>>>>>>>> >>>>>> >> frontend code[2] is available publicly. It lacks some
>>>>>>>>>> support (e.g
>>>>>>>>>> >>>>>> login),
>>>>>>>>>> >>>>>> >> but it is still a good starting point. One thing is
>>>>>>>>>> that I did not
>>>>>>>>>> >>>>>> find a
>>>>>>>>>> >>>>>> >> License statement for that source code. I'll reach out
>>>>>>>>>> to the
>>>>>>>>>> >>>>>> author to see
>>>>>>>>>> >>>>>> >> if they have any concern over our usage.
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >> Apache Infra has not replied to my email regarding some
>>>>>>>>>> details
>>>>>>>>>> >>>>>> about the
>>>>>>>>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is
>>>>>>>>>> still no
>>>>>>>>>> >>>>>> response.
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >> Thanks,
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >> Jiangjie (Becket) Qin
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >> [1] https://emberobserver.com/
>>>>>>>>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>>>>> >>>>>> >> wrote:
>>>>>>>>>> >>>>>> >>
>>>>>>>>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is
>>>>>>>>>> on their
>>>>>>>>>> >>>>>> company
>>>>>>>>>> >>>>>> >>> website. I guess the likelihood that they give out
>>>>>>>>>> code from
>>>>>>>>>> >>>>>> their company
>>>>>>>>>> >>>>>> >>> website is fairly low.
>>>>>>>>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page,
>>>>>>>>>> which we'll
>>>>>>>>>> >>>>>> >>> reactivate as part of this PR:
>>>>>>>>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>>>>>>> >>>>>> >>>
>>>>>>>>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>>>>>>>>> >>>>>> >>> I will propose a short specification in Becket's
>>>>>>>>>> initial document.
>>>>>>>>>> >>>>>> >>>
>>>>>>>>>> >>>>>> >>>
>>>>>>>>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>>>>>>>>> Niels@basjes.nl>
>>>>>>>>>> >>>>>> wrote:
>>>>>>>>>> >>>>>> >>>
>>>>>>>>>> >>>>>> >>>> Hi,
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>> The Beam project has something in this area that is
>>>>>>>>>> simply a page
>>>>>>>>>> >>>>>> >>>> within their documentation website:
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>>>>>>>>> bowenli86@gmail.com>
>>>>>>>>>> >>>>>> wrote:
>>>>>>>>>> >>>>>> >>>> >
>>>>>>>>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of
>>>>>>>>>> this kind. I
>>>>>>>>>> >>>>>> >>>> personally like it over the spark site. May worth
>>>>>>>>>> checking it
>>>>>>>>>> >>>>>> out with
>>>>>>>>>> >>>>>> >>>> Kafka folks
>>>>>>>>>> >>>>>> >>>> >
>>>>>>>>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a
>>>>>>>>>> PR to
>>>>>>>>>> >>>>>> update the
>>>>>>>>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>>> >>>>>> >>>> >> Thanks,
>>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org
>>>>>>>>>> and see if
>>>>>>>>>> >>>>>> they are
>>>>>>>>>> >>>>>> >>>> willing
>>>>>>>>>> >>>>>> >>>> >> > to share.
>>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>>> >>>>>> >>>> >> > Do you want to raise a PR to update the
>>>>>>>>>> ecosystem page
>>>>>>>>>> >>>>>> (maybe sync
>>>>>>>>>> >>>>>> >>>> with
>>>>>>>>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>>> >>>>>>
>>>>>>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink
>>>>>>>>>> )
>>>>>>>>>> >>>>>> >>>> and
>>>>>>>>>> >>>>>> >>>> >> > link it in the navigation?
>>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>>> >>>>>> >>>> >> > Best,
>>>>>>>>>> >>>>>> >>>> >> > Robert
>>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>>> >>>>>> >>>> >> >> Hi Robert,
>>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>>>>>>>>> spark-packages.org
>>>>>>>>>> >>>>>> owners
>>>>>>>>>> >>>>>> >>>> are
>>>>>>>>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to
>>>>>>>>>> write the
>>>>>>>>>> >>>>>> requirement
>>>>>>>>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very
>>>>>>>>>> helpful.
>>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we
>>>>>>>>>> will need
>>>>>>>>>> >>>>>> it to
>>>>>>>>>> >>>>>> >>>> redirect
>>>>>>>>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first
>>>>>>>>>> do that
>>>>>>>>>> >>>>>> while
>>>>>>>>>> >>>>>> >>>> working on
>>>>>>>>>> >>>>>> >>>> >> >> the dynamic website?
>>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>>> >>>>>> >>>> >> >> Thanks,
>>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>>>>>>>>> uce@apache.org
>>>>>>>>>> >>>>>> >
>>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static
>>>>>>>>>> site first.
>>>>>>>>>> >>>>>> We
>>>>>>>>>> >>>>>> >>>> could then
>>>>>>>>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing.
>>>>>>>>>> Of course,
>>>>>>>>>> >>>>>> if we
>>>>>>>>>> >>>>>> >>>> have the
>>>>>>>>>> >>>>>> >>>> >> >>> resources in the community to quickly start
>>>>>>>>>> with a
>>>>>>>>>> >>>>>> dynamic site,
>>>>>>>>>> >>>>>> >>>> I'm
>>>>>>>>>> >>>>>> >>>> >> >>> not apposed.
>>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>>> >>>>>> >>>> >> >>> – Ufuk
>>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>>>>>>> >>>>>> >>>> rmetzger@apache.org>
>>>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this
>>>>>>>>>> Becket! The
>>>>>>>>>> >>>>>> VMs
>>>>>>>>>> >>>>>> >>>> hosted by
>>>>>>>>>> >>>>>> >>>> >> >>> Infra
>>>>>>>>>> >>>>>> >>>> >> >>> > look suitable.
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a
>>>>>>>>>> static page. It
>>>>>>>>>> >>>>>> used to
>>>>>>>>>> >>>>>> >>>> be
>>>>>>>>>> >>>>>> >>>> >> >>> linked,
>>>>>>>>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar
>>>>>>>>>> for some
>>>>>>>>>> >>>>>> reason.
>>>>>>>>>> >>>>>> >>>> This is
>>>>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>>>>> >>>>>> >>>> >> >>> > page:
>>>>>>>>>> https://flink.apache.org/ecosystem.html
>>>>>>>>>> >>>>>> >>>> >> >>> > We could update the page and add it back to
>>>>>>>>>> the
>>>>>>>>>> >>>>>> navigation bar
>>>>>>>>>> >>>>>> >>>> for the
>>>>>>>>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic
>>>>>>>>>> page right
>>>>>>>>>> >>>>>> away.
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do
>>>>>>>>>> you feel
>>>>>>>>>> >>>>>> about
>>>>>>>>>> >>>>>> >>>> sending the
>>>>>>>>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note,
>>>>>>>>>> if they are
>>>>>>>>>> >>>>>> >>>> interested in
>>>>>>>>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the
>>>>>>>>>> code together
>>>>>>>>>> >>>>>> in a
>>>>>>>>>> >>>>>> >>>> public
>>>>>>>>>> >>>>>> >>>> >> >>> repo.
>>>>>>>>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we
>>>>>>>>>> decide not
>>>>>>>>>> >>>>>> to ask
>>>>>>>>>> >>>>>> >>>> in the
>>>>>>>>>> >>>>>> >>>> >> >>> first
>>>>>>>>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short
>>>>>>>>>> description of
>>>>>>>>>> >>>>>> the
>>>>>>>>>> >>>>>> >>>> requirements,
>>>>>>>>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we
>>>>>>>>>> find
>>>>>>>>>> >>>>>> somebody here
>>>>>>>>>> >>>>>> >>>> in the
>>>>>>>>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>>>>>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>>>>>>>>> contribute,
>>>>>>>>>> >>>>>> I
>>>>>>>>>> >>>>>> >>>> believe we
>>>>>>>>>> >>>>>> >>>> >> >>> will
>>>>>>>>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>>>> >>>>>> >>>> >> >>> > > [1]
>>>>>>>>>> https://www.apache.org/dev/services.html#blogs
>>>>>>>>>> >>>>>> (Apache
>>>>>>>>>> >>>>>> >>>> infra
>>>>>>>>>> >>>>>> >>>> >> >>> services)
>>>>>>>>>> >>>>>> >>>> >> >>> > > [2]
>>>>>>>>>> https://www.apache.org/dev/freebsd-jails
>>>>>>>>>> >>>>>> (FreeBSD Jail
>>>>>>>>>> >>>>>> >>>> provided
>>>>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>>>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin
>>>>>>>>>> <
>>>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good
>>>>>>>>>> points. We
>>>>>>>>>> >>>>>> should
>>>>>>>>>> >>>>>> >>>> absolutely
>>>>>>>>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support
>>>>>>>>>> more
>>>>>>>>>> >>>>>> interactions in
>>>>>>>>>> >>>>>> >>>> the
>>>>>>>>>> >>>>>> >>>> >> >>> community.
>>>>>>>>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>>>>>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open
>>>>>>>>>> source solution
>>>>>>>>>> >>>>>> would
>>>>>>>>>> >>>>>> >>>> be great.
>>>>>>>>>> >>>>>> >>>> >> >>> TBH,
>>>>>>>>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building
>>>>>>>>>> a website.
>>>>>>>>>> >>>>>> It'll
>>>>>>>>>> >>>>>> >>>> be great
>>>>>>>>>> >>>>>> >>>> >> >>> if
>>>>>>>>>> >>>>>> >>>> >> >>> > >> someone could help comment on the
>>>>>>>>>> solution here.
>>>>>>>>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website.
>>>>>>>>>> Apache Infra
>>>>>>>>>> >>>>>> provides
>>>>>>>>>> >>>>>> >>>> a few
>>>>>>>>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can
>>>>>>>>>> leverage. I did
>>>>>>>>>> >>>>>> not see
>>>>>>>>>> >>>>>> >>>> >> >>> database
>>>>>>>>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple
>>>>>>>>>> MySQL db in
>>>>>>>>>> >>>>>> FreeBSD
>>>>>>>>>> >>>>>> >>>> jail[2].
>>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive
>>>>>>>>>> feedback!
>>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>>>>>>>>> reasonable to
>>>>>>>>>> >>>>>> me. We
>>>>>>>>>> >>>>>> >>>> >> >>> probably need
>>>>>>>>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site
>>>>>>>>>> anyways, even just
>>>>>>>>>> >>>>>> >>>> provide links
>>>>>>>>>> >>>>>> >>>> >> >>> it to
>>>>>>>>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the
>>>>>>>>>> connectors in
>>>>>>>>>> >>>>>> that
>>>>>>>>>> >>>>>> >>>> static
>>>>>>>>>> >>>>>> >>>> >> >>> page seems
>>>>>>>>>> >>>>>> >>>> >> >>> > >> something we could start with while we
>>>>>>>>>> are working
>>>>>>>>>> >>>>>> on the
>>>>>>>>>> >>>>>> >>>> dynamic
>>>>>>>>>> >>>>>> >>>> >> >>> pages.
>>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan
>>>>>>>>>> Wang <
>>>>>>>>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>>>>>>>>> >>>>>> >>>> >> >>> > >> wrote:
>>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out
>>>>>>>>>> with Flink
>>>>>>>>>> >>>>>> >>>> connectors at
>>>>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a
>>>>>>>>>> static page,
>>>>>>>>>> >>>>>> and
>>>>>>>>>> >>>>>> >>>> upgrade it
>>>>>>>>>> >>>>>> >>>> >> >>> when we
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one
>>>>>>>>>> with rich
>>>>>>>>>> >>>>>> functions.
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> Regards,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert
>>>>>>>>>> Metzger <
>>>>>>>>>> >>>>>> >>>> rmetzger@apache.org
>>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>>> >>>>>> >>>> >> >>> > >>> wrote:
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to
>>>>>>>>>> make sure
>>>>>>>>>> >>>>>> the page
>>>>>>>>>> >>>>>> >>>> is placed
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people
>>>>>>>>>> submitting
>>>>>>>>>> >>>>>> something will
>>>>>>>>>> >>>>>> >>>> get
>>>>>>>>>> >>>>>> >>>> >> >>> attention for
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably
>>>>>>>>>> be better,
>>>>>>>>>> >>>>>> if we
>>>>>>>>>> >>>>>> >>>> want
>>>>>>>>>> >>>>>> >>>> >> >>> features
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on
>>>>>>>>>> Apache
>>>>>>>>>> >>>>>> infra, and
>>>>>>>>>> >>>>>> >>>> endorsed
>>>>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> the community.
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing
>>>>>>>>>> software that
>>>>>>>>>> >>>>>> we
>>>>>>>>>> >>>>>> >>>> could use?
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is
>>>>>>>>>> AUR:
>>>>>>>>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for
>>>>>>>>>> Arch
>>>>>>>>>> >>>>>> Linux. The
>>>>>>>>>> >>>>>> >>>> source
>>>>>>>>>> >>>>>> >>>> >> >>> code of this
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout
>>>>>>>>>> and
>>>>>>>>>> >>>>>> structure is
>>>>>>>>>> >>>>>> >>>> not an
>>>>>>>>>> >>>>>> >>>> >> >>> ideal fit for
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Best,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Robert
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket
>>>>>>>>>> Qin <
>>>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion
>>>>>>>>>> thread about
>>>>>>>>>> >>>>>> creating
>>>>>>>>>> >>>>>> >>>> a Flink
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to
>>>>>>>>>> help
>>>>>>>>>> >>>>>> contributors
>>>>>>>>>> >>>>>> >>>> who
>>>>>>>>>> >>>>>> >>>> >> >>> have developed
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work
>>>>>>>>>> with the
>>>>>>>>>> >>>>>> >>>> community.
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more
>>>>>>>>>> details.
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>>
>>>>>>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>> --
>>>>>>>>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>>>>> >>>>>> >>>>
>>>>>>>>>> >>>>>> >>>
>>>>>>>>>> >>>>>>
>>>>>>>>>> >>>>>
>>>>>>>>>>
>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey Daryl,

thanks a lot for posting a link to this first prototype on the mailing
list! I really like it!

Becket: Our plan forward is that Congxian is implementing the backend for
the website. He has already started with the work, but needs at least one
more week.


[Re-sending this email because the first one was blocked on dev@f.a.o]


On Mon, Apr 15, 2019 at 7:59 AM Becket Qin <be...@gmail.com> wrote:

> Hi Daryl,
>
> Thanks a lot for the update. The site looks awesome! This is a great
> progress. I really like the conciseness of GUI.
>
> One minor suggestion is that for the same library, there might be multiple
> versions compatible with different Flink versions. It would be good to show
> that somewhere in the project page as it seems important to the users.
>
> BTW, will you share the plan to move forward? Would additional hands help?
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com> wrote:
>
>> > Shall we add a guide page to show people how to publish their projects
>> to the website? The exact rules can be discussed and drafted in a separate
>> email thread IMO
>>
>> This is a good idea. (Both the guise, and separate thread), I think once
>> there is an actual packed in place we’ll be in a lot better position to
>> discuss this.
>>
>> > The "Log in with Github" link doesn't seem to work yet. Will it only
>> allow login for admins and publishers, or for everyone?
>>
>> Correct, all the oauth stuff requires a real server. We are currently
>> just faking everything.
>>
>> I will add a mock-login page (username/password that just accepts
>> anything and displays whatever username you type in) so we can see the
>> add-comment field and add-packages page once they exist.
>>
>>
>>>>>>>>>>
>>>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Hi Daryl,

Thanks a lot for the update. The site looks awesome! This is a great
progress. I really like the conciseness of GUI.

One minor suggestion is that for the same library, there might be multiple
versions compatible with different Flink versions. It would be good to show
that somewhere in the project page as it seems important to the users.

BTW, will you share the plan to move forward? Would additional hands help?

Thanks,

Jiangjie (Becket) Qin

On Sat, Apr 13, 2019 at 7:10 PM Daryl Roberts <da...@ververica.com> wrote:

> > Shall we add a guide page to show people how to publish their projects
> to the website? The exact rules can be discussed and drafted in a separate
> email thread IMO
>
> This is a good idea. (Both the guise, and separate thread), I think once
> there is an actual packed in place we’ll be in a lot better position to
> discuss this.
>
> > The "Log in with Github" link doesn't seem to work yet. Will it only
> allow login for admins and publishers, or for everyone?
>
> Correct, all the oauth stuff requires a real server. We are currently just
> faking everything.
>
> I will add a mock-login page (username/password that just accepts anything
> and displays whatever username you type in) so we can see the add-comment
> field and add-packages page once they exist.
>
> On Fri, Apr 12, 2019 at 18:45 Bowen Li <bo...@gmail.com> wrote:
>
>> Fancy, thanks Daryl! I can definitely tell Fresh Bacon and Frozen Tuna
>> gonna be some big killer connectors :)
>>
>> A couple feedbacks:
>>
>>    - Shall we add a guide page to show people how to publish their
>>    projects to the website? The exact rules can be discussed and drafted in a
>>    separate email thread IMO
>>    - The "Log in with Github" link doesn't seem to work yet. Will it
>>    only allow login for admins and publishers, or for everyone?
>>
>> Cheers! Bowen
>>
>>
>>
>> On Fri, Apr 12, 2019 at 6:28 AM Oytun Tez <oy...@motaword.com> wrote:
>>
>>> Yep, I guessed so... Good luck! :)
>>>
>>>
>>>
>>>
>>>
>>> ---
>>> Oytun Tez
>>>
>>> *M O T A W O R D*
>>> The World's Fastest Human Translation Platform.
>>> oytun@motaword.com — www.motaword.com
>>>
>>>
>>> On Fri, Apr 12, 2019 at 9:22 AM Daryl Roberts <da...@ververica.com>
>>> wrote:
>>>
>>>> I can definitely tweak the new on to come closer to matching the styles
>>>> of the other 2.
>>>>
>>>> I think all 3 sites are built with different UI frameworks, so to make
>>>> them all identical might be a bit difficult, but we can get them closer :)
>>>>
>>>> On Fri, Apr 12, 2019 at 3:17 PM Oytun Tez <oy...@motaword.com> wrote:
>>>>
>>>>> Daryl, looks very good, thank you!
>>>>>
>>>>> Only one feedback, I am attaching an image with 3 screenshots of the
>>>>> left sidebar from 3 sites:
>>>>>
>>>>>    - https://flink.apache.org/
>>>>>    - https://ci.apache.org/projects/flink/flink-docs-release-1.8/
>>>>>    - https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>>>
>>>>> SS:
>>>>> [image: 1.png]
>>>>>
>>>>> Maybe we can try to consolidate the sidebar in all 3 sites? This may
>>>>> be overreaching to homepage and doc maintainers as well. If that's a too
>>>>> involved process, perhaps the sidebar can at least have a gray background.
>>>>>
>>>>> Thank you again!
>>>>>
>>>>>
>>>>>
>>>>> ---
>>>>> Oytun Tez
>>>>>
>>>>> *M O T A W O R D*
>>>>> The World's Fastest Human Translation Platform.
>>>>> oytun@motaword.com — www.motaword.com
>>>>>
>>>>>
>>>>> On Fri, Apr 12, 2019 at 8:52 AM Daryl Roberts <da...@ververica.com>
>>>>> wrote:
>>>>>
>>>>>> Hello all,
>>>>>>
>>>>>> We have deployed the first version of the UI prototype to the
>>>>>> following URL:
>>>>>> https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>>>>
>>>>>> It has some very basic functionality:
>>>>>> * list packages
>>>>>> * list packages by 'category'
>>>>>> * show a single package
>>>>>> * search that will take you to a search page
>>>>>>
>>>>>> The data is all fake, and generated new every time, so even if you
>>>>>> click on a package name, and the URL says one thing, the package data
>>>>>> itself will be different (and change every time you refresh).
>>>>>>
>>>>>> [image: Screenshot_2019-04-12_14_44_19.png]
>>>>>>
>>>>>> None of this is final, but we thought it would be a good idea for you
>>>>>> all to see what we have so far.
>>>>>>
>>>>>> If you have any feedback, please let us know.
>>>>>>
>>>>>> Thanks,
>>>>>> -daryl
>>>>>>
>>>>>> On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:
>>>>>>
>>>>>>> Thank you, all! If there are operational tasks about the ecosystem
>>>>>>> page(s), let me know (organizing the content etc, whatever).
>>>>>>>
>>>>>>> ---
>>>>>>> Oytun Tez
>>>>>>>
>>>>>>> *M O T A W O R D*
>>>>>>> The World's Fastest Human Translation Platform.
>>>>>>> oytun@motaword.com — www.motaword.com
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Thanks for the update Robert! Looking forward to the prototype!
>>>>>>>>
>>>>>>>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <
>>>>>>>> rmetzger@apache.org> wrote:
>>>>>>>>
>>>>>>>>> Quick summary of our call:
>>>>>>>>> Daryl will soon start with a front end, build against a very simple
>>>>>>>>> mock-backend.
>>>>>>>>> Congxian will start implementing the Spring-based backend early
>>>>>>>>> April.
>>>>>>>>>
>>>>>>>>> As soon as the first prototype of the UI is ready, we'll share it
>>>>>>>>> here for
>>>>>>>>> feedback.
>>>>>>>>>
>>>>>>>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <
>>>>>>>>> rmetzger@apache.org> wrote:
>>>>>>>>>
>>>>>>>>> > Okay, great.
>>>>>>>>> >
>>>>>>>>> > Congxian Qiu, Daryl and I have a kick-off call later today at
>>>>>>>>> 2pm CET, 9pm
>>>>>>>>> > China time about the design of the ecosystem page (see:
>>>>>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>>>>>>>> > Please let me know if others want to join as well, I can add
>>>>>>>>> them to the
>>>>>>>>> > invite.
>>>>>>>>> >
>>>>>>>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>> >
>>>>>>>>> >> I agree. We can start with english-only and see how it goes.
>>>>>>>>> The comments
>>>>>>>>> >> and descriptions can always be multi-lingual but that is up to
>>>>>>>>> the package
>>>>>>>>> >> owners.
>>>>>>>>> >>
>>>>>>>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <
>>>>>>>>> rmetzger@apache.org>
>>>>>>>>> >> wrote:
>>>>>>>>> >>
>>>>>>>>> >>> Thanks.
>>>>>>>>> >>>
>>>>>>>>> >>> Do we actually want this page to be multi-language?
>>>>>>>>> >>>
>>>>>>>>> >>> I propose to make the website english-only, but maybe consider
>>>>>>>>> allowing
>>>>>>>>> >>> comments in different languages.
>>>>>>>>> >>> If we would make it multi-language, then we might have
>>>>>>>>> problems with
>>>>>>>>> >>> people submitting packages in non-english languages.
>>>>>>>>> >>>
>>>>>>>>> >>>
>>>>>>>>> >>>
>>>>>>>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <
>>>>>>>>> becket.qin@gmail.com> wrote:
>>>>>>>>> >>>
>>>>>>>>> >>>> Done. The writeup looks great!
>>>>>>>>> >>>>
>>>>>>>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <
>>>>>>>>> rmetzger@apache.org>
>>>>>>>>> >>>> wrote:
>>>>>>>>> >>>>
>>>>>>>>> >>>>> Nice, really good news on the INFRA front!
>>>>>>>>> >>>>> I think the hardware specs sound reasonable. And a periodic
>>>>>>>>> backup of
>>>>>>>>> >>>>> the website's database to Infra's backup solution sounds
>>>>>>>>> reasonable too.
>>>>>>>>> >>>>>
>>>>>>>>> >>>>> Can you accept and review my proposal for the website?
>>>>>>>>> >>>>>
>>>>>>>>> >>>>>
>>>>>>>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <
>>>>>>>>> becket.qin@gmail.com>
>>>>>>>>> >>>>> wrote:
>>>>>>>>> >>>>>
>>>>>>>>> >>>>>> >
>>>>>>>>> >>>>>> > I have a very capable and motivated frontend developer
>>>>>>>>> who would be
>>>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>> That is awesome!
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the
>>>>>>>>> reply. It
>>>>>>>>> >>>>>> looks that
>>>>>>>>> >>>>>> Apache infra team could provide a decent VM. The last piece
>>>>>>>>> is how to
>>>>>>>>> >>>>>> ensure the data is persisted so we won't lose the project
>>>>>>>>> info / user
>>>>>>>>> >>>>>> feedbacks when the VM is down. If Apache infra does not
>>>>>>>>> provide a
>>>>>>>>> >>>>>> persistent storage for DB backup, we can always ask for
>>>>>>>>> multiple VMs
>>>>>>>>> >>>>>> and do
>>>>>>>>> >>>>>> the fault tolerance by ourselves. It seems we can almost
>>>>>>>>> say the
>>>>>>>>> >>>>>> hardware
>>>>>>>>> >>>>>> side is also ready.
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>> Thanks,
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>> Jiangjie (Becket) Qin
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>>>>>>>> rmetzger@apache.org>
>>>>>>>>> >>>>>> wrote:
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>>>>>> >>>>>> > When I first saw the Ember repository, I thought it is
>>>>>>>>> the whole
>>>>>>>>> >>>>>> thing
>>>>>>>>> >>>>>> > (frontend and backend), but while testing it, I realized
>>>>>>>>> it is
>>>>>>>>> >>>>>> "only" the
>>>>>>>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the
>>>>>>>>> Ember
>>>>>>>>> >>>>>> observer
>>>>>>>>> >>>>>> > client, or just write a simple UI from scratch.
>>>>>>>>> >>>>>> > I have a very capable and motivated frontend developer
>>>>>>>>> who would be
>>>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to
>>>>>>>>> be eager
>>>>>>>>> >>>>>> to help
>>>>>>>>> >>>>>> > with this project for the backend:
>>>>>>>>> >>>>>> >
>>>>>>>>> https://github.com/rmetzger/flink-community-tools/issues/4
>>>>>>>>> >>>>>> >
>>>>>>>>> >>>>>> > For Infra: I made the same experience when asking for
>>>>>>>>> more GitHub
>>>>>>>>> >>>>>> > permissions for "flinkbot": They didn't respond on their
>>>>>>>>> mailing
>>>>>>>>> >>>>>> list, only
>>>>>>>>> >>>>>> > on Jira.
>>>>>>>>> >>>>>> >
>>>>>>>>> >>>>>> >
>>>>>>>>> >>>>>> >
>>>>>>>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>>>>>>>> becket.qin@gmail.com>
>>>>>>>>> >>>>>> wrote:
>>>>>>>>> >>>>>> >
>>>>>>>>> >>>>>> >> Thanks for writing up the specifications.
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >> Regarding the website source code, Austin found a
>>>>>>>>> website[1] whose
>>>>>>>>> >>>>>> >> frontend code[2] is available publicly. It lacks some
>>>>>>>>> support (e.g
>>>>>>>>> >>>>>> login),
>>>>>>>>> >>>>>> >> but it is still a good starting point. One thing is that
>>>>>>>>> I did not
>>>>>>>>> >>>>>> find a
>>>>>>>>> >>>>>> >> License statement for that source code. I'll reach out
>>>>>>>>> to the
>>>>>>>>> >>>>>> author to see
>>>>>>>>> >>>>>> >> if they have any concern over our usage.
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >> Apache Infra has not replied to my email regarding some
>>>>>>>>> details
>>>>>>>>> >>>>>> about the
>>>>>>>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is
>>>>>>>>> still no
>>>>>>>>> >>>>>> response.
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >> Thanks,
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >> Jiangjie (Becket) Qin
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >> [1] https://emberobserver.com/
>>>>>>>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>>>> >>>>>> >> wrote:
>>>>>>>>> >>>>>> >>
>>>>>>>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is
>>>>>>>>> on their
>>>>>>>>> >>>>>> company
>>>>>>>>> >>>>>> >>> website. I guess the likelihood that they give out code
>>>>>>>>> from
>>>>>>>>> >>>>>> their company
>>>>>>>>> >>>>>> >>> website is fairly low.
>>>>>>>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page,
>>>>>>>>> which we'll
>>>>>>>>> >>>>>> >>> reactivate as part of this PR:
>>>>>>>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>>>>>> >>>>>> >>>
>>>>>>>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>>>>>>>> >>>>>> >>> I will propose a short specification in Becket's
>>>>>>>>> initial document.
>>>>>>>>> >>>>>> >>>
>>>>>>>>> >>>>>> >>>
>>>>>>>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>>>>>>>> Niels@basjes.nl>
>>>>>>>>> >>>>>> wrote:
>>>>>>>>> >>>>>> >>>
>>>>>>>>> >>>>>> >>>> Hi,
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>> The Beam project has something in this area that is
>>>>>>>>> simply a page
>>>>>>>>> >>>>>> >>>> within their documentation website:
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>>>>>>>> bowenli86@gmail.com>
>>>>>>>>> >>>>>> wrote:
>>>>>>>>> >>>>>> >>>> >
>>>>>>>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of
>>>>>>>>> this kind. I
>>>>>>>>> >>>>>> >>>> personally like it over the spark site. May worth
>>>>>>>>> checking it
>>>>>>>>> >>>>>> out with
>>>>>>>>> >>>>>> >>>> Kafka folks
>>>>>>>>> >>>>>> >>>> >
>>>>>>>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a
>>>>>>>>> PR to
>>>>>>>>> >>>>>> update the
>>>>>>>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>> >>>>>> >>>> >> Thanks,
>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>> >>>>>> >>>> >>
>>>>>>>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and
>>>>>>>>> see if
>>>>>>>>> >>>>>> they are
>>>>>>>>> >>>>>> >>>> willing
>>>>>>>>> >>>>>> >>>> >> > to share.
>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem
>>>>>>>>> page
>>>>>>>>> >>>>>> (maybe sync
>>>>>>>>> >>>>>> >>>> with
>>>>>>>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>> >>>>>>
>>>>>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink
>>>>>>>>> )
>>>>>>>>> >>>>>> >>>> and
>>>>>>>>> >>>>>> >>>> >> > link it in the navigation?
>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>> >>>>>> >>>> >> > Best,
>>>>>>>>> >>>>>> >>>> >> > Robert
>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>> >>>>>> >>>> >> >
>>>>>>>>> >>>>>> >>>> >> >> Hi Robert,
>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>>>>>>>> spark-packages.org
>>>>>>>>> >>>>>> owners
>>>>>>>>> >>>>>> >>>> are
>>>>>>>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to
>>>>>>>>> write the
>>>>>>>>> >>>>>> requirement
>>>>>>>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very
>>>>>>>>> helpful.
>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we
>>>>>>>>> will need
>>>>>>>>> >>>>>> it to
>>>>>>>>> >>>>>> >>>> redirect
>>>>>>>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first
>>>>>>>>> do that
>>>>>>>>> >>>>>> while
>>>>>>>>> >>>>>> >>>> working on
>>>>>>>>> >>>>>> >>>> >> >> the dynamic website?
>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>> >>>>>> >>>> >> >> Thanks,
>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>>>>>>>> uce@apache.org
>>>>>>>>> >>>>>> >
>>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static
>>>>>>>>> site first.
>>>>>>>>> >>>>>> We
>>>>>>>>> >>>>>> >>>> could then
>>>>>>>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>>>>>>>> course,
>>>>>>>>> >>>>>> if we
>>>>>>>>> >>>>>> >>>> have the
>>>>>>>>> >>>>>> >>>> >> >>> resources in the community to quickly start
>>>>>>>>> with a
>>>>>>>>> >>>>>> dynamic site,
>>>>>>>>> >>>>>> >>>> I'm
>>>>>>>>> >>>>>> >>>> >> >>> not apposed.
>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>> >>>>>> >>>> >> >>> – Ufuk
>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>>>>>> >>>>>> >>>> rmetzger@apache.org>
>>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this
>>>>>>>>> Becket! The
>>>>>>>>> >>>>>> VMs
>>>>>>>>> >>>>>> >>>> hosted by
>>>>>>>>> >>>>>> >>>> >> >>> Infra
>>>>>>>>> >>>>>> >>>> >> >>> > look suitable.
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static
>>>>>>>>> page. It
>>>>>>>>> >>>>>> used to
>>>>>>>>> >>>>>> >>>> be
>>>>>>>>> >>>>>> >>>> >> >>> linked,
>>>>>>>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar
>>>>>>>>> for some
>>>>>>>>> >>>>>> reason.
>>>>>>>>> >>>>>> >>>> This is
>>>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>>>>>> >>>>>> >>>> >> >>> > We could update the page and add it back to
>>>>>>>>> the
>>>>>>>>> >>>>>> navigation bar
>>>>>>>>> >>>>>> >>>> for the
>>>>>>>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic
>>>>>>>>> page right
>>>>>>>>> >>>>>> away.
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do
>>>>>>>>> you feel
>>>>>>>>> >>>>>> about
>>>>>>>>> >>>>>> >>>> sending the
>>>>>>>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note,
>>>>>>>>> if they are
>>>>>>>>> >>>>>> >>>> interested in
>>>>>>>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the
>>>>>>>>> code together
>>>>>>>>> >>>>>> in a
>>>>>>>>> >>>>>> >>>> public
>>>>>>>>> >>>>>> >>>> >> >>> repo.
>>>>>>>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we
>>>>>>>>> decide not
>>>>>>>>> >>>>>> to ask
>>>>>>>>> >>>>>> >>>> in the
>>>>>>>>> >>>>>> >>>> >> >>> first
>>>>>>>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short
>>>>>>>>> description of
>>>>>>>>> >>>>>> the
>>>>>>>>> >>>>>> >>>> requirements,
>>>>>>>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we
>>>>>>>>> find
>>>>>>>>> >>>>>> somebody here
>>>>>>>>> >>>>>> >>>> in the
>>>>>>>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>>>>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>>>>>>>> contribute,
>>>>>>>>> >>>>>> I
>>>>>>>>> >>>>>> >>>> believe we
>>>>>>>>> >>>>>> >>>> >> >>> will
>>>>>>>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>>> >>>>>> >>>> >> >>> > > [1]
>>>>>>>>> https://www.apache.org/dev/services.html#blogs
>>>>>>>>> >>>>>> (Apache
>>>>>>>>> >>>>>> >>>> infra
>>>>>>>>> >>>>>> >>>> >> >>> services)
>>>>>>>>> >>>>>> >>>> >> >>> > > [2]
>>>>>>>>> https://www.apache.org/dev/freebsd-jails
>>>>>>>>> >>>>>> (FreeBSD Jail
>>>>>>>>> >>>>>> >>>> provided
>>>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good
>>>>>>>>> points. We
>>>>>>>>> >>>>>> should
>>>>>>>>> >>>>>> >>>> absolutely
>>>>>>>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>>>>>> >>>>>> interactions in
>>>>>>>>> >>>>>> >>>> the
>>>>>>>>> >>>>>> >>>> >> >>> community.
>>>>>>>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>>>>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>>>>>>>> solution
>>>>>>>>> >>>>>> would
>>>>>>>>> >>>>>> >>>> be great.
>>>>>>>>> >>>>>> >>>> >> >>> TBH,
>>>>>>>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building
>>>>>>>>> a website.
>>>>>>>>> >>>>>> It'll
>>>>>>>>> >>>>>> >>>> be great
>>>>>>>>> >>>>>> >>>> >> >>> if
>>>>>>>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution
>>>>>>>>> here.
>>>>>>>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website.
>>>>>>>>> Apache Infra
>>>>>>>>> >>>>>> provides
>>>>>>>>> >>>>>> >>>> a few
>>>>>>>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can
>>>>>>>>> leverage. I did
>>>>>>>>> >>>>>> not see
>>>>>>>>> >>>>>> >>>> >> >>> database
>>>>>>>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple
>>>>>>>>> MySQL db in
>>>>>>>>> >>>>>> FreeBSD
>>>>>>>>> >>>>>> >>>> jail[2].
>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive
>>>>>>>>> feedback!
>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>>>>>>>> reasonable to
>>>>>>>>> >>>>>> me. We
>>>>>>>>> >>>>>> >>>> >> >>> probably need
>>>>>>>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways,
>>>>>>>>> even just
>>>>>>>>> >>>>>> >>>> provide links
>>>>>>>>> >>>>>> >>>> >> >>> it to
>>>>>>>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the
>>>>>>>>> connectors in
>>>>>>>>> >>>>>> that
>>>>>>>>> >>>>>> >>>> static
>>>>>>>>> >>>>>> >>>> >> >>> page seems
>>>>>>>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>>>>>>>> working
>>>>>>>>> >>>>>> on the
>>>>>>>>> >>>>>> >>>> dynamic
>>>>>>>>> >>>>>> >>>> >> >>> pages.
>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks,
>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan
>>>>>>>>> Wang <
>>>>>>>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>>>>>>>> >>>>>> >>>> >> >>> > >> wrote:
>>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out
>>>>>>>>> with Flink
>>>>>>>>> >>>>>> >>>> connectors at
>>>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a
>>>>>>>>> static page,
>>>>>>>>> >>>>>> and
>>>>>>>>> >>>>>> >>>> upgrade it
>>>>>>>>> >>>>>> >>>> >> >>> when we
>>>>>>>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one
>>>>>>>>> with rich
>>>>>>>>> >>>>>> functions.
>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>> Regards,
>>>>>>>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert
>>>>>>>>> Metzger <
>>>>>>>>> >>>>>> >>>> rmetzger@apache.org
>>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>>> >>>>>> >>>> >> >>> > >>> wrote:
>>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to
>>>>>>>>> make sure
>>>>>>>>> >>>>>> the page
>>>>>>>>> >>>>>> >>>> is placed
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>>>>>>> >>>>>> something will
>>>>>>>>> >>>>>> >>>> get
>>>>>>>>> >>>>>> >>>> >> >>> attention for
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>>>>>>>> better,
>>>>>>>>> >>>>>> if we
>>>>>>>>> >>>>>> >>>> want
>>>>>>>>> >>>>>> >>>> >> >>> features
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on
>>>>>>>>> Apache
>>>>>>>>> >>>>>> infra, and
>>>>>>>>> >>>>>> >>>> endorsed
>>>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> the community.
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing
>>>>>>>>> software that
>>>>>>>>> >>>>>> we
>>>>>>>>> >>>>>> >>>> could use?
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>>>>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for
>>>>>>>>> Arch
>>>>>>>>> >>>>>> Linux. The
>>>>>>>>> >>>>>> >>>> source
>>>>>>>>> >>>>>> >>>> >> >>> code of this
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>>>>>>> >>>>>> structure is
>>>>>>>>> >>>>>> >>>> not an
>>>>>>>>> >>>>>> >>>> >> >>> ideal fit for
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Best,
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> Robert
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket
>>>>>>>>> Qin <
>>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion
>>>>>>>>> thread about
>>>>>>>>> >>>>>> creating
>>>>>>>>> >>>>>> >>>> a Flink
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to
>>>>>>>>> help
>>>>>>>>> >>>>>> contributors
>>>>>>>>> >>>>>> >>>> who
>>>>>>>>> >>>>>> >>>> >> >>> have developed
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work
>>>>>>>>> with the
>>>>>>>>> >>>>>> >>>> community.
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more
>>>>>>>>> details.
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>>
>>>>>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>> --
>>>>>>>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>>>> >>>>>> >>>>
>>>>>>>>> >>>>>> >>>
>>>>>>>>> >>>>>>
>>>>>>>>> >>>>>
>>>>>>>>>
>>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Daryl Roberts <da...@ververica.com>]

> Shall we add a guide page to show people how to publish their projects to
the website? The exact rules can be discussed and drafted in a separate
email thread IMO

This is a good idea. (Both the guise, and separate thread), I think once
there is an actual packed in place we’ll be in a lot better position to
discuss this.

> The "Log in with Github" link doesn't seem to work yet. Will it only
allow login for admins and publishers, or for everyone?

Correct, all the oauth stuff requires a real server. We are currently just
faking everything.

I will add a mock-login page (username/password that just accepts anything
and displays whatever username you type in) so we can see the add-comment
field and add-packages page once they exist.

On Fri, Apr 12, 2019 at 18:45 Bowen Li <bo...@gmail.com> wrote:

> Fancy, thanks Daryl! I can definitely tell Fresh Bacon and Frozen Tuna
> gonna be some big killer connectors :)
>
> A couple feedbacks:
>
>    - Shall we add a guide page to show people how to publish their
>    projects to the website? The exact rules can be discussed and drafted in a
>    separate email thread IMO
>    - The "Log in with Github" link doesn't seem to work yet. Will it only
>    allow login for admins and publishers, or for everyone?
>
> Cheers! Bowen
>
>
>
> On Fri, Apr 12, 2019 at 6:28 AM Oytun Tez <oy...@motaword.com> wrote:
>
>> Yep, I guessed so... Good luck! :)
>>
>>
>>
>>
>>
>> ---
>> Oytun Tez
>>
>> *M O T A W O R D*
>> The World's Fastest Human Translation Platform.
>> oytun@motaword.com — www.motaword.com
>>
>>
>> On Fri, Apr 12, 2019 at 9:22 AM Daryl Roberts <da...@ververica.com>
>> wrote:
>>
>>> I can definitely tweak the new on to come closer to matching the styles
>>> of the other 2.
>>>
>>> I think all 3 sites are built with different UI frameworks, so to make
>>> them all identical might be a bit difficult, but we can get them closer :)
>>>
>>> On Fri, Apr 12, 2019 at 3:17 PM Oytun Tez <oy...@motaword.com> wrote:
>>>
>>>> Daryl, looks very good, thank you!
>>>>
>>>> Only one feedback, I am attaching an image with 3 screenshots of the
>>>> left sidebar from 3 sites:
>>>>
>>>>    - https://flink.apache.org/
>>>>    - https://ci.apache.org/projects/flink/flink-docs-release-1.8/
>>>>    - https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>>
>>>> SS:
>>>> [image: 1.png]
>>>>
>>>> Maybe we can try to consolidate the sidebar in all 3 sites? This may be
>>>> overreaching to homepage and doc maintainers as well. If that's a too
>>>> involved process, perhaps the sidebar can at least have a gray background.
>>>>
>>>> Thank you again!
>>>>
>>>>
>>>>
>>>> ---
>>>> Oytun Tez
>>>>
>>>> *M O T A W O R D*
>>>> The World's Fastest Human Translation Platform.
>>>> oytun@motaword.com — www.motaword.com
>>>>
>>>>
>>>> On Fri, Apr 12, 2019 at 8:52 AM Daryl Roberts <da...@ververica.com>
>>>> wrote:
>>>>
>>>>> Hello all,
>>>>>
>>>>> We have deployed the first version of the UI prototype to the
>>>>> following URL:
>>>>> https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>>>
>>>>> It has some very basic functionality:
>>>>> * list packages
>>>>> * list packages by 'category'
>>>>> * show a single package
>>>>> * search that will take you to a search page
>>>>>
>>>>> The data is all fake, and generated new every time, so even if you
>>>>> click on a package name, and the URL says one thing, the package data
>>>>> itself will be different (and change every time you refresh).
>>>>>
>>>>> [image: Screenshot_2019-04-12_14_44_19.png]
>>>>>
>>>>> None of this is final, but we thought it would be a good idea for you
>>>>> all to see what we have so far.
>>>>>
>>>>> If you have any feedback, please let us know.
>>>>>
>>>>> Thanks,
>>>>> -daryl
>>>>>
>>>>> On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:
>>>>>
>>>>>> Thank you, all! If there are operational tasks about the ecosystem
>>>>>> page(s), let me know (organizing the content etc, whatever).
>>>>>>
>>>>>> ---
>>>>>> Oytun Tez
>>>>>>
>>>>>> *M O T A W O R D*
>>>>>> The World's Fastest Human Translation Platform.
>>>>>> oytun@motaword.com — www.motaword.com
>>>>>>
>>>>>>
>>>>>> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Thanks for the update Robert! Looking forward to the prototype!
>>>>>>>
>>>>>>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Quick summary of our call:
>>>>>>>> Daryl will soon start with a front end, build against a very simple
>>>>>>>> mock-backend.
>>>>>>>> Congxian will start implementing the Spring-based backend early
>>>>>>>> April.
>>>>>>>>
>>>>>>>> As soon as the first prototype of the UI is ready, we'll share it
>>>>>>>> here for
>>>>>>>> feedback.
>>>>>>>>
>>>>>>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <
>>>>>>>> rmetzger@apache.org> wrote:
>>>>>>>>
>>>>>>>> > Okay, great.
>>>>>>>> >
>>>>>>>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm
>>>>>>>> CET, 9pm
>>>>>>>> > China time about the design of the ecosystem page (see:
>>>>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>>>>>>> > Please let me know if others want to join as well, I can add them
>>>>>>>> to the
>>>>>>>> > invite.
>>>>>>>> >
>>>>>>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>>>>>>> wrote:
>>>>>>>> >
>>>>>>>> >> I agree. We can start with english-only and see how it goes. The
>>>>>>>> comments
>>>>>>>> >> and descriptions can always be multi-lingual but that is up to
>>>>>>>> the package
>>>>>>>> >> owners.
>>>>>>>> >>
>>>>>>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <
>>>>>>>> rmetzger@apache.org>
>>>>>>>> >> wrote:
>>>>>>>> >>
>>>>>>>> >>> Thanks.
>>>>>>>> >>>
>>>>>>>> >>> Do we actually want this page to be multi-language?
>>>>>>>> >>>
>>>>>>>> >>> I propose to make the website english-only, but maybe consider
>>>>>>>> allowing
>>>>>>>> >>> comments in different languages.
>>>>>>>> >>> If we would make it multi-language, then we might have problems
>>>>>>>> with
>>>>>>>> >>> people submitting packages in non-english languages.
>>>>>>>> >>>
>>>>>>>> >>>
>>>>>>>> >>>
>>>>>>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <
>>>>>>>> becket.qin@gmail.com> wrote:
>>>>>>>> >>>
>>>>>>>> >>>> Done. The writeup looks great!
>>>>>>>> >>>>
>>>>>>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <
>>>>>>>> rmetzger@apache.org>
>>>>>>>> >>>> wrote:
>>>>>>>> >>>>
>>>>>>>> >>>>> Nice, really good news on the INFRA front!
>>>>>>>> >>>>> I think the hardware specs sound reasonable. And a periodic
>>>>>>>> backup of
>>>>>>>> >>>>> the website's database to Infra's backup solution sounds
>>>>>>>> reasonable too.
>>>>>>>> >>>>>
>>>>>>>> >>>>> Can you accept and review my proposal for the website?
>>>>>>>> >>>>>
>>>>>>>> >>>>>
>>>>>>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <
>>>>>>>> becket.qin@gmail.com>
>>>>>>>> >>>>> wrote:
>>>>>>>> >>>>>
>>>>>>>> >>>>>> >
>>>>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>>>>> would be
>>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> That is awesome!
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the
>>>>>>>> reply. It
>>>>>>>> >>>>>> looks that
>>>>>>>> >>>>>> Apache infra team could provide a decent VM. The last piece
>>>>>>>> is how to
>>>>>>>> >>>>>> ensure the data is persisted so we won't lose the project
>>>>>>>> info / user
>>>>>>>> >>>>>> feedbacks when the VM is down. If Apache infra does not
>>>>>>>> provide a
>>>>>>>> >>>>>> persistent storage for DB backup, we can always ask for
>>>>>>>> multiple VMs
>>>>>>>> >>>>>> and do
>>>>>>>> >>>>>> the fault tolerance by ourselves. It seems we can almost say
>>>>>>>> the
>>>>>>>> >>>>>> hardware
>>>>>>>> >>>>>> side is also ready.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> Thanks,
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> Jiangjie (Becket) Qin
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>>>>>>> rmetzger@apache.org>
>>>>>>>> >>>>>> wrote:
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>>>>> >>>>>> > When I first saw the Ember repository, I thought it is the
>>>>>>>> whole
>>>>>>>> >>>>>> thing
>>>>>>>> >>>>>> > (frontend and backend), but while testing it, I realized
>>>>>>>> it is
>>>>>>>> >>>>>> "only" the
>>>>>>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the
>>>>>>>> Ember
>>>>>>>> >>>>>> observer
>>>>>>>> >>>>>> > client, or just write a simple UI from scratch.
>>>>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>>>>> would be
>>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to
>>>>>>>> be eager
>>>>>>>> >>>>>> to help
>>>>>>>> >>>>>> > with this project for the backend:
>>>>>>>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>>>>> >>>>>> >
>>>>>>>> >>>>>> > For Infra: I made the same experience when asking for more
>>>>>>>> GitHub
>>>>>>>> >>>>>> > permissions for "flinkbot": They didn't respond on their
>>>>>>>> mailing
>>>>>>>> >>>>>> list, only
>>>>>>>> >>>>>> > on Jira.
>>>>>>>> >>>>>> >
>>>>>>>> >>>>>> >
>>>>>>>> >>>>>> >
>>>>>>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>>>>>>> becket.qin@gmail.com>
>>>>>>>> >>>>>> wrote:
>>>>>>>> >>>>>> >
>>>>>>>> >>>>>> >> Thanks for writing up the specifications.
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >> Regarding the website source code, Austin found a
>>>>>>>> website[1] whose
>>>>>>>> >>>>>> >> frontend code[2] is available publicly. It lacks some
>>>>>>>> support (e.g
>>>>>>>> >>>>>> login),
>>>>>>>> >>>>>> >> but it is still a good starting point. One thing is that
>>>>>>>> I did not
>>>>>>>> >>>>>> find a
>>>>>>>> >>>>>> >> License statement for that source code. I'll reach out to
>>>>>>>> the
>>>>>>>> >>>>>> author to see
>>>>>>>> >>>>>> >> if they have any concern over our usage.
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >> Apache Infra has not replied to my email regarding some
>>>>>>>> details
>>>>>>>> >>>>>> about the
>>>>>>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is
>>>>>>>> still no
>>>>>>>> >>>>>> response.
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >> Thanks,
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >> Jiangjie (Becket) Qin
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >> [1] https://emberobserver.com/
>>>>>>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>>> >>>>>> >> wrote:
>>>>>>>> >>>>>> >>
>>>>>>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on
>>>>>>>> their
>>>>>>>> >>>>>> company
>>>>>>>> >>>>>> >>> website. I guess the likelihood that they give out code
>>>>>>>> from
>>>>>>>> >>>>>> their company
>>>>>>>> >>>>>> >>> website is fairly low.
>>>>>>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page,
>>>>>>>> which we'll
>>>>>>>> >>>>>> >>> reactivate as part of this PR:
>>>>>>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>>>>> >>>>>> >>>
>>>>>>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>>>>>>> >>>>>> >>> I will propose a short specification in Becket's initial
>>>>>>>> document.
>>>>>>>> >>>>>> >>>
>>>>>>>> >>>>>> >>>
>>>>>>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>>>>>>> Niels@basjes.nl>
>>>>>>>> >>>>>> wrote:
>>>>>>>> >>>>>> >>>
>>>>>>>> >>>>>> >>>> Hi,
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>> The Beam project has something in this area that is
>>>>>>>> simply a page
>>>>>>>> >>>>>> >>>> within their documentation website:
>>>>>>>> >>>>>> >>>>
>>>>>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>>>>>>> bowenli86@gmail.com>
>>>>>>>> >>>>>> wrote:
>>>>>>>> >>>>>> >>>> >
>>>>>>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of
>>>>>>>> this kind. I
>>>>>>>> >>>>>> >>>> personally like it over the spark site. May worth
>>>>>>>> checking it
>>>>>>>> >>>>>> out with
>>>>>>>> >>>>>> >>>> Kafka folks
>>>>>>>> >>>>>> >>>> >
>>>>>>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>> >>>>>> >>>> >>
>>>>>>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR
>>>>>>>> to
>>>>>>>> >>>>>> update the
>>>>>>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>>>>>>> >>>>>> >>>> >>
>>>>>>>> >>>>>> >>>> >> Thanks,
>>>>>>>> >>>>>> >>>> >>
>>>>>>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>>>>> >>>>>> >>>> >>
>>>>>>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>> >>>>>> >>>> >>
>>>>>>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and
>>>>>>>> see if
>>>>>>>> >>>>>> they are
>>>>>>>> >>>>>> >>>> willing
>>>>>>>> >>>>>> >>>> >> > to share.
>>>>>>>> >>>>>> >>>> >> >
>>>>>>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem
>>>>>>>> page
>>>>>>>> >>>>>> (maybe sync
>>>>>>>> >>>>>> >>>> with
>>>>>>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>>>>>>> >>>>>> >>>> >> >
>>>>>>>> >>>>>>
>>>>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>>>>> >>>>>> >>>> and
>>>>>>>> >>>>>> >>>> >> > link it in the navigation?
>>>>>>>> >>>>>> >>>> >> >
>>>>>>>> >>>>>> >>>> >> > Best,
>>>>>>>> >>>>>> >>>> >> > Robert
>>>>>>>> >>>>>> >>>> >> >
>>>>>>>> >>>>>> >>>> >> >
>>>>>>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>> >>>>>> >>>> >> >
>>>>>>>> >>>>>> >>>> >> >> Hi Robert,
>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>>>>>>> spark-packages.org
>>>>>>>> >>>>>> owners
>>>>>>>> >>>>>> >>>> are
>>>>>>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to
>>>>>>>> write the
>>>>>>>> >>>>>> requirement
>>>>>>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very
>>>>>>>> helpful.
>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we
>>>>>>>> will need
>>>>>>>> >>>>>> it to
>>>>>>>> >>>>>> >>>> redirect
>>>>>>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first
>>>>>>>> do that
>>>>>>>> >>>>>> while
>>>>>>>> >>>>>> >>>> working on
>>>>>>>> >>>>>> >>>> >> >> the dynamic website?
>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>> >>>>>> >>>> >> >> Thanks,
>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>>>>>>> uce@apache.org
>>>>>>>> >>>>>> >
>>>>>>>> >>>>>> >>>> wrote:
>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static
>>>>>>>> site first.
>>>>>>>> >>>>>> We
>>>>>>>> >>>>>> >>>> could then
>>>>>>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>>>>>>> course,
>>>>>>>> >>>>>> if we
>>>>>>>> >>>>>> >>>> have the
>>>>>>>> >>>>>> >>>> >> >>> resources in the community to quickly start with
>>>>>>>> a
>>>>>>>> >>>>>> dynamic site,
>>>>>>>> >>>>>> >>>> I'm
>>>>>>>> >>>>>> >>>> >> >>> not apposed.
>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>> >>>>>> >>>> >> >>> – Ufuk
>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>>>>> >>>>>> >>>> rmetzger@apache.org>
>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this
>>>>>>>> Becket! The
>>>>>>>> >>>>>> VMs
>>>>>>>> >>>>>> >>>> hosted by
>>>>>>>> >>>>>> >>>> >> >>> Infra
>>>>>>>> >>>>>> >>>> >> >>> > look suitable.
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static
>>>>>>>> page. It
>>>>>>>> >>>>>> used to
>>>>>>>> >>>>>> >>>> be
>>>>>>>> >>>>>> >>>> >> >>> linked,
>>>>>>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar
>>>>>>>> for some
>>>>>>>> >>>>>> reason.
>>>>>>>> >>>>>> >>>> This is
>>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>>>>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>>>>> >>>>>> navigation bar
>>>>>>>> >>>>>> >>>> for the
>>>>>>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic
>>>>>>>> page right
>>>>>>>> >>>>>> away.
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do
>>>>>>>> you feel
>>>>>>>> >>>>>> about
>>>>>>>> >>>>>> >>>> sending the
>>>>>>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if
>>>>>>>> they are
>>>>>>>> >>>>>> >>>> interested in
>>>>>>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>>>>>>>> together
>>>>>>>> >>>>>> in a
>>>>>>>> >>>>>> >>>> public
>>>>>>>> >>>>>> >>>> >> >>> repo.
>>>>>>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we
>>>>>>>> decide not
>>>>>>>> >>>>>> to ask
>>>>>>>> >>>>>> >>>> in the
>>>>>>>> >>>>>> >>>> >> >>> first
>>>>>>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short
>>>>>>>> description of
>>>>>>>> >>>>>> the
>>>>>>>> >>>>>> >>>> requirements,
>>>>>>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we
>>>>>>>> find
>>>>>>>> >>>>>> somebody here
>>>>>>>> >>>>>> >>>> in the
>>>>>>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>>>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>>>>>>> contribute,
>>>>>>>> >>>>>> I
>>>>>>>> >>>>>> >>>> believe we
>>>>>>>> >>>>>> >>>> >> >>> will
>>>>>>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>> >>>>>> >>>> >> >>> > > [1]
>>>>>>>> https://www.apache.org/dev/services.html#blogs
>>>>>>>> >>>>>> (Apache
>>>>>>>> >>>>>> >>>> infra
>>>>>>>> >>>>>> >>>> >> >>> services)
>>>>>>>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>>>>>>> >>>>>> (FreeBSD Jail
>>>>>>>> >>>>>> >>>> provided
>>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good
>>>>>>>> points. We
>>>>>>>> >>>>>> should
>>>>>>>> >>>>>> >>>> absolutely
>>>>>>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>>>>> >>>>>> interactions in
>>>>>>>> >>>>>> >>>> the
>>>>>>>> >>>>>> >>>> >> >>> community.
>>>>>>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>>>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>>>>>>> solution
>>>>>>>> >>>>>> would
>>>>>>>> >>>>>> >>>> be great.
>>>>>>>> >>>>>> >>>> >> >>> TBH,
>>>>>>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>>>>>>>> website.
>>>>>>>> >>>>>> It'll
>>>>>>>> >>>>>> >>>> be great
>>>>>>>> >>>>>> >>>> >> >>> if
>>>>>>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution
>>>>>>>> here.
>>>>>>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache
>>>>>>>> Infra
>>>>>>>> >>>>>> provides
>>>>>>>> >>>>>> >>>> a few
>>>>>>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can
>>>>>>>> leverage. I did
>>>>>>>> >>>>>> not see
>>>>>>>> >>>>>> >>>> >> >>> database
>>>>>>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple
>>>>>>>> MySQL db in
>>>>>>>> >>>>>> FreeBSD
>>>>>>>> >>>>>> >>>> jail[2].
>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive
>>>>>>>> feedback!
>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>>>>>>> reasonable to
>>>>>>>> >>>>>> me. We
>>>>>>>> >>>>>> >>>> >> >>> probably need
>>>>>>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways,
>>>>>>>> even just
>>>>>>>> >>>>>> >>>> provide links
>>>>>>>> >>>>>> >>>> >> >>> it to
>>>>>>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the
>>>>>>>> connectors in
>>>>>>>> >>>>>> that
>>>>>>>> >>>>>> >>>> static
>>>>>>>> >>>>>> >>>> >> >>> page seems
>>>>>>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>>>>>>> working
>>>>>>>> >>>>>> on the
>>>>>>>> >>>>>> >>>> dynamic
>>>>>>>> >>>>>> >>>> >> >>> pages.
>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>> >>>>>> >>>> >> >>> > >> Thanks,
>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan
>>>>>>>> Wang <
>>>>>>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>>>>>>> >>>>>> >>>> >> >>> > >> wrote:
>>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out
>>>>>>>> with Flink
>>>>>>>> >>>>>> >>>> connectors at
>>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a
>>>>>>>> static page,
>>>>>>>> >>>>>> and
>>>>>>>> >>>>>> >>>> upgrade it
>>>>>>>> >>>>>> >>>> >> >>> when we
>>>>>>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one
>>>>>>>> with rich
>>>>>>>> >>>>>> functions.
>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>> >>>>>> >>>> >> >>> > >>> Regards,
>>>>>>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert
>>>>>>>> Metzger <
>>>>>>>> >>>>>> >>>> rmetzger@apache.org
>>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>>> >>>>>> >>>> >> >>> > >>> wrote:
>>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>>>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to
>>>>>>>> make sure
>>>>>>>> >>>>>> the page
>>>>>>>> >>>>>> >>>> is placed
>>>>>>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>>>>>> >>>>>> something will
>>>>>>>> >>>>>> >>>> get
>>>>>>>> >>>>>> >>>> >> >>> attention for
>>>>>>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>>>>>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>>>>>>> better,
>>>>>>>> >>>>>> if we
>>>>>>>> >>>>>> >>>> want
>>>>>>>> >>>>>> >>>> >> >>> features
>>>>>>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>>>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on
>>>>>>>> Apache
>>>>>>>> >>>>>> infra, and
>>>>>>>> >>>>>> >>>> endorsed
>>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>>> >>>>>> >>>> >> >>> > >>>> the community.
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing
>>>>>>>> software that
>>>>>>>> >>>>>> we
>>>>>>>> >>>>>> >>>> could use?
>>>>>>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>>>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>>>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for
>>>>>>>> Arch
>>>>>>>> >>>>>> Linux. The
>>>>>>>> >>>>>> >>>> source
>>>>>>>> >>>>>> >>>> >> >>> code of this
>>>>>>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>>>>>> >>>>>> structure is
>>>>>>>> >>>>>> >>>> not an
>>>>>>>> >>>>>> >>>> >> >>> ideal fit for
>>>>>>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>> Best,
>>>>>>>> >>>>>> >>>> >> >>> > >>>> Robert
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket
>>>>>>>> Qin <
>>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion
>>>>>>>> thread about
>>>>>>>> >>>>>> creating
>>>>>>>> >>>>>> >>>> a Flink
>>>>>>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to
>>>>>>>> help
>>>>>>>> >>>>>> contributors
>>>>>>>> >>>>>> >>>> who
>>>>>>>> >>>>>> >>>> >> >>> have developed
>>>>>>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work
>>>>>>>> with the
>>>>>>>> >>>>>> >>>> community.
>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more
>>>>>>>> details.
>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>>
>>>>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>>> >>>>>> >>>> >> >>>
>>>>>>>> >>>>>> >>>> >> >>
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>> --
>>>>>>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>>> >>>>>> >>>>
>>>>>>>> >>>>>> >>>
>>>>>>>> >>>>>>
>>>>>>>> >>>>>
>>>>>>>>
>>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Bowen Li <bo...@gmail.com>]

Fancy, thanks Daryl! I can definitely tell Fresh Bacon and Frozen Tuna
gonna be some big killer connectors :)

A couple feedbacks:

   - Shall we add a guide page to show people how to publish their projects
   to the website? The exact rules can be discussed and drafted in a separate
   email thread IMO
   - The "Log in with Github" link doesn't seem to work yet. Will it only
   allow login for admins and publishers, or for everyone?

Cheers! Bowen



On Fri, Apr 12, 2019 at 6:28 AM Oytun Tez <oy...@motaword.com> wrote:

> Yep, I guessed so... Good luck! :)
>
>
>
>
>
> ---
> Oytun Tez
>
> *M O T A W O R D*
> The World's Fastest Human Translation Platform.
> oytun@motaword.com — www.motaword.com
>
>
> On Fri, Apr 12, 2019 at 9:22 AM Daryl Roberts <da...@ververica.com> wrote:
>
>> I can definitely tweak the new on to come closer to matching the styles
>> of the other 2.
>>
>> I think all 3 sites are built with different UI frameworks, so to make
>> them all identical might be a bit difficult, but we can get them closer :)
>>
>> On Fri, Apr 12, 2019 at 3:17 PM Oytun Tez <oy...@motaword.com> wrote:
>>
>>> Daryl, looks very good, thank you!
>>>
>>> Only one feedback, I am attaching an image with 3 screenshots of the
>>> left sidebar from 3 sites:
>>>
>>>    - https://flink.apache.org/
>>>    - https://ci.apache.org/projects/flink/flink-docs-release-1.8/
>>>    - https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>
>>> SS:
>>> [image: 1.png]
>>>
>>> Maybe we can try to consolidate the sidebar in all 3 sites? This may be
>>> overreaching to homepage and doc maintainers as well. If that's a too
>>> involved process, perhaps the sidebar can at least have a gray background.
>>>
>>> Thank you again!
>>>
>>>
>>>
>>> ---
>>> Oytun Tez
>>>
>>> *M O T A W O R D*
>>> The World's Fastest Human Translation Platform.
>>> oytun@motaword.com — www.motaword.com
>>>
>>>
>>> On Fri, Apr 12, 2019 at 8:52 AM Daryl Roberts <da...@ververica.com>
>>> wrote:
>>>
>>>> Hello all,
>>>>
>>>> We have deployed the first version of the UI prototype to the following
>>>> URL: https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>>
>>>> It has some very basic functionality:
>>>> * list packages
>>>> * list packages by 'category'
>>>> * show a single package
>>>> * search that will take you to a search page
>>>>
>>>> The data is all fake, and generated new every time, so even if you
>>>> click on a package name, and the URL says one thing, the package data
>>>> itself will be different (and change every time you refresh).
>>>>
>>>> [image: Screenshot_2019-04-12_14_44_19.png]
>>>>
>>>> None of this is final, but we thought it would be a good idea for you
>>>> all to see what we have so far.
>>>>
>>>> If you have any feedback, please let us know.
>>>>
>>>> Thanks,
>>>> -daryl
>>>>
>>>> On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:
>>>>
>>>>> Thank you, all! If there are operational tasks about the ecosystem
>>>>> page(s), let me know (organizing the content etc, whatever).
>>>>>
>>>>> ---
>>>>> Oytun Tez
>>>>>
>>>>> *M O T A W O R D*
>>>>> The World's Fastest Human Translation Platform.
>>>>> oytun@motaword.com — www.motaword.com
>>>>>
>>>>>
>>>>> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Thanks for the update Robert! Looking forward to the prototype!
>>>>>>
>>>>>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>>> Quick summary of our call:
>>>>>>> Daryl will soon start with a front end, build against a very simple
>>>>>>> mock-backend.
>>>>>>> Congxian will start implementing the Spring-based backend early
>>>>>>> April.
>>>>>>>
>>>>>>> As soon as the first prototype of the UI is ready, we'll share it
>>>>>>> here for
>>>>>>> feedback.
>>>>>>>
>>>>>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
>>>>>>> wrote:
>>>>>>>
>>>>>>> > Okay, great.
>>>>>>> >
>>>>>>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm
>>>>>>> CET, 9pm
>>>>>>> > China time about the design of the ecosystem page (see:
>>>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>>>>>> > Please let me know if others want to join as well, I can add them
>>>>>>> to the
>>>>>>> > invite.
>>>>>>> >
>>>>>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>>>>>> wrote:
>>>>>>> >
>>>>>>> >> I agree. We can start with english-only and see how it goes. The
>>>>>>> comments
>>>>>>> >> and descriptions can always be multi-lingual but that is up to
>>>>>>> the package
>>>>>>> >> owners.
>>>>>>> >>
>>>>>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <
>>>>>>> rmetzger@apache.org>
>>>>>>> >> wrote:
>>>>>>> >>
>>>>>>> >>> Thanks.
>>>>>>> >>>
>>>>>>> >>> Do we actually want this page to be multi-language?
>>>>>>> >>>
>>>>>>> >>> I propose to make the website english-only, but maybe consider
>>>>>>> allowing
>>>>>>> >>> comments in different languages.
>>>>>>> >>> If we would make it multi-language, then we might have problems
>>>>>>> with
>>>>>>> >>> people submitting packages in non-english languages.
>>>>>>> >>>
>>>>>>> >>>
>>>>>>> >>>
>>>>>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
>>>>>>> wrote:
>>>>>>> >>>
>>>>>>> >>>> Done. The writeup looks great!
>>>>>>> >>>>
>>>>>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <
>>>>>>> rmetzger@apache.org>
>>>>>>> >>>> wrote:
>>>>>>> >>>>
>>>>>>> >>>>> Nice, really good news on the INFRA front!
>>>>>>> >>>>> I think the hardware specs sound reasonable. And a periodic
>>>>>>> backup of
>>>>>>> >>>>> the website's database to Infra's backup solution sounds
>>>>>>> reasonable too.
>>>>>>> >>>>>
>>>>>>> >>>>> Can you accept and review my proposal for the website?
>>>>>>> >>>>>
>>>>>>> >>>>>
>>>>>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <
>>>>>>> becket.qin@gmail.com>
>>>>>>> >>>>> wrote:
>>>>>>> >>>>>
>>>>>>> >>>>>> >
>>>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>>>> would be
>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>> >>>>>>
>>>>>>> >>>>>>
>>>>>>> >>>>>> That is awesome!
>>>>>>> >>>>>>
>>>>>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply.
>>>>>>> It
>>>>>>> >>>>>> looks that
>>>>>>> >>>>>> Apache infra team could provide a decent VM. The last piece
>>>>>>> is how to
>>>>>>> >>>>>> ensure the data is persisted so we won't lose the project
>>>>>>> info / user
>>>>>>> >>>>>> feedbacks when the VM is down. If Apache infra does not
>>>>>>> provide a
>>>>>>> >>>>>> persistent storage for DB backup, we can always ask for
>>>>>>> multiple VMs
>>>>>>> >>>>>> and do
>>>>>>> >>>>>> the fault tolerance by ourselves. It seems we can almost say
>>>>>>> the
>>>>>>> >>>>>> hardware
>>>>>>> >>>>>> side is also ready.
>>>>>>> >>>>>>
>>>>>>> >>>>>> Thanks,
>>>>>>> >>>>>>
>>>>>>> >>>>>> Jiangjie (Becket) Qin
>>>>>>> >>>>>>
>>>>>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>>> >>>>>>
>>>>>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>>>>>> rmetzger@apache.org>
>>>>>>> >>>>>> wrote:
>>>>>>> >>>>>>
>>>>>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>>>> >>>>>> > When I first saw the Ember repository, I thought it is the
>>>>>>> whole
>>>>>>> >>>>>> thing
>>>>>>> >>>>>> > (frontend and backend), but while testing it, I realized it
>>>>>>> is
>>>>>>> >>>>>> "only" the
>>>>>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>>>>>> >>>>>> observer
>>>>>>> >>>>>> > client, or just write a simple UI from scratch.
>>>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>>>> would be
>>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to
>>>>>>> be eager
>>>>>>> >>>>>> to help
>>>>>>> >>>>>> > with this project for the backend:
>>>>>>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>>>> >>>>>> >
>>>>>>> >>>>>> > For Infra: I made the same experience when asking for more
>>>>>>> GitHub
>>>>>>> >>>>>> > permissions for "flinkbot": They didn't respond on their
>>>>>>> mailing
>>>>>>> >>>>>> list, only
>>>>>>> >>>>>> > on Jira.
>>>>>>> >>>>>> >
>>>>>>> >>>>>> >
>>>>>>> >>>>>> >
>>>>>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>>>>>> becket.qin@gmail.com>
>>>>>>> >>>>>> wrote:
>>>>>>> >>>>>> >
>>>>>>> >>>>>> >> Thanks for writing up the specifications.
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >> Regarding the website source code, Austin found a
>>>>>>> website[1] whose
>>>>>>> >>>>>> >> frontend code[2] is available publicly. It lacks some
>>>>>>> support (e.g
>>>>>>> >>>>>> login),
>>>>>>> >>>>>> >> but it is still a good starting point. One thing is that I
>>>>>>> did not
>>>>>>> >>>>>> find a
>>>>>>> >>>>>> >> License statement for that source code. I'll reach out to
>>>>>>> the
>>>>>>> >>>>>> author to see
>>>>>>> >>>>>> >> if they have any concern over our usage.
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >> Apache Infra has not replied to my email regarding some
>>>>>>> details
>>>>>>> >>>>>> about the
>>>>>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is
>>>>>>> still no
>>>>>>> >>>>>> response.
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >> Thanks,
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >> Jiangjie (Becket) Qin
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >> [1] https://emberobserver.com/
>>>>>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>> >>>>>> >> wrote:
>>>>>>> >>>>>> >>
>>>>>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on
>>>>>>> their
>>>>>>> >>>>>> company
>>>>>>> >>>>>> >>> website. I guess the likelihood that they give out code
>>>>>>> from
>>>>>>> >>>>>> their company
>>>>>>> >>>>>> >>> website is fairly low.
>>>>>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page,
>>>>>>> which we'll
>>>>>>> >>>>>> >>> reactivate as part of this PR:
>>>>>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>>>> >>>>>> >>>
>>>>>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>>>>>> >>>>>> >>> I will propose a short specification in Becket's initial
>>>>>>> document.
>>>>>>> >>>>>> >>>
>>>>>>> >>>>>> >>>
>>>>>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>>>>>> Niels@basjes.nl>
>>>>>>> >>>>>> wrote:
>>>>>>> >>>>>> >>>
>>>>>>> >>>>>> >>>> Hi,
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>> The Beam project has something in this area that is
>>>>>>> simply a page
>>>>>>> >>>>>> >>>> within their documentation website:
>>>>>>> >>>>>> >>>>
>>>>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>>>>>> bowenli86@gmail.com>
>>>>>>> >>>>>> wrote:
>>>>>>> >>>>>> >>>> >
>>>>>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of
>>>>>>> this kind. I
>>>>>>> >>>>>> >>>> personally like it over the spark site. May worth
>>>>>>> checking it
>>>>>>> >>>>>> out with
>>>>>>> >>>>>> >>>> Kafka folks
>>>>>>> >>>>>> >>>> >
>>>>>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>> >>>>>> >>>> wrote:
>>>>>>> >>>>>> >>>> >>
>>>>>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR
>>>>>>> to
>>>>>>> >>>>>> update the
>>>>>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>>>>>> >>>>>> >>>> >>
>>>>>>> >>>>>> >>>> >> Thanks,
>>>>>>> >>>>>> >>>> >>
>>>>>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>>>> >>>>>> >>>> >>
>>>>>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>>>> >>>>>> rmetzger@apache.org>
>>>>>>> >>>>>> >>>> wrote:
>>>>>>> >>>>>> >>>> >>
>>>>>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and
>>>>>>> see if
>>>>>>> >>>>>> they are
>>>>>>> >>>>>> >>>> willing
>>>>>>> >>>>>> >>>> >> > to share.
>>>>>>> >>>>>> >>>> >> >
>>>>>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem
>>>>>>> page
>>>>>>> >>>>>> (maybe sync
>>>>>>> >>>>>> >>>> with
>>>>>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>>>>>> >>>>>> >>>> >> >
>>>>>>> >>>>>>
>>>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>>>> >>>>>> >>>> and
>>>>>>> >>>>>> >>>> >> > link it in the navigation?
>>>>>>> >>>>>> >>>> >> >
>>>>>>> >>>>>> >>>> >> > Best,
>>>>>>> >>>>>> >>>> >> > Robert
>>>>>>> >>>>>> >>>> >> >
>>>>>>> >>>>>> >>>> >> >
>>>>>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>>> >>>>>> >>>> wrote:
>>>>>>> >>>>>> >>>> >> >
>>>>>>> >>>>>> >>>> >> >> Hi Robert,
>>>>>>> >>>>>> >>>> >> >>
>>>>>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>>>>>> spark-packages.org
>>>>>>> >>>>>> owners
>>>>>>> >>>>>> >>>> are
>>>>>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write
>>>>>>> the
>>>>>>> >>>>>> requirement
>>>>>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very
>>>>>>> helpful.
>>>>>>> >>>>>> >>>> >> >>
>>>>>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we
>>>>>>> will need
>>>>>>> >>>>>> it to
>>>>>>> >>>>>> >>>> redirect
>>>>>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do
>>>>>>> that
>>>>>>> >>>>>> while
>>>>>>> >>>>>> >>>> working on
>>>>>>> >>>>>> >>>> >> >> the dynamic website?
>>>>>>> >>>>>> >>>> >> >>
>>>>>>> >>>>>> >>>> >> >> Thanks,
>>>>>>> >>>>>> >>>> >> >>
>>>>>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>>>> >>>>>> >>>> >> >>
>>>>>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>>>>>> uce@apache.org
>>>>>>> >>>>>> >
>>>>>>> >>>>>> >>>> wrote:
>>>>>>> >>>>>> >>>> >> >>
>>>>>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site
>>>>>>> first.
>>>>>>> >>>>>> We
>>>>>>> >>>>>> >>>> could then
>>>>>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>>>>>> course,
>>>>>>> >>>>>> if we
>>>>>>> >>>>>> >>>> have the
>>>>>>> >>>>>> >>>> >> >>> resources in the community to quickly start with a
>>>>>>> >>>>>> dynamic site,
>>>>>>> >>>>>> >>>> I'm
>>>>>>> >>>>>> >>>> >> >>> not apposed.
>>>>>>> >>>>>> >>>> >> >>>
>>>>>>> >>>>>> >>>> >> >>> – Ufuk
>>>>>>> >>>>>> >>>> >> >>>
>>>>>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>>>> >>>>>> >>>> rmetzger@apache.org>
>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this
>>>>>>> Becket! The
>>>>>>> >>>>>> VMs
>>>>>>> >>>>>> >>>> hosted by
>>>>>>> >>>>>> >>>> >> >>> Infra
>>>>>>> >>>>>> >>>> >> >>> > look suitable.
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static
>>>>>>> page. It
>>>>>>> >>>>>> used to
>>>>>>> >>>>>> >>>> be
>>>>>>> >>>>>> >>>> >> >>> linked,
>>>>>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar
>>>>>>> for some
>>>>>>> >>>>>> reason.
>>>>>>> >>>>>> >>>> This is
>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>>>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>>>> >>>>>> navigation bar
>>>>>>> >>>>>> >>>> for the
>>>>>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic
>>>>>>> page right
>>>>>>> >>>>>> away.
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you
>>>>>>> feel
>>>>>>> >>>>>> about
>>>>>>> >>>>>> >>>> sending the
>>>>>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if
>>>>>>> they are
>>>>>>> >>>>>> >>>> interested in
>>>>>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>>>>>>> together
>>>>>>> >>>>>> in a
>>>>>>> >>>>>> >>>> public
>>>>>>> >>>>>> >>>> >> >>> repo.
>>>>>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we
>>>>>>> decide not
>>>>>>> >>>>>> to ask
>>>>>>> >>>>>> >>>> in the
>>>>>>> >>>>>> >>>> >> >>> first
>>>>>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short
>>>>>>> description of
>>>>>>> >>>>>> the
>>>>>>> >>>>>> >>>> requirements,
>>>>>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>>>>> >>>>>> somebody here
>>>>>>> >>>>>> >>>> in the
>>>>>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>>>>>> contribute,
>>>>>>> >>>>>> I
>>>>>>> >>>>>> >>>> believe we
>>>>>>> >>>>>> >>>> >> >>> will
>>>>>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>> >>>>>> >>>> >> >>> > > [1]
>>>>>>> https://www.apache.org/dev/services.html#blogs
>>>>>>> >>>>>> (Apache
>>>>>>> >>>>>> >>>> infra
>>>>>>> >>>>>> >>>> >> >>> services)
>>>>>>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>>>>>> >>>>>> (FreeBSD Jail
>>>>>>> >>>>>> >>>> provided
>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>>> >>>>>> >>>> >> >>> > >
>>>>>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good
>>>>>>> points. We
>>>>>>> >>>>>> should
>>>>>>> >>>>>> >>>> absolutely
>>>>>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>>>> >>>>>> interactions in
>>>>>>> >>>>>> >>>> the
>>>>>>> >>>>>> >>>> >> >>> community.
>>>>>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>>>>>> solution
>>>>>>> >>>>>> would
>>>>>>> >>>>>> >>>> be great.
>>>>>>> >>>>>> >>>> >> >>> TBH,
>>>>>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>>>>>>> website.
>>>>>>> >>>>>> It'll
>>>>>>> >>>>>> >>>> be great
>>>>>>> >>>>>> >>>> >> >>> if
>>>>>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution
>>>>>>> here.
>>>>>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache
>>>>>>> Infra
>>>>>>> >>>>>> provides
>>>>>>> >>>>>> >>>> a few
>>>>>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can
>>>>>>> leverage. I did
>>>>>>> >>>>>> not see
>>>>>>> >>>>>> >>>> >> >>> database
>>>>>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL
>>>>>>> db in
>>>>>>> >>>>>> FreeBSD
>>>>>>> >>>>>> >>>> jail[2].
>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive
>>>>>>> feedback!
>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>>>>>> reasonable to
>>>>>>> >>>>>> me. We
>>>>>>> >>>>>> >>>> >> >>> probably need
>>>>>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways,
>>>>>>> even just
>>>>>>> >>>>>> >>>> provide links
>>>>>>> >>>>>> >>>> >> >>> it to
>>>>>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the
>>>>>>> connectors in
>>>>>>> >>>>>> that
>>>>>>> >>>>>> >>>> static
>>>>>>> >>>>>> >>>> >> >>> page seems
>>>>>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>>>>>> working
>>>>>>> >>>>>> on the
>>>>>>> >>>>>> >>>> dynamic
>>>>>>> >>>>>> >>>> >> >>> pages.
>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>> >>>>>> >>>> >> >>> > >> Thanks,
>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan
>>>>>>> Wang <
>>>>>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>>>>>> >>>>>> >>>> >> >>> > >> wrote:
>>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out
>>>>>>> with Flink
>>>>>>> >>>>>> >>>> connectors at
>>>>>>> >>>>>> >>>> >> >>> the
>>>>>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static
>>>>>>> page,
>>>>>>> >>>>>> and
>>>>>>> >>>>>> >>>> upgrade it
>>>>>>> >>>>>> >>>> >> >>> when we
>>>>>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with
>>>>>>> rich
>>>>>>> >>>>>> functions.
>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>> >>>>>> >>>> >> >>> > >>> Regards,
>>>>>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert
>>>>>>> Metzger <
>>>>>>> >>>>>> >>>> rmetzger@apache.org
>>>>>>> >>>>>> >>>> >> >>> >
>>>>>>> >>>>>> >>>> >> >>> > >>> wrote:
>>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make
>>>>>>> sure
>>>>>>> >>>>>> the page
>>>>>>> >>>>>> >>>> is placed
>>>>>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>>>>> >>>>>> something will
>>>>>>> >>>>>> >>>> get
>>>>>>> >>>>>> >>>> >> >>> attention for
>>>>>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>>>>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>>>>>> better,
>>>>>>> >>>>>> if we
>>>>>>> >>>>>> >>>> want
>>>>>>> >>>>>> >>>> >> >>> features
>>>>>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on
>>>>>>> Apache
>>>>>>> >>>>>> infra, and
>>>>>>> >>>>>> >>>> endorsed
>>>>>>> >>>>>> >>>> >> >>> by
>>>>>>> >>>>>> >>>> >> >>> > >>>> the community.
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing
>>>>>>> software that
>>>>>>> >>>>>> we
>>>>>>> >>>>>> >>>> could use?
>>>>>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for
>>>>>>> Arch
>>>>>>> >>>>>> Linux. The
>>>>>>> >>>>>> >>>> source
>>>>>>> >>>>>> >>>> >> >>> code of this
>>>>>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>>>>> >>>>>> structure is
>>>>>>> >>>>>> >>>> not an
>>>>>>> >>>>>> >>>> >> >>> ideal fit for
>>>>>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>> Best,
>>>>>>> >>>>>> >>>> >> >>> > >>>> Robert
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin
>>>>>>> <
>>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread
>>>>>>> about
>>>>>>> >>>>>> creating
>>>>>>> >>>>>> >>>> a Flink
>>>>>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to
>>>>>>> help
>>>>>>> >>>>>> contributors
>>>>>>> >>>>>> >>>> who
>>>>>>> >>>>>> >>>> >> >>> have developed
>>>>>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work
>>>>>>> with the
>>>>>>> >>>>>> >>>> community.
>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more
>>>>>>> details.
>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>> >>>>>> >>>> >> >>>
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>>
>>>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>>> >>>>>> >>>> >> >>>
>>>>>>> >>>>>> >>>> >> >>
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>> --
>>>>>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>> Niels Basjes
>>>>>>> >>>>>> >>>>
>>>>>>> >>>>>> >>>
>>>>>>> >>>>>>
>>>>>>> >>>>>
>>>>>>>
>>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Oytun Tez <oy...@motaword.com>]

Yep, I guessed so... Good luck! :)





---
Oytun Tez

*M O T A W O R D*
The World's Fastest Human Translation Platform.
oytun@motaword.com — www.motaword.com


On Fri, Apr 12, 2019 at 9:22 AM Daryl Roberts <da...@ververica.com> wrote:

> I can definitely tweak the new on to come closer to matching the styles of
> the other 2.
>
> I think all 3 sites are built with different UI frameworks, so to make
> them all identical might be a bit difficult, but we can get them closer :)
>
> On Fri, Apr 12, 2019 at 3:17 PM Oytun Tez <oy...@motaword.com> wrote:
>
>> Daryl, looks very good, thank you!
>>
>> Only one feedback, I am attaching an image with 3 screenshots of the left
>> sidebar from 3 sites:
>>
>>    - https://flink.apache.org/
>>    - https://ci.apache.org/projects/flink/flink-docs-release-1.8/
>>    - https://flink-ecosystem-demo.flink-resources.org/#/packages
>>
>> SS:
>> [image: 1.png]
>>
>> Maybe we can try to consolidate the sidebar in all 3 sites? This may be
>> overreaching to homepage and doc maintainers as well. If that's a too
>> involved process, perhaps the sidebar can at least have a gray background.
>>
>> Thank you again!
>>
>>
>>
>> ---
>> Oytun Tez
>>
>> *M O T A W O R D*
>> The World's Fastest Human Translation Platform.
>> oytun@motaword.com — www.motaword.com
>>
>>
>> On Fri, Apr 12, 2019 at 8:52 AM Daryl Roberts <da...@ververica.com>
>> wrote:
>>
>>> Hello all,
>>>
>>> We have deployed the first version of the UI prototype to the following
>>> URL: https://flink-ecosystem-demo.flink-resources.org/#/packages
>>>
>>> It has some very basic functionality:
>>> * list packages
>>> * list packages by 'category'
>>> * show a single package
>>> * search that will take you to a search page
>>>
>>> The data is all fake, and generated new every time, so even if you click
>>> on a package name, and the URL says one thing, the package data itself will
>>> be different (and change every time you refresh).
>>>
>>> [image: Screenshot_2019-04-12_14_44_19.png]
>>>
>>> None of this is final, but we thought it would be a good idea for you
>>> all to see what we have so far.
>>>
>>> If you have any feedback, please let us know.
>>>
>>> Thanks,
>>> -daryl
>>>
>>> On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:
>>>
>>>> Thank you, all! If there are operational tasks about the ecosystem
>>>> page(s), let me know (organizing the content etc, whatever).
>>>>
>>>> ---
>>>> Oytun Tez
>>>>
>>>> *M O T A W O R D*
>>>> The World's Fastest Human Translation Platform.
>>>> oytun@motaword.com — www.motaword.com
>>>>
>>>>
>>>> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>>
>>>>> Thanks for the update Robert! Looking forward to the prototype!
>>>>>
>>>>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
>>>>> wrote:
>>>>>
>>>>>> Quick summary of our call:
>>>>>> Daryl will soon start with a front end, build against a very simple
>>>>>> mock-backend.
>>>>>> Congxian will start implementing the Spring-based backend early April.
>>>>>>
>>>>>> As soon as the first prototype of the UI is ready, we'll share it
>>>>>> here for
>>>>>> feedback.
>>>>>>
>>>>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>> > Okay, great.
>>>>>> >
>>>>>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm
>>>>>> CET, 9pm
>>>>>> > China time about the design of the ecosystem page (see:
>>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>>>>> > Please let me know if others want to join as well, I can add them
>>>>>> to the
>>>>>> > invite.
>>>>>> >
>>>>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>>>>> wrote:
>>>>>> >
>>>>>> >> I agree. We can start with english-only and see how it goes. The
>>>>>> comments
>>>>>> >> and descriptions can always be multi-lingual but that is up to the
>>>>>> package
>>>>>> >> owners.
>>>>>> >>
>>>>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <
>>>>>> rmetzger@apache.org>
>>>>>> >> wrote:
>>>>>> >>
>>>>>> >>> Thanks.
>>>>>> >>>
>>>>>> >>> Do we actually want this page to be multi-language?
>>>>>> >>>
>>>>>> >>> I propose to make the website english-only, but maybe consider
>>>>>> allowing
>>>>>> >>> comments in different languages.
>>>>>> >>> If we would make it multi-language, then we might have problems
>>>>>> with
>>>>>> >>> people submitting packages in non-english languages.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
>>>>>> wrote:
>>>>>> >>>
>>>>>> >>>> Done. The writeup looks great!
>>>>>> >>>>
>>>>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <
>>>>>> rmetzger@apache.org>
>>>>>> >>>> wrote:
>>>>>> >>>>
>>>>>> >>>>> Nice, really good news on the INFRA front!
>>>>>> >>>>> I think the hardware specs sound reasonable. And a periodic
>>>>>> backup of
>>>>>> >>>>> the website's database to Infra's backup solution sounds
>>>>>> reasonable too.
>>>>>> >>>>>
>>>>>> >>>>> Can you accept and review my proposal for the website?
>>>>>> >>>>>
>>>>>> >>>>>
>>>>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <
>>>>>> becket.qin@gmail.com>
>>>>>> >>>>> wrote:
>>>>>> >>>>>
>>>>>> >>>>>> >
>>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>>> would be
>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>> >>>>>>
>>>>>> >>>>>>
>>>>>> >>>>>> That is awesome!
>>>>>> >>>>>>
>>>>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply.
>>>>>> It
>>>>>> >>>>>> looks that
>>>>>> >>>>>> Apache infra team could provide a decent VM. The last piece is
>>>>>> how to
>>>>>> >>>>>> ensure the data is persisted so we won't lose the project info
>>>>>> / user
>>>>>> >>>>>> feedbacks when the VM is down. If Apache infra does not
>>>>>> provide a
>>>>>> >>>>>> persistent storage for DB backup, we can always ask for
>>>>>> multiple VMs
>>>>>> >>>>>> and do
>>>>>> >>>>>> the fault tolerance by ourselves. It seems we can almost say
>>>>>> the
>>>>>> >>>>>> hardware
>>>>>> >>>>>> side is also ready.
>>>>>> >>>>>>
>>>>>> >>>>>> Thanks,
>>>>>> >>>>>>
>>>>>> >>>>>> Jiangjie (Becket) Qin
>>>>>> >>>>>>
>>>>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>> >>>>>>
>>>>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>>>>> rmetzger@apache.org>
>>>>>> >>>>>> wrote:
>>>>>> >>>>>>
>>>>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>>> >>>>>> > When I first saw the Ember repository, I thought it is the
>>>>>> whole
>>>>>> >>>>>> thing
>>>>>> >>>>>> > (frontend and backend), but while testing it, I realized it
>>>>>> is
>>>>>> >>>>>> "only" the
>>>>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>>>>> >>>>>> observer
>>>>>> >>>>>> > client, or just write a simple UI from scratch.
>>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>>> would be
>>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be
>>>>>> eager
>>>>>> >>>>>> to help
>>>>>> >>>>>> > with this project for the backend:
>>>>>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>>> >>>>>> >
>>>>>> >>>>>> > For Infra: I made the same experience when asking for more
>>>>>> GitHub
>>>>>> >>>>>> > permissions for "flinkbot": They didn't respond on their
>>>>>> mailing
>>>>>> >>>>>> list, only
>>>>>> >>>>>> > on Jira.
>>>>>> >>>>>> >
>>>>>> >>>>>> >
>>>>>> >>>>>> >
>>>>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>>>>> becket.qin@gmail.com>
>>>>>> >>>>>> wrote:
>>>>>> >>>>>> >
>>>>>> >>>>>> >> Thanks for writing up the specifications.
>>>>>> >>>>>> >>
>>>>>> >>>>>> >> Regarding the website source code, Austin found a
>>>>>> website[1] whose
>>>>>> >>>>>> >> frontend code[2] is available publicly. It lacks some
>>>>>> support (e.g
>>>>>> >>>>>> login),
>>>>>> >>>>>> >> but it is still a good starting point. One thing is that I
>>>>>> did not
>>>>>> >>>>>> find a
>>>>>> >>>>>> >> License statement for that source code. I'll reach out to
>>>>>> the
>>>>>> >>>>>> author to see
>>>>>> >>>>>> >> if they have any concern over our usage.
>>>>>> >>>>>> >>
>>>>>> >>>>>> >> Apache Infra has not replied to my email regarding some
>>>>>> details
>>>>>> >>>>>> about the
>>>>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is
>>>>>> still no
>>>>>> >>>>>> response.
>>>>>> >>>>>> >>
>>>>>> >>>>>> >> Thanks,
>>>>>> >>>>>> >>
>>>>>> >>>>>> >> Jiangjie (Becket) Qin
>>>>>> >>>>>> >>
>>>>>> >>>>>> >> [1] https://emberobserver.com/
>>>>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>>>>> >>>>>> >>
>>>>>> >>>>>> >>
>>>>>> >>>>>> >>
>>>>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>>> >>>>>> rmetzger@apache.org>
>>>>>> >>>>>> >> wrote:
>>>>>> >>>>>> >>
>>>>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on
>>>>>> their
>>>>>> >>>>>> company
>>>>>> >>>>>> >>> website. I guess the likelihood that they give out code
>>>>>> from
>>>>>> >>>>>> their company
>>>>>> >>>>>> >>> website is fairly low.
>>>>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which
>>>>>> we'll
>>>>>> >>>>>> >>> reactivate as part of this PR:
>>>>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>>> >>>>>> >>>
>>>>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>>>>> >>>>>> >>> I will propose a short specification in Becket's initial
>>>>>> document.
>>>>>> >>>>>> >>>
>>>>>> >>>>>> >>>
>>>>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>>>>> Niels@basjes.nl>
>>>>>> >>>>>> wrote:
>>>>>> >>>>>> >>>
>>>>>> >>>>>> >>>> Hi,
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>> The Beam project has something in this area that is
>>>>>> simply a page
>>>>>> >>>>>> >>>> within their documentation website:
>>>>>> >>>>>> >>>>
>>>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>> Niels Basjes
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>>>>> bowenli86@gmail.com>
>>>>>> >>>>>> wrote:
>>>>>> >>>>>> >>>> >
>>>>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
>>>>>> kind. I
>>>>>> >>>>>> >>>> personally like it over the spark site. May worth
>>>>>> checking it
>>>>>> >>>>>> out with
>>>>>> >>>>>> >>>> Kafka folks
>>>>>> >>>>>> >>>> >
>>>>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>> >>>>>> >>>> wrote:
>>>>>> >>>>>> >>>> >>
>>>>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>>>>>> >>>>>> update the
>>>>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>>>>> >>>>>> >>>> >>
>>>>>> >>>>>> >>>> >> Thanks,
>>>>>> >>>>>> >>>> >>
>>>>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>>> >>>>>> >>>> >>
>>>>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>>> >>>>>> rmetzger@apache.org>
>>>>>> >>>>>> >>>> wrote:
>>>>>> >>>>>> >>>> >>
>>>>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and
>>>>>> see if
>>>>>> >>>>>> they are
>>>>>> >>>>>> >>>> willing
>>>>>> >>>>>> >>>> >> > to share.
>>>>>> >>>>>> >>>> >> >
>>>>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem
>>>>>> page
>>>>>> >>>>>> (maybe sync
>>>>>> >>>>>> >>>> with
>>>>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>>>>> >>>>>> >>>> >> >
>>>>>> >>>>>>
>>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>>> >>>>>> >>>> and
>>>>>> >>>>>> >>>> >> > link it in the navigation?
>>>>>> >>>>>> >>>> >> >
>>>>>> >>>>>> >>>> >> > Best,
>>>>>> >>>>>> >>>> >> > Robert
>>>>>> >>>>>> >>>> >> >
>>>>>> >>>>>> >>>> >> >
>>>>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>>> >>>>>> becket.qin@gmail.com>
>>>>>> >>>>>> >>>> wrote:
>>>>>> >>>>>> >>>> >> >
>>>>>> >>>>>> >>>> >> >> Hi Robert,
>>>>>> >>>>>> >>>> >> >>
>>>>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>>>>> spark-packages.org
>>>>>> >>>>>> owners
>>>>>> >>>>>> >>>> are
>>>>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write
>>>>>> the
>>>>>> >>>>>> requirement
>>>>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very
>>>>>> helpful.
>>>>>> >>>>>> >>>> >> >>
>>>>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will
>>>>>> need
>>>>>> >>>>>> it to
>>>>>> >>>>>> >>>> redirect
>>>>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do
>>>>>> that
>>>>>> >>>>>> while
>>>>>> >>>>>> >>>> working on
>>>>>> >>>>>> >>>> >> >> the dynamic website?
>>>>>> >>>>>> >>>> >> >>
>>>>>> >>>>>> >>>> >> >> Thanks,
>>>>>> >>>>>> >>>> >> >>
>>>>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>>> >>>>>> >>>> >> >>
>>>>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>>>>> uce@apache.org
>>>>>> >>>>>> >
>>>>>> >>>>>> >>>> wrote:
>>>>>> >>>>>> >>>> >> >>
>>>>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site
>>>>>> first.
>>>>>> >>>>>> We
>>>>>> >>>>>> >>>> could then
>>>>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>>>>> course,
>>>>>> >>>>>> if we
>>>>>> >>>>>> >>>> have the
>>>>>> >>>>>> >>>> >> >>> resources in the community to quickly start with a
>>>>>> >>>>>> dynamic site,
>>>>>> >>>>>> >>>> I'm
>>>>>> >>>>>> >>>> >> >>> not apposed.
>>>>>> >>>>>> >>>> >> >>>
>>>>>> >>>>>> >>>> >> >>> – Ufuk
>>>>>> >>>>>> >>>> >> >>>
>>>>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>>> >>>>>> >>>> rmetzger@apache.org>
>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this
>>>>>> Becket! The
>>>>>> >>>>>> VMs
>>>>>> >>>>>> >>>> hosted by
>>>>>> >>>>>> >>>> >> >>> Infra
>>>>>> >>>>>> >>>> >> >>> > look suitable.
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static
>>>>>> page. It
>>>>>> >>>>>> used to
>>>>>> >>>>>> >>>> be
>>>>>> >>>>>> >>>> >> >>> linked,
>>>>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for
>>>>>> some
>>>>>> >>>>>> reason.
>>>>>> >>>>>> >>>> This is
>>>>>> >>>>>> >>>> >> >>> the
>>>>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>>> >>>>>> navigation bar
>>>>>> >>>>>> >>>> for the
>>>>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page
>>>>>> right
>>>>>> >>>>>> away.
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you
>>>>>> feel
>>>>>> >>>>>> about
>>>>>> >>>>>> >>>> sending the
>>>>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if
>>>>>> they are
>>>>>> >>>>>> >>>> interested in
>>>>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>>>>>> together
>>>>>> >>>>>> in a
>>>>>> >>>>>> >>>> public
>>>>>> >>>>>> >>>> >> >>> repo.
>>>>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we
>>>>>> decide not
>>>>>> >>>>>> to ask
>>>>>> >>>>>> >>>> in the
>>>>>> >>>>>> >>>> >> >>> first
>>>>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short
>>>>>> description of
>>>>>> >>>>>> the
>>>>>> >>>>>> >>>> requirements,
>>>>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>>>> >>>>>> somebody here
>>>>>> >>>>>> >>>> in the
>>>>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>>>>> contribute,
>>>>>> >>>>>> I
>>>>>> >>>>>> >>>> believe we
>>>>>> >>>>>> >>>> >> >>> will
>>>>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>>> >>>>>> >>>> >> >>> > >
>>>>>> >>>>>> >>>> >> >>> > > [1]
>>>>>> https://www.apache.org/dev/services.html#blogs
>>>>>> >>>>>> (Apache
>>>>>> >>>>>> >>>> infra
>>>>>> >>>>>> >>>> >> >>> services)
>>>>>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>>>>> >>>>>> (FreeBSD Jail
>>>>>> >>>>>> >>>> provided
>>>>>> >>>>>> >>>> >> >>> by
>>>>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>>>>> >>>>>> >>>> >> >>> > >
>>>>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>>>> >>>> >> >>> wrote:
>>>>>> >>>>>> >>>> >> >>> > >
>>>>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good
>>>>>> points. We
>>>>>> >>>>>> should
>>>>>> >>>>>> >>>> absolutely
>>>>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>>> >>>>>> interactions in
>>>>>> >>>>>> >>>> the
>>>>>> >>>>>> >>>> >> >>> community.
>>>>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>>>>> solution
>>>>>> >>>>>> would
>>>>>> >>>>>> >>>> be great.
>>>>>> >>>>>> >>>> >> >>> TBH,
>>>>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>>>>>> website.
>>>>>> >>>>>> It'll
>>>>>> >>>>>> >>>> be great
>>>>>> >>>>>> >>>> >> >>> if
>>>>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution
>>>>>> here.
>>>>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache
>>>>>> Infra
>>>>>> >>>>>> provides
>>>>>> >>>>>> >>>> a few
>>>>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can
>>>>>> leverage. I did
>>>>>> >>>>>> not see
>>>>>> >>>>>> >>>> >> >>> database
>>>>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL
>>>>>> db in
>>>>>> >>>>>> FreeBSD
>>>>>> >>>>>> >>>> jail[2].
>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive
>>>>>> feedback!
>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>>>>> reasonable to
>>>>>> >>>>>> me. We
>>>>>> >>>>>> >>>> >> >>> probably need
>>>>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways,
>>>>>> even just
>>>>>> >>>>>> >>>> provide links
>>>>>> >>>>>> >>>> >> >>> it to
>>>>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the
>>>>>> connectors in
>>>>>> >>>>>> that
>>>>>> >>>>>> >>>> static
>>>>>> >>>>>> >>>> >> >>> page seems
>>>>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>>>>> working
>>>>>> >>>>>> on the
>>>>>> >>>>>> >>>> dynamic
>>>>>> >>>>>> >>>> >> >>> pages.
>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>> >>>>>> >>>> >> >>> > >> Thanks,
>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang
>>>>>> <
>>>>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>>>>> >>>>>> >>>> >> >>> > >> wrote:
>>>>>> >>>>>> >>>> >> >>> > >>
>>>>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with
>>>>>> Flink
>>>>>> >>>>>> >>>> connectors at
>>>>>> >>>>>> >>>> >> >>> the
>>>>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static
>>>>>> page,
>>>>>> >>>>>> and
>>>>>> >>>>>> >>>> upgrade it
>>>>>> >>>>>> >>>> >> >>> when we
>>>>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with
>>>>>> rich
>>>>>> >>>>>> functions.
>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>> >>>>>> >>>> >> >>> > >>> Regards,
>>>>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert
>>>>>> Metzger <
>>>>>> >>>>>> >>>> rmetzger@apache.org
>>>>>> >>>>>> >>>> >> >>> >
>>>>>> >>>>>> >>>> >> >>> > >>> wrote:
>>>>>> >>>>>> >>>> >> >>> > >>>
>>>>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make
>>>>>> sure
>>>>>> >>>>>> the page
>>>>>> >>>>>> >>>> is placed
>>>>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>>>> >>>>>> something will
>>>>>> >>>>>> >>>> get
>>>>>> >>>>>> >>>> >> >>> attention for
>>>>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>>>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>>>>> better,
>>>>>> >>>>>> if we
>>>>>> >>>>>> >>>> want
>>>>>> >>>>>> >>>> >> >>> features
>>>>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on
>>>>>> Apache
>>>>>> >>>>>> infra, and
>>>>>> >>>>>> >>>> endorsed
>>>>>> >>>>>> >>>> >> >>> by
>>>>>> >>>>>> >>>> >> >>> > >>>> the community.
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing
>>>>>> software that
>>>>>> >>>>>> we
>>>>>> >>>>>> >>>> could use?
>>>>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>>>>>> >>>>>> Linux. The
>>>>>> >>>>>> >>>> source
>>>>>> >>>>>> >>>> >> >>> code of this
>>>>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>>>> >>>>>> structure is
>>>>>> >>>>>> >>>> not an
>>>>>> >>>>>> >>>> >> >>> ideal fit for
>>>>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>> > >>>> Best,
>>>>>> >>>>>> >>>> >> >>> > >>>> Robert
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread
>>>>>> about
>>>>>> >>>>>> creating
>>>>>> >>>>>> >>>> a Flink
>>>>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>>>> >>>>>> contributors
>>>>>> >>>>>> >>>> who
>>>>>> >>>>>> >>>> >> >>> have developed
>>>>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work
>>>>>> with the
>>>>>> >>>>>> >>>> community.
>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more
>>>>>> details.
>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>>>> >>>> >> >>>
>>>>>> >>>>>> >>>>
>>>>>> >>>>>>
>>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>>> >>>>>> >>>> >> >>>
>>>>>> >>>>>> >>>> >> >>
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>> --
>>>>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>> Niels Basjes
>>>>>> >>>>>> >>>>
>>>>>> >>>>>> >>>
>>>>>> >>>>>>
>>>>>> >>>>>
>>>>>>
>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Daryl Roberts <da...@ververica.com>]

I can definitely tweak the new on to come closer to matching the styles of
the other 2.

I think all 3 sites are built with different UI frameworks, so to make them
all identical might be a bit difficult, but we can get them closer :)

On Fri, Apr 12, 2019 at 3:17 PM Oytun Tez <oy...@motaword.com> wrote:

> Daryl, looks very good, thank you!
>
> Only one feedback, I am attaching an image with 3 screenshots of the left
> sidebar from 3 sites:
>
>    - https://flink.apache.org/
>    - https://ci.apache.org/projects/flink/flink-docs-release-1.8/
>    - https://flink-ecosystem-demo.flink-resources.org/#/packages
>
> SS:
> [image: 1.png]
>
> Maybe we can try to consolidate the sidebar in all 3 sites? This may be
> overreaching to homepage and doc maintainers as well. If that's a too
> involved process, perhaps the sidebar can at least have a gray background.
>
> Thank you again!
>
>
>
> ---
> Oytun Tez
>
> *M O T A W O R D*
> The World's Fastest Human Translation Platform.
> oytun@motaword.com — www.motaword.com
>
>
> On Fri, Apr 12, 2019 at 8:52 AM Daryl Roberts <da...@ververica.com> wrote:
>
>> Hello all,
>>
>> We have deployed the first version of the UI prototype to the following
>> URL: https://flink-ecosystem-demo.flink-resources.org/#/packages
>>
>> It has some very basic functionality:
>> * list packages
>> * list packages by 'category'
>> * show a single package
>> * search that will take you to a search page
>>
>> The data is all fake, and generated new every time, so even if you click
>> on a package name, and the URL says one thing, the package data itself will
>> be different (and change every time you refresh).
>>
>> [image: Screenshot_2019-04-12_14_44_19.png]
>>
>> None of this is final, but we thought it would be a good idea for you all
>> to see what we have so far.
>>
>> If you have any feedback, please let us know.
>>
>> Thanks,
>> -daryl
>>
>> On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:
>>
>>> Thank you, all! If there are operational tasks about the ecosystem
>>> page(s), let me know (organizing the content etc, whatever).
>>>
>>> ---
>>> Oytun Tez
>>>
>>> *M O T A W O R D*
>>> The World's Fastest Human Translation Platform.
>>> oytun@motaword.com — www.motaword.com
>>>
>>>
>>> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> Thanks for the update Robert! Looking forward to the prototype!
>>>>
>>>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>>> Quick summary of our call:
>>>>> Daryl will soon start with a front end, build against a very simple
>>>>> mock-backend.
>>>>> Congxian will start implementing the Spring-based backend early April.
>>>>>
>>>>> As soon as the first prototype of the UI is ready, we'll share it here
>>>>> for
>>>>> feedback.
>>>>>
>>>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
>>>>> wrote:
>>>>>
>>>>> > Okay, great.
>>>>> >
>>>>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm
>>>>> CET, 9pm
>>>>> > China time about the design of the ecosystem page (see:
>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>>>> > Please let me know if others want to join as well, I can add them to
>>>>> the
>>>>> > invite.
>>>>> >
>>>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>> >
>>>>> >> I agree. We can start with english-only and see how it goes. The
>>>>> comments
>>>>> >> and descriptions can always be multi-lingual but that is up to the
>>>>> package
>>>>> >> owners.
>>>>> >>
>>>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rmetzger@apache.org
>>>>> >
>>>>> >> wrote:
>>>>> >>
>>>>> >>> Thanks.
>>>>> >>>
>>>>> >>> Do we actually want this page to be multi-language?
>>>>> >>>
>>>>> >>> I propose to make the website english-only, but maybe consider
>>>>> allowing
>>>>> >>> comments in different languages.
>>>>> >>> If we would make it multi-language, then we might have problems
>>>>> with
>>>>> >>> people submitting packages in non-english languages.
>>>>> >>>
>>>>> >>>
>>>>> >>>
>>>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>> >>>
>>>>> >>>> Done. The writeup looks great!
>>>>> >>>>
>>>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <
>>>>> rmetzger@apache.org>
>>>>> >>>> wrote:
>>>>> >>>>
>>>>> >>>>> Nice, really good news on the INFRA front!
>>>>> >>>>> I think the hardware specs sound reasonable. And a periodic
>>>>> backup of
>>>>> >>>>> the website's database to Infra's backup solution sounds
>>>>> reasonable too.
>>>>> >>>>>
>>>>> >>>>> Can you accept and review my proposal for the website?
>>>>> >>>>>
>>>>> >>>>>
>>>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <becket.qin@gmail.com
>>>>> >
>>>>> >>>>> wrote:
>>>>> >>>>>
>>>>> >>>>>> >
>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>> would be
>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>> >>>>>>
>>>>> >>>>>>
>>>>> >>>>>> That is awesome!
>>>>> >>>>>>
>>>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
>>>>> >>>>>> looks that
>>>>> >>>>>> Apache infra team could provide a decent VM. The last piece is
>>>>> how to
>>>>> >>>>>> ensure the data is persisted so we won't lose the project info
>>>>> / user
>>>>> >>>>>> feedbacks when the VM is down. If Apache infra does not provide
>>>>> a
>>>>> >>>>>> persistent storage for DB backup, we can always ask for
>>>>> multiple VMs
>>>>> >>>>>> and do
>>>>> >>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>>> >>>>>> hardware
>>>>> >>>>>> side is also ready.
>>>>> >>>>>>
>>>>> >>>>>> Thanks,
>>>>> >>>>>>
>>>>> >>>>>> Jiangjie (Becket) Qin
>>>>> >>>>>>
>>>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>> >>>>>>
>>>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>>>> rmetzger@apache.org>
>>>>> >>>>>> wrote:
>>>>> >>>>>>
>>>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>> >>>>>> > When I first saw the Ember repository, I thought it is the
>>>>> whole
>>>>> >>>>>> thing
>>>>> >>>>>> > (frontend and backend), but while testing it, I realized it is
>>>>> >>>>>> "only" the
>>>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>>>> >>>>>> observer
>>>>> >>>>>> > client, or just write a simple UI from scratch.
>>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>>> would be
>>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be
>>>>> eager
>>>>> >>>>>> to help
>>>>> >>>>>> > with this project for the backend:
>>>>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>> >>>>>> >
>>>>> >>>>>> > For Infra: I made the same experience when asking for more
>>>>> GitHub
>>>>> >>>>>> > permissions for "flinkbot": They didn't respond on their
>>>>> mailing
>>>>> >>>>>> list, only
>>>>> >>>>>> > on Jira.
>>>>> >>>>>> >
>>>>> >>>>>> >
>>>>> >>>>>> >
>>>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>>>> becket.qin@gmail.com>
>>>>> >>>>>> wrote:
>>>>> >>>>>> >
>>>>> >>>>>> >> Thanks for writing up the specifications.
>>>>> >>>>>> >>
>>>>> >>>>>> >> Regarding the website source code, Austin found a website[1]
>>>>> whose
>>>>> >>>>>> >> frontend code[2] is available publicly. It lacks some
>>>>> support (e.g
>>>>> >>>>>> login),
>>>>> >>>>>> >> but it is still a good starting point. One thing is that I
>>>>> did not
>>>>> >>>>>> find a
>>>>> >>>>>> >> License statement for that source code. I'll reach out to the
>>>>> >>>>>> author to see
>>>>> >>>>>> >> if they have any concern over our usage.
>>>>> >>>>>> >>
>>>>> >>>>>> >> Apache Infra has not replied to my email regarding some
>>>>> details
>>>>> >>>>>> about the
>>>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is
>>>>> still no
>>>>> >>>>>> response.
>>>>> >>>>>> >>
>>>>> >>>>>> >> Thanks,
>>>>> >>>>>> >>
>>>>> >>>>>> >> Jiangjie (Becket) Qin
>>>>> >>>>>> >>
>>>>> >>>>>> >> [1] https://emberobserver.com/
>>>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>>>> >>>>>> >>
>>>>> >>>>>> >>
>>>>> >>>>>> >>
>>>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>> >>>>>> rmetzger@apache.org>
>>>>> >>>>>> >> wrote:
>>>>> >>>>>> >>
>>>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on
>>>>> their
>>>>> >>>>>> company
>>>>> >>>>>> >>> website. I guess the likelihood that they give out code from
>>>>> >>>>>> their company
>>>>> >>>>>> >>> website is fairly low.
>>>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which
>>>>> we'll
>>>>> >>>>>> >>> reactivate as part of this PR:
>>>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>> >>>>>> >>>
>>>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>>>> >>>>>> >>> I will propose a short specification in Becket's initial
>>>>> document.
>>>>> >>>>>> >>>
>>>>> >>>>>> >>>
>>>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>>>> Niels@basjes.nl>
>>>>> >>>>>> wrote:
>>>>> >>>>>> >>>
>>>>> >>>>>> >>>> Hi,
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>> The Beam project has something in this area that is simply
>>>>> a page
>>>>> >>>>>> >>>> within their documentation website:
>>>>> >>>>>> >>>>
>>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>> Niels Basjes
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>>>> bowenli86@gmail.com>
>>>>> >>>>>> wrote:
>>>>> >>>>>> >>>> >
>>>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
>>>>> kind. I
>>>>> >>>>>> >>>> personally like it over the spark site. May worth checking
>>>>> it
>>>>> >>>>>> out with
>>>>> >>>>>> >>>> Kafka folks
>>>>> >>>>>> >>>> >
>>>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>> >>>>>> becket.qin@gmail.com>
>>>>> >>>>>> >>>> wrote:
>>>>> >>>>>> >>>> >>
>>>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>>>>> >>>>>> update the
>>>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>>>> >>>>>> >>>> >>
>>>>> >>>>>> >>>> >> Thanks,
>>>>> >>>>>> >>>> >>
>>>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>> >>>>>> >>>> >>
>>>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>> >>>>>> rmetzger@apache.org>
>>>>> >>>>>> >>>> wrote:
>>>>> >>>>>> >>>> >>
>>>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see
>>>>> if
>>>>> >>>>>> they are
>>>>> >>>>>> >>>> willing
>>>>> >>>>>> >>>> >> > to share.
>>>>> >>>>>> >>>> >> >
>>>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>>>> >>>>>> (maybe sync
>>>>> >>>>>> >>>> with
>>>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>>>> >>>>>> >>>> >> >
>>>>> >>>>>>
>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>> >>>>>> >>>> and
>>>>> >>>>>> >>>> >> > link it in the navigation?
>>>>> >>>>>> >>>> >> >
>>>>> >>>>>> >>>> >> > Best,
>>>>> >>>>>> >>>> >> > Robert
>>>>> >>>>>> >>>> >> >
>>>>> >>>>>> >>>> >> >
>>>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>> >>>>>> becket.qin@gmail.com>
>>>>> >>>>>> >>>> wrote:
>>>>> >>>>>> >>>> >> >
>>>>> >>>>>> >>>> >> >> Hi Robert,
>>>>> >>>>>> >>>> >> >>
>>>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>>>> spark-packages.org
>>>>> >>>>>> owners
>>>>> >>>>>> >>>> are
>>>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write
>>>>> the
>>>>> >>>>>> requirement
>>>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>>> >>>>>> >>>> >> >>
>>>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will
>>>>> need
>>>>> >>>>>> it to
>>>>> >>>>>> >>>> redirect
>>>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do
>>>>> that
>>>>> >>>>>> while
>>>>> >>>>>> >>>> working on
>>>>> >>>>>> >>>> >> >> the dynamic website?
>>>>> >>>>>> >>>> >> >>
>>>>> >>>>>> >>>> >> >> Thanks,
>>>>> >>>>>> >>>> >> >>
>>>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>> >>>>>> >>>> >> >>
>>>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>>>> uce@apache.org
>>>>> >>>>>> >
>>>>> >>>>>> >>>> wrote:
>>>>> >>>>>> >>>> >> >>
>>>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site
>>>>> first.
>>>>> >>>>>> We
>>>>> >>>>>> >>>> could then
>>>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>>>> course,
>>>>> >>>>>> if we
>>>>> >>>>>> >>>> have the
>>>>> >>>>>> >>>> >> >>> resources in the community to quickly start with a
>>>>> >>>>>> dynamic site,
>>>>> >>>>>> >>>> I'm
>>>>> >>>>>> >>>> >> >>> not apposed.
>>>>> >>>>>> >>>> >> >>>
>>>>> >>>>>> >>>> >> >>> – Ufuk
>>>>> >>>>>> >>>> >> >>>
>>>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>> >>>>>> >>>> rmetzger@apache.org>
>>>>> >>>>>> >>>> >> >>> wrote:
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this
>>>>> Becket! The
>>>>> >>>>>> VMs
>>>>> >>>>>> >>>> hosted by
>>>>> >>>>>> >>>> >> >>> Infra
>>>>> >>>>>> >>>> >> >>> > look suitable.
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static
>>>>> page. It
>>>>> >>>>>> used to
>>>>> >>>>>> >>>> be
>>>>> >>>>>> >>>> >> >>> linked,
>>>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for
>>>>> some
>>>>> >>>>>> reason.
>>>>> >>>>>> >>>> This is
>>>>> >>>>>> >>>> >> >>> the
>>>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>> >>>>>> navigation bar
>>>>> >>>>>> >>>> for the
>>>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page
>>>>> right
>>>>> >>>>>> away.
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you
>>>>> feel
>>>>> >>>>>> about
>>>>> >>>>>> >>>> sending the
>>>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if
>>>>> they are
>>>>> >>>>>> >>>> interested in
>>>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>>>>> together
>>>>> >>>>>> in a
>>>>> >>>>>> >>>> public
>>>>> >>>>>> >>>> >> >>> repo.
>>>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we
>>>>> decide not
>>>>> >>>>>> to ask
>>>>> >>>>>> >>>> in the
>>>>> >>>>>> >>>> >> >>> first
>>>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short
>>>>> description of
>>>>> >>>>>> the
>>>>> >>>>>> >>>> requirements,
>>>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>>> >>>>>> somebody here
>>>>> >>>>>> >>>> in the
>>>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>>>> contribute,
>>>>> >>>>>> I
>>>>> >>>>>> >>>> believe we
>>>>> >>>>>> >>>> >> >>> will
>>>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>>>> >>>> >> >>> wrote:
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>> >>>>>> >>>> >> >>> > >
>>>>> >>>>>> >>>> >> >>> > > [1]
>>>>> https://www.apache.org/dev/services.html#blogs
>>>>> >>>>>> (Apache
>>>>> >>>>>> >>>> infra
>>>>> >>>>>> >>>> >> >>> services)
>>>>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>>>> >>>>>> (FreeBSD Jail
>>>>> >>>>>> >>>> provided
>>>>> >>>>>> >>>> >> >>> by
>>>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>>>> >>>>>> >>>> >> >>> > >
>>>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>>>> >>>> >> >>> wrote:
>>>>> >>>>>> >>>> >> >>> > >
>>>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>>>> >>>>>> >>>> >> >>> > >>
>>>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good
>>>>> points. We
>>>>> >>>>>> should
>>>>> >>>>>> >>>> absolutely
>>>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>> >>>>>> interactions in
>>>>> >>>>>> >>>> the
>>>>> >>>>>> >>>> >> >>> community.
>>>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>>>> solution
>>>>> >>>>>> would
>>>>> >>>>>> >>>> be great.
>>>>> >>>>>> >>>> >> >>> TBH,
>>>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>>>>> website.
>>>>> >>>>>> It'll
>>>>> >>>>>> >>>> be great
>>>>> >>>>>> >>>> >> >>> if
>>>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution
>>>>> here.
>>>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache
>>>>> Infra
>>>>> >>>>>> provides
>>>>> >>>>>> >>>> a few
>>>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage.
>>>>> I did
>>>>> >>>>>> not see
>>>>> >>>>>> >>>> >> >>> database
>>>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL
>>>>> db in
>>>>> >>>>>> FreeBSD
>>>>> >>>>>> >>>> jail[2].
>>>>> >>>>>> >>>> >> >>> > >>
>>>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive
>>>>> feedback!
>>>>> >>>>>> >>>> >> >>> > >>
>>>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>>>> reasonable to
>>>>> >>>>>> me. We
>>>>> >>>>>> >>>> >> >>> probably need
>>>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways,
>>>>> even just
>>>>> >>>>>> >>>> provide links
>>>>> >>>>>> >>>> >> >>> it to
>>>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the
>>>>> connectors in
>>>>> >>>>>> that
>>>>> >>>>>> >>>> static
>>>>> >>>>>> >>>> >> >>> page seems
>>>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>>>> working
>>>>> >>>>>> on the
>>>>> >>>>>> >>>> dynamic
>>>>> >>>>>> >>>> >> >>> pages.
>>>>> >>>>>> >>>> >> >>> > >>
>>>>> >>>>>> >>>> >> >>> > >> Thanks,
>>>>> >>>>>> >>>> >> >>> > >>
>>>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>> >>>>>> >>>> >> >>> > >>
>>>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>>>> >>>>>> >>>> >> >>> > >> wrote:
>>>>> >>>>>> >>>> >> >>> > >>
>>>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>> >>>>>> >>>> >> >>> > >>>
>>>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with
>>>>> Flink
>>>>> >>>>>> >>>> connectors at
>>>>> >>>>>> >>>> >> >>> the
>>>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static
>>>>> page,
>>>>> >>>>>> and
>>>>> >>>>>> >>>> upgrade it
>>>>> >>>>>> >>>> >> >>> when we
>>>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with
>>>>> rich
>>>>> >>>>>> functions.
>>>>> >>>>>> >>>> >> >>> > >>>
>>>>> >>>>>> >>>> >> >>> > >>> Regards,
>>>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>> >>>>>> >>>> >> >>> > >>>
>>>>> >>>>>> >>>> >> >>> > >>>
>>>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger
>>>>> <
>>>>> >>>>>> >>>> rmetzger@apache.org
>>>>> >>>>>> >>>> >> >>> >
>>>>> >>>>>> >>>> >> >>> > >>> wrote:
>>>>> >>>>>> >>>> >> >>> > >>>
>>>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make
>>>>> sure
>>>>> >>>>>> the page
>>>>> >>>>>> >>>> is placed
>>>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>>> >>>>>> something will
>>>>> >>>>>> >>>> get
>>>>> >>>>>> >>>> >> >>> attention for
>>>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>>>> better,
>>>>> >>>>>> if we
>>>>> >>>>>> >>>> want
>>>>> >>>>>> >>>> >> >>> features
>>>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>>>> >>>>>> infra, and
>>>>> >>>>>> >>>> endorsed
>>>>> >>>>>> >>>> >> >>> by
>>>>> >>>>>> >>>> >> >>> > >>>> the community.
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software
>>>>> that
>>>>> >>>>>> we
>>>>> >>>>>> >>>> could use?
>>>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>>>>> >>>>>> Linux. The
>>>>> >>>>>> >>>> source
>>>>> >>>>>> >>>> >> >>> code of this
>>>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>>> >>>>>> structure is
>>>>> >>>>>> >>>> not an
>>>>> >>>>>> >>>> >> >>> ideal fit for
>>>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>> > >>>> Best,
>>>>> >>>>>> >>>> >> >>> > >>>> Robert
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread
>>>>> about
>>>>> >>>>>> creating
>>>>> >>>>>> >>>> a Flink
>>>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>>> >>>>>> contributors
>>>>> >>>>>> >>>> who
>>>>> >>>>>> >>>> >> >>> have developed
>>>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with
>>>>> the
>>>>> >>>>>> >>>> community.
>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more
>>>>> details.
>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>> >>>>>> >>>> >> >>>
>>>>> >>>>>> >>>>
>>>>> >>>>>>
>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>> >>>>>> >>>> >> >>> > >>>>>
>>>>> >>>>>> >>>> >> >>> > >>>>
>>>>> >>>>>> >>>> >> >>>
>>>>> >>>>>> >>>> >> >>
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>> --
>>>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>> Niels Basjes
>>>>> >>>>>> >>>>
>>>>> >>>>>> >>>
>>>>> >>>>>>
>>>>> >>>>>
>>>>>
>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Oytun Tez <oy...@motaword.com>]

Daryl, looks very good, thank you!

Only one feedback, I am attaching an image with 3 screenshots of the left
sidebar from 3 sites:

   - https://flink.apache.org/
   - https://ci.apache.org/projects/flink/flink-docs-release-1.8/
   - https://flink-ecosystem-demo.flink-resources.org/#/packages

SS:
[image: 1.png]

Maybe we can try to consolidate the sidebar in all 3 sites? This may be
overreaching to homepage and doc maintainers as well. If that's a too
involved process, perhaps the sidebar can at least have a gray background.

Thank you again!



---
Oytun Tez

*M O T A W O R D*
The World's Fastest Human Translation Platform.
oytun@motaword.com — www.motaword.com


On Fri, Apr 12, 2019 at 8:52 AM Daryl Roberts <da...@ververica.com> wrote:

> Hello all,
>
> We have deployed the first version of the UI prototype to the following
> URL: https://flink-ecosystem-demo.flink-resources.org/#/packages
>
> It has some very basic functionality:
> * list packages
> * list packages by 'category'
> * show a single package
> * search that will take you to a search page
>
> The data is all fake, and generated new every time, so even if you click
> on a package name, and the URL says one thing, the package data itself will
> be different (and change every time you refresh).
>
> [image: Screenshot_2019-04-12_14_44_19.png]
>
> None of this is final, but we thought it would be a good idea for you all
> to see what we have so far.
>
> If you have any feedback, please let us know.
>
> Thanks,
> -daryl
>
> On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:
>
>> Thank you, all! If there are operational tasks about the ecosystem
>> page(s), let me know (organizing the content etc, whatever).
>>
>> ---
>> Oytun Tez
>>
>> *M O T A W O R D*
>> The World's Fastest Human Translation Platform.
>> oytun@motaword.com — www.motaword.com
>>
>>
>> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com> wrote:
>>
>>> Thanks for the update Robert! Looking forward to the prototype!
>>>
>>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Quick summary of our call:
>>>> Daryl will soon start with a front end, build against a very simple
>>>> mock-backend.
>>>> Congxian will start implementing the Spring-based backend early April.
>>>>
>>>> As soon as the first prototype of the UI is ready, we'll share it here
>>>> for
>>>> feedback.
>>>>
>>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>> > Okay, great.
>>>> >
>>>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm
>>>> CET, 9pm
>>>> > China time about the design of the ecosystem page (see:
>>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>>> > Please let me know if others want to join as well, I can add them to
>>>> the
>>>> > invite.
>>>> >
>>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >
>>>> >> I agree. We can start with english-only and see how it goes. The
>>>> comments
>>>> >> and descriptions can always be multi-lingual but that is up to the
>>>> package
>>>> >> owners.
>>>> >>
>>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
>>>> >> wrote:
>>>> >>
>>>> >>> Thanks.
>>>> >>>
>>>> >>> Do we actually want this page to be multi-language?
>>>> >>>
>>>> >>> I propose to make the website english-only, but maybe consider
>>>> allowing
>>>> >>> comments in different languages.
>>>> >>> If we would make it multi-language, then we might have problems with
>>>> >>> people submitting packages in non-english languages.
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >>>
>>>> >>>> Done. The writeup looks great!
>>>> >>>>
>>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>>> wrote:
>>>> >>>>
>>>> >>>>> Nice, really good news on the INFRA front!
>>>> >>>>> I think the hardware specs sound reasonable. And a periodic
>>>> backup of
>>>> >>>>> the website's database to Infra's backup solution sounds
>>>> reasonable too.
>>>> >>>>>
>>>> >>>>> Can you accept and review my proposal for the website?
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>>>> >>>>> wrote:
>>>> >>>>>
>>>> >>>>>> >
>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>> would be
>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>> That is awesome!
>>>> >>>>>>
>>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
>>>> >>>>>> looks that
>>>> >>>>>> Apache infra team could provide a decent VM. The last piece is
>>>> how to
>>>> >>>>>> ensure the data is persisted so we won't lose the project info /
>>>> user
>>>> >>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>>> >>>>>> persistent storage for DB backup, we can always ask for multiple
>>>> VMs
>>>> >>>>>> and do
>>>> >>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>> >>>>>> hardware
>>>> >>>>>> side is also ready.
>>>> >>>>>>
>>>> >>>>>> Thanks,
>>>> >>>>>>
>>>> >>>>>> Jiangjie (Becket) Qin
>>>> >>>>>>
>>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>> >>>>>>
>>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>>>>> wrote:
>>>> >>>>>>
>>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>>> >>>>>> > When I first saw the Ember repository, I thought it is the
>>>> whole
>>>> >>>>>> thing
>>>> >>>>>> > (frontend and backend), but while testing it, I realized it is
>>>> >>>>>> "only" the
>>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>>> >>>>>> observer
>>>> >>>>>> > client, or just write a simple UI from scratch.
>>>> >>>>>> > I have a very capable and motivated frontend developer who
>>>> would be
>>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be
>>>> eager
>>>> >>>>>> to help
>>>> >>>>>> > with this project for the backend:
>>>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>> >>>>>> >
>>>> >>>>>> > For Infra: I made the same experience when asking for more
>>>> GitHub
>>>> >>>>>> > permissions for "flinkbot": They didn't respond on their
>>>> mailing
>>>> >>>>>> list, only
>>>> >>>>>> > on Jira.
>>>> >>>>>> >
>>>> >>>>>> >
>>>> >>>>>> >
>>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >>>>>> wrote:
>>>> >>>>>> >
>>>> >>>>>> >> Thanks for writing up the specifications.
>>>> >>>>>> >>
>>>> >>>>>> >> Regarding the website source code, Austin found a website[1]
>>>> whose
>>>> >>>>>> >> frontend code[2] is available publicly. It lacks some support
>>>> (e.g
>>>> >>>>>> login),
>>>> >>>>>> >> but it is still a good starting point. One thing is that I
>>>> did not
>>>> >>>>>> find a
>>>> >>>>>> >> License statement for that source code. I'll reach out to the
>>>> >>>>>> author to see
>>>> >>>>>> >> if they have any concern over our usage.
>>>> >>>>>> >>
>>>> >>>>>> >> Apache Infra has not replied to my email regarding some
>>>> details
>>>> >>>>>> about the
>>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still
>>>> no
>>>> >>>>>> response.
>>>> >>>>>> >>
>>>> >>>>>> >> Thanks,
>>>> >>>>>> >>
>>>> >>>>>> >> Jiangjie (Becket) Qin
>>>> >>>>>> >>
>>>> >>>>>> >> [1] https://emberobserver.com/
>>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>>> >>>>>> >>
>>>> >>>>>> >>
>>>> >>>>>> >>
>>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>> >>>>>> rmetzger@apache.org>
>>>> >>>>>> >> wrote:
>>>> >>>>>> >>
>>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on
>>>> their
>>>> >>>>>> company
>>>> >>>>>> >>> website. I guess the likelihood that they give out code from
>>>> >>>>>> their company
>>>> >>>>>> >>> website is fairly low.
>>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which
>>>> we'll
>>>> >>>>>> >>> reactivate as part of this PR:
>>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>> >>>>>> >>>
>>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>>> >>>>>> >>> I will propose a short specification in Becket's initial
>>>> document.
>>>> >>>>>> >>>
>>>> >>>>>> >>>
>>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>>> Niels@basjes.nl>
>>>> >>>>>> wrote:
>>>> >>>>>> >>>
>>>> >>>>>> >>>> Hi,
>>>> >>>>>> >>>>
>>>> >>>>>> >>>> The Beam project has something in this area that is simply
>>>> a page
>>>> >>>>>> >>>> within their documentation website:
>>>> >>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>> >>>>>> >>>>
>>>> >>>>>> >>>> Niels Basjes
>>>> >>>>>> >>>>
>>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>>> bowenli86@gmail.com>
>>>> >>>>>> wrote:
>>>> >>>>>> >>>> >
>>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
>>>> kind. I
>>>> >>>>>> >>>> personally like it over the spark site. May worth checking
>>>> it
>>>> >>>>>> out with
>>>> >>>>>> >>>> Kafka folks
>>>> >>>>>> >>>> >
>>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>> >>>>>> becket.qin@gmail.com>
>>>> >>>>>> >>>> wrote:
>>>> >>>>>> >>>> >>
>>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>>>> >>>>>> update the
>>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>>> >>>>>> >>>> >>
>>>> >>>>>> >>>> >> Thanks,
>>>> >>>>>> >>>> >>
>>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>>> >>>>>> >>>> >>
>>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>> >>>>>> rmetzger@apache.org>
>>>> >>>>>> >>>> wrote:
>>>> >>>>>> >>>> >>
>>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see
>>>> if
>>>> >>>>>> they are
>>>> >>>>>> >>>> willing
>>>> >>>>>> >>>> >> > to share.
>>>> >>>>>> >>>> >> >
>>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>>> >>>>>> (maybe sync
>>>> >>>>>> >>>> with
>>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>>> >>>>>> >>>> >> >
>>>> >>>>>>
>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>> >>>>>> >>>> and
>>>> >>>>>> >>>> >> > link it in the navigation?
>>>> >>>>>> >>>> >> >
>>>> >>>>>> >>>> >> > Best,
>>>> >>>>>> >>>> >> > Robert
>>>> >>>>>> >>>> >> >
>>>> >>>>>> >>>> >> >
>>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>> >>>>>> becket.qin@gmail.com>
>>>> >>>>>> >>>> wrote:
>>>> >>>>>> >>>> >> >
>>>> >>>>>> >>>> >> >> Hi Robert,
>>>> >>>>>> >>>> >> >>
>>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>>> spark-packages.org
>>>> >>>>>> owners
>>>> >>>>>> >>>> are
>>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>>> >>>>>> requirement
>>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>> >>>>>> >>>> >> >>
>>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will
>>>> need
>>>> >>>>>> it to
>>>> >>>>>> >>>> redirect
>>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do
>>>> that
>>>> >>>>>> while
>>>> >>>>>> >>>> working on
>>>> >>>>>> >>>> >> >> the dynamic website?
>>>> >>>>>> >>>> >> >>
>>>> >>>>>> >>>> >> >> Thanks,
>>>> >>>>>> >>>> >> >>
>>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>> >>>>>> >>>> >> >>
>>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>>> uce@apache.org
>>>> >>>>>> >
>>>> >>>>>> >>>> wrote:
>>>> >>>>>> >>>> >> >>
>>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site
>>>> first.
>>>> >>>>>> We
>>>> >>>>>> >>>> could then
>>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>>> course,
>>>> >>>>>> if we
>>>> >>>>>> >>>> have the
>>>> >>>>>> >>>> >> >>> resources in the community to quickly start with a
>>>> >>>>>> dynamic site,
>>>> >>>>>> >>>> I'm
>>>> >>>>>> >>>> >> >>> not apposed.
>>>> >>>>>> >>>> >> >>>
>>>> >>>>>> >>>> >> >>> – Ufuk
>>>> >>>>>> >>>> >> >>>
>>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>> >>>>>> >>>> rmetzger@apache.org>
>>>> >>>>>> >>>> >> >>> wrote:
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this
>>>> Becket! The
>>>> >>>>>> VMs
>>>> >>>>>> >>>> hosted by
>>>> >>>>>> >>>> >> >>> Infra
>>>> >>>>>> >>>> >> >>> > look suitable.
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static
>>>> page. It
>>>> >>>>>> used to
>>>> >>>>>> >>>> be
>>>> >>>>>> >>>> >> >>> linked,
>>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for
>>>> some
>>>> >>>>>> reason.
>>>> >>>>>> >>>> This is
>>>> >>>>>> >>>> >> >>> the
>>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>> >>>>>> navigation bar
>>>> >>>>>> >>>> for the
>>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page
>>>> right
>>>> >>>>>> away.
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you
>>>> feel
>>>> >>>>>> about
>>>> >>>>>> >>>> sending the
>>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if
>>>> they are
>>>> >>>>>> >>>> interested in
>>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>>>> together
>>>> >>>>>> in a
>>>> >>>>>> >>>> public
>>>> >>>>>> >>>> >> >>> repo.
>>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we
>>>> decide not
>>>> >>>>>> to ask
>>>> >>>>>> >>>> in the
>>>> >>>>>> >>>> >> >>> first
>>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short description
>>>> of
>>>> >>>>>> the
>>>> >>>>>> >>>> requirements,
>>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>> >>>>>> somebody here
>>>> >>>>>> >>>> in the
>>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>>> contribute,
>>>> >>>>>> I
>>>> >>>>>> >>>> believe we
>>>> >>>>>> >>>> >> >>> will
>>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>> >>>>>> >>>> >> >>> wrote:
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>> >>>>>> >>>> >> >>> > >
>>>> >>>>>> >>>> >> >>> > > [1]
>>>> https://www.apache.org/dev/services.html#blogs
>>>> >>>>>> (Apache
>>>> >>>>>> >>>> infra
>>>> >>>>>> >>>> >> >>> services)
>>>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>>> >>>>>> (FreeBSD Jail
>>>> >>>>>> >>>> provided
>>>> >>>>>> >>>> >> >>> by
>>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>>> >>>>>> >>>> >> >>> > >
>>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>> >>>>>> >>>> >> >>> wrote:
>>>> >>>>>> >>>> >> >>> > >
>>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>>> >>>>>> >>>> >> >>> > >>
>>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points.
>>>> We
>>>> >>>>>> should
>>>> >>>>>> >>>> absolutely
>>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>> >>>>>> interactions in
>>>> >>>>>> >>>> the
>>>> >>>>>> >>>> >> >>> community.
>>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>>> solution
>>>> >>>>>> would
>>>> >>>>>> >>>> be great.
>>>> >>>>>> >>>> >> >>> TBH,
>>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>>>> website.
>>>> >>>>>> It'll
>>>> >>>>>> >>>> be great
>>>> >>>>>> >>>> >> >>> if
>>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache
>>>> Infra
>>>> >>>>>> provides
>>>> >>>>>> >>>> a few
>>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage.
>>>> I did
>>>> >>>>>> not see
>>>> >>>>>> >>>> >> >>> database
>>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db
>>>> in
>>>> >>>>>> FreeBSD
>>>> >>>>>> >>>> jail[2].
>>>> >>>>>> >>>> >> >>> > >>
>>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>> >>>>>> >>>> >> >>> > >>
>>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>>> reasonable to
>>>> >>>>>> me. We
>>>> >>>>>> >>>> >> >>> probably need
>>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even
>>>> just
>>>> >>>>>> >>>> provide links
>>>> >>>>>> >>>> >> >>> it to
>>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the
>>>> connectors in
>>>> >>>>>> that
>>>> >>>>>> >>>> static
>>>> >>>>>> >>>> >> >>> page seems
>>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>>> working
>>>> >>>>>> on the
>>>> >>>>>> >>>> dynamic
>>>> >>>>>> >>>> >> >>> pages.
>>>> >>>>>> >>>> >> >>> > >>
>>>> >>>>>> >>>> >> >>> > >> Thanks,
>>>> >>>>>> >>>> >> >>> > >>
>>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>> >>>>>> >>>> >> >>> > >>
>>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>>> >>>>>> >>>> >> >>> > >> wrote:
>>>> >>>>>> >>>> >> >>> > >>
>>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>> >>>>>> >>>> >> >>> > >>>
>>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with
>>>> Flink
>>>> >>>>>> >>>> connectors at
>>>> >>>>>> >>>> >> >>> the
>>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static
>>>> page,
>>>> >>>>>> and
>>>> >>>>>> >>>> upgrade it
>>>> >>>>>> >>>> >> >>> when we
>>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with
>>>> rich
>>>> >>>>>> functions.
>>>> >>>>>> >>>> >> >>> > >>>
>>>> >>>>>> >>>> >> >>> > >>> Regards,
>>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>>> >>>>>> >>>> >> >>> > >>>
>>>> >>>>>> >>>> >> >>> > >>>
>>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>> >>>>>> >>>> rmetzger@apache.org
>>>> >>>>>> >>>> >> >>> >
>>>> >>>>>> >>>> >> >>> > >>> wrote:
>>>> >>>>>> >>>> >> >>> > >>>
>>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make
>>>> sure
>>>> >>>>>> the page
>>>> >>>>>> >>>> is placed
>>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>> >>>>>> something will
>>>> >>>>>> >>>> get
>>>> >>>>>> >>>> >> >>> attention for
>>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>>> better,
>>>> >>>>>> if we
>>>> >>>>>> >>>> want
>>>> >>>>>> >>>> >> >>> features
>>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>>> >>>>>> infra, and
>>>> >>>>>> >>>> endorsed
>>>> >>>>>> >>>> >> >>> by
>>>> >>>>>> >>>> >> >>> > >>>> the community.
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software
>>>> that
>>>> >>>>>> we
>>>> >>>>>> >>>> could use?
>>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>>>> >>>>>> Linux. The
>>>> >>>>>> >>>> source
>>>> >>>>>> >>>> >> >>> code of this
>>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>> >>>>>> structure is
>>>> >>>>>> >>>> not an
>>>> >>>>>> >>>> >> >>> ideal fit for
>>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>> > >>>> Best,
>>>> >>>>>> >>>> >> >>> > >>>> Robert
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>> >>>>>> >>>> becket.qin@gmail.com>
>>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>> >>>>>> >>>> >> >>> > >>>>>
>>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread
>>>> about
>>>> >>>>>> creating
>>>> >>>>>> >>>> a Flink
>>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>> >>>>>> contributors
>>>> >>>>>> >>>> who
>>>> >>>>>> >>>> >> >>> have developed
>>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with
>>>> the
>>>> >>>>>> >>>> community.
>>>> >>>>>> >>>> >> >>> > >>>>>
>>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more
>>>> details.
>>>> >>>>>> >>>> >> >>> > >>>>>
>>>> >>>>>> >>>> >> >>> > >>>>>
>>>> >>>>>> >>>> >> >>>
>>>> >>>>>> >>>>
>>>> >>>>>>
>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>> >>>>>> >>>> >> >>> > >>>>>
>>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>>> >>>>>> >>>> >> >>> > >>>>>
>>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>> >>>>>> >>>> >> >>> > >>>>>
>>>> >>>>>> >>>> >> >>> > >>>>
>>>> >>>>>> >>>> >> >>>
>>>> >>>>>> >>>> >> >>
>>>> >>>>>> >>>>
>>>> >>>>>> >>>>
>>>> >>>>>> >>>>
>>>> >>>>>> >>>> --
>>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>> >>>>>> >>>>
>>>> >>>>>> >>>> Niels Basjes
>>>> >>>>>> >>>>
>>>> >>>>>> >>>
>>>> >>>>>>
>>>> >>>>>
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Daryl Roberts <da...@ververica.com>]

Hello all,

We have deployed the first version of the UI prototype to the following
URL: https://flink-ecosystem-demo.flink-resources.org/#/packages

It has some very basic functionality:
* list packages
* list packages by 'category'
* show a single package
* search that will take you to a search page

The data is all fake, and generated new every time, so even if you click on
a package name, and the URL says one thing, the package data itself will be
different (and change every time you refresh).

[image: Screenshot_2019-04-12_14_44_19.png]

None of this is final, but we thought it would be a good idea for you all
to see what we have so far.

If you have any feedback, please let us know.

Thanks,
-daryl

On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:

> Thank you, all! If there are operational tasks about the ecosystem
> page(s), let me know (organizing the content etc, whatever).
>
> ---
> Oytun Tez
>
> *M O T A W O R D*
> The World's Fastest Human Translation Platform.
> oytun@motaword.com — www.motaword.com
>
>
> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com> wrote:
>
>> Thanks for the update Robert! Looking forward to the prototype!
>>
>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Quick summary of our call:
>>> Daryl will soon start with a front end, build against a very simple
>>> mock-backend.
>>> Congxian will start implementing the Spring-based backend early April.
>>>
>>> As soon as the first prototype of the UI is ready, we'll share it here
>>> for
>>> feedback.
>>>
>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>> > Okay, great.
>>> >
>>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET,
>>> 9pm
>>> > China time about the design of the ecosystem page (see:
>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>> > Please let me know if others want to join as well, I can add them to
>>> the
>>> > invite.
>>> >
>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >
>>> >> I agree. We can start with english-only and see how it goes. The
>>> comments
>>> >> and descriptions can always be multi-lingual but that is up to the
>>> package
>>> >> owners.
>>> >>
>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
>>> >> wrote:
>>> >>
>>> >>> Thanks.
>>> >>>
>>> >>> Do we actually want this page to be multi-language?
>>> >>>
>>> >>> I propose to make the website english-only, but maybe consider
>>> allowing
>>> >>> comments in different languages.
>>> >>> If we would make it multi-language, then we might have problems with
>>> >>> people submitting packages in non-english languages.
>>> >>>
>>> >>>
>>> >>>
>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >>>
>>> >>>> Done. The writeup looks great!
>>> >>>>
>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rmetzger@apache.org
>>> >
>>> >>>> wrote:
>>> >>>>
>>> >>>>> Nice, really good news on the INFRA front!
>>> >>>>> I think the hardware specs sound reasonable. And a periodic backup
>>> of
>>> >>>>> the website's database to Infra's backup solution sounds
>>> reasonable too.
>>> >>>>>
>>> >>>>> Can you accept and review my proposal for the website?
>>> >>>>>
>>> >>>>>
>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>>> >>>>> wrote:
>>> >>>>>
>>> >>>>>> >
>>> >>>>>> > I have a very capable and motivated frontend developer who
>>> would be
>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>> >>>>>>
>>> >>>>>>
>>> >>>>>> That is awesome!
>>> >>>>>>
>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
>>> >>>>>> looks that
>>> >>>>>> Apache infra team could provide a decent VM. The last piece is
>>> how to
>>> >>>>>> ensure the data is persisted so we won't lose the project info /
>>> user
>>> >>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>> >>>>>> persistent storage for DB backup, we can always ask for multiple
>>> VMs
>>> >>>>>> and do
>>> >>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>> >>>>>> hardware
>>> >>>>>> side is also ready.
>>> >>>>>>
>>> >>>>>> Thanks,
>>> >>>>>>
>>> >>>>>> Jiangjie (Becket) Qin
>>> >>>>>>
>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>> >>>>>>
>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>> rmetzger@apache.org>
>>> >>>>>> wrote:
>>> >>>>>>
>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>> >>>>>> > When I first saw the Ember repository, I thought it is the whole
>>> >>>>>> thing
>>> >>>>>> > (frontend and backend), but while testing it, I realized it is
>>> >>>>>> "only" the
>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>> >>>>>> observer
>>> >>>>>> > client, or just write a simple UI from scratch.
>>> >>>>>> > I have a very capable and motivated frontend developer who
>>> would be
>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be
>>> eager
>>> >>>>>> to help
>>> >>>>>> > with this project for the backend:
>>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>> >>>>>> >
>>> >>>>>> > For Infra: I made the same experience when asking for more
>>> GitHub
>>> >>>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>> >>>>>> list, only
>>> >>>>>> > on Jira.
>>> >>>>>> >
>>> >>>>>> >
>>> >>>>>> >
>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>> becket.qin@gmail.com>
>>> >>>>>> wrote:
>>> >>>>>> >
>>> >>>>>> >> Thanks for writing up the specifications.
>>> >>>>>> >>
>>> >>>>>> >> Regarding the website source code, Austin found a website[1]
>>> whose
>>> >>>>>> >> frontend code[2] is available publicly. It lacks some support
>>> (e.g
>>> >>>>>> login),
>>> >>>>>> >> but it is still a good starting point. One thing is that I did
>>> not
>>> >>>>>> find a
>>> >>>>>> >> License statement for that source code. I'll reach out to the
>>> >>>>>> author to see
>>> >>>>>> >> if they have any concern over our usage.
>>> >>>>>> >>
>>> >>>>>> >> Apache Infra has not replied to my email regarding some details
>>> >>>>>> about the
>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still
>>> no
>>> >>>>>> response.
>>> >>>>>> >>
>>> >>>>>> >> Thanks,
>>> >>>>>> >>
>>> >>>>>> >> Jiangjie (Becket) Qin
>>> >>>>>> >>
>>> >>>>>> >> [1] https://emberobserver.com/
>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>> >>>>>> >>
>>> >>>>>> >>
>>> >>>>>> >>
>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>> >>>>>> rmetzger@apache.org>
>>> >>>>>> >> wrote:
>>> >>>>>> >>
>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>> >>>>>> company
>>> >>>>>> >>> website. I guess the likelihood that they give out code from
>>> >>>>>> their company
>>> >>>>>> >>> website is fairly low.
>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which
>>> we'll
>>> >>>>>> >>> reactivate as part of this PR:
>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>> >>>>>> >>>
>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>> >>>>>> >>> I will propose a short specification in Becket's initial
>>> document.
>>> >>>>>> >>>
>>> >>>>>> >>>
>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>> Niels@basjes.nl>
>>> >>>>>> wrote:
>>> >>>>>> >>>
>>> >>>>>> >>>> Hi,
>>> >>>>>> >>>>
>>> >>>>>> >>>> The Beam project has something in this area that is simply a
>>> page
>>> >>>>>> >>>> within their documentation website:
>>> >>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>> >>>>>> >>>>
>>> >>>>>> >>>> Niels Basjes
>>> >>>>>> >>>>
>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>> bowenli86@gmail.com>
>>> >>>>>> wrote:
>>> >>>>>> >>>> >
>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
>>> kind. I
>>> >>>>>> >>>> personally like it over the spark site. May worth checking it
>>> >>>>>> out with
>>> >>>>>> >>>> Kafka folks
>>> >>>>>> >>>> >
>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>> >>>>>> becket.qin@gmail.com>
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>>> >>>>>> update the
>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> Thanks,
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>> >>>>>> rmetzger@apache.org>
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
>>> >>>>>> they are
>>> >>>>>> >>>> willing
>>> >>>>>> >>>> >> > to share.
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>> >>>>>> (maybe sync
>>> >>>>>> >>>> with
>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>> >>>>>> >>>> >> >
>>> >>>>>>
>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>> >>>>>> >>>> and
>>> >>>>>> >>>> >> > link it in the navigation?
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> > Best,
>>> >>>>>> >>>> >> > Robert
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>> >>>>>> becket.qin@gmail.com>
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> >> Hi Robert,
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>> spark-packages.org
>>> >>>>>> owners
>>> >>>>>> >>>> are
>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>> >>>>>> requirement
>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will
>>> need
>>> >>>>>> it to
>>> >>>>>> >>>> redirect
>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
>>> >>>>>> while
>>> >>>>>> >>>> working on
>>> >>>>>> >>>> >> >> the dynamic website?
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> Thanks,
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>> uce@apache.org
>>> >>>>>> >
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site
>>> first.
>>> >>>>>> We
>>> >>>>>> >>>> could then
>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>> course,
>>> >>>>>> if we
>>> >>>>>> >>>> have the
>>> >>>>>> >>>> >> >>> resources in the community to quickly start with a
>>> >>>>>> dynamic site,
>>> >>>>>> >>>> I'm
>>> >>>>>> >>>> >> >>> not apposed.
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>> >> >>> – Ufuk
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>> >>>>>> >>>> rmetzger@apache.org>
>>> >>>>>> >>>> >> >>> wrote:
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket!
>>> The
>>> >>>>>> VMs
>>> >>>>>> >>>> hosted by
>>> >>>>>> >>>> >> >>> Infra
>>> >>>>>> >>>> >> >>> > look suitable.
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page.
>>> It
>>> >>>>>> used to
>>> >>>>>> >>>> be
>>> >>>>>> >>>> >> >>> linked,
>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for
>>> some
>>> >>>>>> reason.
>>> >>>>>> >>>> This is
>>> >>>>>> >>>> >> >>> the
>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>>> >>>>>> navigation bar
>>> >>>>>> >>>> for the
>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page
>>> right
>>> >>>>>> away.
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
>>> >>>>>> about
>>> >>>>>> >>>> sending the
>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they
>>> are
>>> >>>>>> >>>> interested in
>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>>> together
>>> >>>>>> in a
>>> >>>>>> >>>> public
>>> >>>>>> >>>> >> >>> repo.
>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide
>>> not
>>> >>>>>> to ask
>>> >>>>>> >>>> in the
>>> >>>>>> >>>> >> >>> first
>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short description
>>> of
>>> >>>>>> the
>>> >>>>>> >>>> requirements,
>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>> >>>>>> somebody here
>>> >>>>>> >>>> in the
>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>> contribute,
>>> >>>>>> I
>>> >>>>>> >>>> believe we
>>> >>>>>> >>>> >> >>> will
>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>> >>>>>> >>>> becket.qin@gmail.com>
>>> >>>>>> >>>> >> >>> wrote:
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>> >>>>>> >>>> >> >>> > >
>>> >>>>>> >>>> >> >>> > > [1]
>>> https://www.apache.org/dev/services.html#blogs
>>> >>>>>> (Apache
>>> >>>>>> >>>> infra
>>> >>>>>> >>>> >> >>> services)
>>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>> >>>>>> (FreeBSD Jail
>>> >>>>>> >>>> provided
>>> >>>>>> >>>> >> >>> by
>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>> >>>>>> >>>> >> >>> > >
>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>> >>>>>> >>>> becket.qin@gmail.com>
>>> >>>>>> >>>> >> >>> wrote:
>>> >>>>>> >>>> >> >>> > >
>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points.
>>> We
>>> >>>>>> should
>>> >>>>>> >>>> absolutely
>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>> >>>>>> interactions in
>>> >>>>>> >>>> the
>>> >>>>>> >>>> >> >>> community.
>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>> solution
>>> >>>>>> would
>>> >>>>>> >>>> be great.
>>> >>>>>> >>>> >> >>> TBH,
>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>>> website.
>>> >>>>>> It'll
>>> >>>>>> >>>> be great
>>> >>>>>> >>>> >> >>> if
>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>> >>>>>> provides
>>> >>>>>> >>>> a few
>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I
>>> did
>>> >>>>>> not see
>>> >>>>>> >>>> >> >>> database
>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db
>>> in
>>> >>>>>> FreeBSD
>>> >>>>>> >>>> jail[2].
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>> reasonable to
>>> >>>>>> me. We
>>> >>>>>> >>>> >> >>> probably need
>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even
>>> just
>>> >>>>>> >>>> provide links
>>> >>>>>> >>>> >> >>> it to
>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors
>>> in
>>> >>>>>> that
>>> >>>>>> >>>> static
>>> >>>>>> >>>> >> >>> page seems
>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>> working
>>> >>>>>> on the
>>> >>>>>> >>>> dynamic
>>> >>>>>> >>>> >> >>> pages.
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> Thanks,
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>> >>>>>> >>>> >> >>> > >> wrote:
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with
>>> Flink
>>> >>>>>> >>>> connectors at
>>> >>>>>> >>>> >> >>> the
>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static
>>> page,
>>> >>>>>> and
>>> >>>>>> >>>> upgrade it
>>> >>>>>> >>>> >> >>> when we
>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>> >>>>>> functions.
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>> Regards,
>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>> >>>>>> >>>> rmetzger@apache.org
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > >>> wrote:
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure
>>> >>>>>> the page
>>> >>>>>> >>>> is placed
>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>> >>>>>> something will
>>> >>>>>> >>>> get
>>> >>>>>> >>>> >> >>> attention for
>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>> better,
>>> >>>>>> if we
>>> >>>>>> >>>> want
>>> >>>>>> >>>> >> >>> features
>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>> >>>>>> infra, and
>>> >>>>>> >>>> endorsed
>>> >>>>>> >>>> >> >>> by
>>> >>>>>> >>>> >> >>> > >>>> the community.
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software
>>> that
>>> >>>>>> we
>>> >>>>>> >>>> could use?
>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>>> >>>>>> Linux. The
>>> >>>>>> >>>> source
>>> >>>>>> >>>> >> >>> code of this
>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>> >>>>>> structure is
>>> >>>>>> >>>> not an
>>> >>>>>> >>>> >> >>> ideal fit for
>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> Best,
>>> >>>>>> >>>> >> >>> > >>>> Robert
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>> >>>>>> >>>> becket.qin@gmail.com>
>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread
>>> about
>>> >>>>>> creating
>>> >>>>>> >>>> a Flink
>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>> >>>>>> contributors
>>> >>>>>> >>>> who
>>> >>>>>> >>>> >> >>> have developed
>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with
>>> the
>>> >>>>>> >>>> community.
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>>
>>> >>>>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>>
>>> >>>>>> >>>>
>>> >>>>>> >>>>
>>> >>>>>> >>>> --
>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>> >>>>>> >>>>
>>> >>>>>> >>>> Niels Basjes
>>> >>>>>> >>>>
>>> >>>>>> >>>
>>> >>>>>>
>>> >>>>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Daryl Roberts <da...@ververica.com>]

Hello all,

We have deployed the first version of the UI prototype to the following
URL: https://flink-ecosystem-demo.flink-resources.org/#/packages

It has some very basic functionality:
* list packages
* list packages by 'category'
* show a single package
* search that will take you to a search page

The data is all fake, and generated new every time, so even if you click on
a package name, and the URL says one thing, the package data itself will be
different (and change every time you refresh).

[image: Screenshot_2019-04-12_14_44_19.png]

None of this is final, but we thought it would be a good idea for you all
to see what we have so far.

If you have any feedback, please let us know.

Thanks,
-daryl

On Thu, Mar 21, 2019 at 7:18 PM Oytun Tez <oy...@motaword.com> wrote:

> Thank you, all! If there are operational tasks about the ecosystem
> page(s), let me know (organizing the content etc, whatever).
>
> ---
> Oytun Tez
>
> *M O T A W O R D*
> The World's Fastest Human Translation Platform.
> oytun@motaword.com — www.motaword.com
>
>
> On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com> wrote:
>
>> Thanks for the update Robert! Looking forward to the prototype!
>>
>> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Quick summary of our call:
>>> Daryl will soon start with a front end, build against a very simple
>>> mock-backend.
>>> Congxian will start implementing the Spring-based backend early April.
>>>
>>> As soon as the first prototype of the UI is ready, we'll share it here
>>> for
>>> feedback.
>>>
>>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>> > Okay, great.
>>> >
>>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET,
>>> 9pm
>>> > China time about the design of the ecosystem page (see:
>>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>>> > Please let me know if others want to join as well, I can add them to
>>> the
>>> > invite.
>>> >
>>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >
>>> >> I agree. We can start with english-only and see how it goes. The
>>> comments
>>> >> and descriptions can always be multi-lingual but that is up to the
>>> package
>>> >> owners.
>>> >>
>>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
>>> >> wrote:
>>> >>
>>> >>> Thanks.
>>> >>>
>>> >>> Do we actually want this page to be multi-language?
>>> >>>
>>> >>> I propose to make the website english-only, but maybe consider
>>> allowing
>>> >>> comments in different languages.
>>> >>> If we would make it multi-language, then we might have problems with
>>> >>> people submitting packages in non-english languages.
>>> >>>
>>> >>>
>>> >>>
>>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >>>
>>> >>>> Done. The writeup looks great!
>>> >>>>
>>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rmetzger@apache.org
>>> >
>>> >>>> wrote:
>>> >>>>
>>> >>>>> Nice, really good news on the INFRA front!
>>> >>>>> I think the hardware specs sound reasonable. And a periodic backup
>>> of
>>> >>>>> the website's database to Infra's backup solution sounds
>>> reasonable too.
>>> >>>>>
>>> >>>>> Can you accept and review my proposal for the website?
>>> >>>>>
>>> >>>>>
>>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>>> >>>>> wrote:
>>> >>>>>
>>> >>>>>> >
>>> >>>>>> > I have a very capable and motivated frontend developer who
>>> would be
>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>> >>>>>>
>>> >>>>>>
>>> >>>>>> That is awesome!
>>> >>>>>>
>>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
>>> >>>>>> looks that
>>> >>>>>> Apache infra team could provide a decent VM. The last piece is
>>> how to
>>> >>>>>> ensure the data is persisted so we won't lose the project info /
>>> user
>>> >>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>> >>>>>> persistent storage for DB backup, we can always ask for multiple
>>> VMs
>>> >>>>>> and do
>>> >>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>> >>>>>> hardware
>>> >>>>>> side is also ready.
>>> >>>>>>
>>> >>>>>> Thanks,
>>> >>>>>>
>>> >>>>>> Jiangjie (Becket) Qin
>>> >>>>>>
>>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>> >>>>>>
>>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>>> rmetzger@apache.org>
>>> >>>>>> wrote:
>>> >>>>>>
>>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>>> >>>>>> > When I first saw the Ember repository, I thought it is the whole
>>> >>>>>> thing
>>> >>>>>> > (frontend and backend), but while testing it, I realized it is
>>> >>>>>> "only" the
>>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>> >>>>>> observer
>>> >>>>>> > client, or just write a simple UI from scratch.
>>> >>>>>> > I have a very capable and motivated frontend developer who
>>> would be
>>> >>>>>> > willing to implement what I've mocked in my proposal.
>>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be
>>> eager
>>> >>>>>> to help
>>> >>>>>> > with this project for the backend:
>>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>> >>>>>> >
>>> >>>>>> > For Infra: I made the same experience when asking for more
>>> GitHub
>>> >>>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>> >>>>>> list, only
>>> >>>>>> > on Jira.
>>> >>>>>> >
>>> >>>>>> >
>>> >>>>>> >
>>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <
>>> becket.qin@gmail.com>
>>> >>>>>> wrote:
>>> >>>>>> >
>>> >>>>>> >> Thanks for writing up the specifications.
>>> >>>>>> >>
>>> >>>>>> >> Regarding the website source code, Austin found a website[1]
>>> whose
>>> >>>>>> >> frontend code[2] is available publicly. It lacks some support
>>> (e.g
>>> >>>>>> login),
>>> >>>>>> >> but it is still a good starting point. One thing is that I did
>>> not
>>> >>>>>> find a
>>> >>>>>> >> License statement for that source code. I'll reach out to the
>>> >>>>>> author to see
>>> >>>>>> >> if they have any concern over our usage.
>>> >>>>>> >>
>>> >>>>>> >> Apache Infra has not replied to my email regarding some details
>>> >>>>>> about the
>>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still
>>> no
>>> >>>>>> response.
>>> >>>>>> >>
>>> >>>>>> >> Thanks,
>>> >>>>>> >>
>>> >>>>>> >> Jiangjie (Becket) Qin
>>> >>>>>> >>
>>> >>>>>> >> [1] https://emberobserver.com/
>>> >>>>>> >> [2] https://github.com/emberobserver/client
>>> >>>>>> >>
>>> >>>>>> >>
>>> >>>>>> >>
>>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>> >>>>>> rmetzger@apache.org>
>>> >>>>>> >> wrote:
>>> >>>>>> >>
>>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>> >>>>>> company
>>> >>>>>> >>> website. I guess the likelihood that they give out code from
>>> >>>>>> their company
>>> >>>>>> >>> website is fairly low.
>>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which
>>> we'll
>>> >>>>>> >>> reactivate as part of this PR:
>>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>>> >>>>>> >>>
>>> >>>>>> >>> Spark-packages.org did not respond to my request.
>>> >>>>>> >>> I will propose a short specification in Becket's initial
>>> document.
>>> >>>>>> >>>
>>> >>>>>> >>>
>>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <
>>> Niels@basjes.nl>
>>> >>>>>> wrote:
>>> >>>>>> >>>
>>> >>>>>> >>>> Hi,
>>> >>>>>> >>>>
>>> >>>>>> >>>> The Beam project has something in this area that is simply a
>>> page
>>> >>>>>> >>>> within their documentation website:
>>> >>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>> >>>>>> >>>>
>>> >>>>>> >>>> Niels Basjes
>>> >>>>>> >>>>
>>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <
>>> bowenli86@gmail.com>
>>> >>>>>> wrote:
>>> >>>>>> >>>> >
>>> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
>>> kind. I
>>> >>>>>> >>>> personally like it over the spark site. May worth checking it
>>> >>>>>> out with
>>> >>>>>> >>>> Kafka folks
>>> >>>>>> >>>> >
>>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>> >>>>>> becket.qin@gmail.com>
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>>> >>>>>> update the
>>> >>>>>> >>>> >> ecosystem page and the navigation.
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> Thanks,
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>> >>>>>> rmetzger@apache.org>
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >>
>>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
>>> >>>>>> they are
>>> >>>>>> >>>> willing
>>> >>>>>> >>>> >> > to share.
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>> >>>>>> (maybe sync
>>> >>>>>> >>>> with
>>> >>>>>> >>>> >> > the "Software Projects" listed here:
>>> >>>>>> >>>> >> >
>>> >>>>>>
>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>> >>>>>> >>>> and
>>> >>>>>> >>>> >> > link it in the navigation?
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> > Best,
>>> >>>>>> >>>> >> > Robert
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>> >>>>>> becket.qin@gmail.com>
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >> >
>>> >>>>>> >>>> >> >> Hi Robert,
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> I think it at least worths checking if
>>> spark-packages.org
>>> >>>>>> owners
>>> >>>>>> >>>> are
>>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>> >>>>>> requirement
>>> >>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will
>>> need
>>> >>>>>> it to
>>> >>>>>> >>>> redirect
>>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
>>> >>>>>> while
>>> >>>>>> >>>> working on
>>> >>>>>> >>>> >> >> the dynamic website?
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> Thanks,
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>>> uce@apache.org
>>> >>>>>> >
>>> >>>>>> >>>> wrote:
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site
>>> first.
>>> >>>>>> We
>>> >>>>>> >>>> could then
>>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of
>>> course,
>>> >>>>>> if we
>>> >>>>>> >>>> have the
>>> >>>>>> >>>> >> >>> resources in the community to quickly start with a
>>> >>>>>> dynamic site,
>>> >>>>>> >>>> I'm
>>> >>>>>> >>>> >> >>> not apposed.
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>> >> >>> – Ufuk
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>> >>>>>> >>>> rmetzger@apache.org>
>>> >>>>>> >>>> >> >>> wrote:
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket!
>>> The
>>> >>>>>> VMs
>>> >>>>>> >>>> hosted by
>>> >>>>>> >>>> >> >>> Infra
>>> >>>>>> >>>> >> >>> > look suitable.
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page.
>>> It
>>> >>>>>> used to
>>> >>>>>> >>>> be
>>> >>>>>> >>>> >> >>> linked,
>>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for
>>> some
>>> >>>>>> reason.
>>> >>>>>> >>>> This is
>>> >>>>>> >>>> >> >>> the
>>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>>> >>>>>> navigation bar
>>> >>>>>> >>>> for the
>>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page
>>> right
>>> >>>>>> away.
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
>>> >>>>>> about
>>> >>>>>> >>>> sending the
>>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they
>>> are
>>> >>>>>> >>>> interested in
>>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>>> together
>>> >>>>>> in a
>>> >>>>>> >>>> public
>>> >>>>>> >>>> >> >>> repo.
>>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide
>>> not
>>> >>>>>> to ask
>>> >>>>>> >>>> in the
>>> >>>>>> >>>> >> >>> first
>>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short description
>>> of
>>> >>>>>> the
>>> >>>>>> >>>> requirements,
>>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>> >>>>>> somebody here
>>> >>>>>> >>>> in the
>>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>>> contribute,
>>> >>>>>> I
>>> >>>>>> >>>> believe we
>>> >>>>>> >>>> >> >>> will
>>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>> >>>>>> >>>> becket.qin@gmail.com>
>>> >>>>>> >>>> >> >>> wrote:
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>>> >>>>>> >>>> >> >>> > >
>>> >>>>>> >>>> >> >>> > > [1]
>>> https://www.apache.org/dev/services.html#blogs
>>> >>>>>> (Apache
>>> >>>>>> >>>> infra
>>> >>>>>> >>>> >> >>> services)
>>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>> >>>>>> (FreeBSD Jail
>>> >>>>>> >>>> provided
>>> >>>>>> >>>> >> >>> by
>>> >>>>>> >>>> >> >>> > > Apache Infra)
>>> >>>>>> >>>> >> >>> > >
>>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>> >>>>>> >>>> becket.qin@gmail.com>
>>> >>>>>> >>>> >> >>> wrote:
>>> >>>>>> >>>> >> >>> > >
>>> >>>>>> >>>> >> >>> > >> Hi Robert,
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points.
>>> We
>>> >>>>>> should
>>> >>>>>> >>>> absolutely
>>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>> >>>>>> interactions in
>>> >>>>>> >>>> the
>>> >>>>>> >>>> >> >>> community.
>>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>>> solution
>>> >>>>>> would
>>> >>>>>> >>>> be great.
>>> >>>>>> >>>> >> >>> TBH,
>>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>>> website.
>>> >>>>>> It'll
>>> >>>>>> >>>> be great
>>> >>>>>> >>>> >> >>> if
>>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>> >>>>>> provides
>>> >>>>>> >>>> a few
>>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I
>>> did
>>> >>>>>> not see
>>> >>>>>> >>>> >> >>> database
>>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db
>>> in
>>> >>>>>> FreeBSD
>>> >>>>>> >>>> jail[2].
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds
>>> reasonable to
>>> >>>>>> me. We
>>> >>>>>> >>>> >> >>> probably need
>>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even
>>> just
>>> >>>>>> >>>> provide links
>>> >>>>>> >>>> >> >>> it to
>>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors
>>> in
>>> >>>>>> that
>>> >>>>>> >>>> static
>>> >>>>>> >>>> >> >>> page seems
>>> >>>>>> >>>> >> >>> > >> something we could start with while we are
>>> working
>>> >>>>>> on the
>>> >>>>>> >>>> dynamic
>>> >>>>>> >>>> >> >>> pages.
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> Thanks,
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>> >>>>>> >>>> wshaoxuan@gmail.com>
>>> >>>>>> >>>> >> >>> > >> wrote:
>>> >>>>>> >>>> >> >>> > >>
>>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with
>>> Flink
>>> >>>>>> >>>> connectors at
>>> >>>>>> >>>> >> >>> the
>>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static
>>> page,
>>> >>>>>> and
>>> >>>>>> >>>> upgrade it
>>> >>>>>> >>>> >> >>> when we
>>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>> >>>>>> functions.
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>> Regards,
>>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>> >>>>>> >>>> rmetzger@apache.org
>>> >>>>>> >>>> >> >>> >
>>> >>>>>> >>>> >> >>> > >>> wrote:
>>> >>>>>> >>>> >> >>> > >>>
>>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure
>>> >>>>>> the page
>>> >>>>>> >>>> is placed
>>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>> >>>>>> something will
>>> >>>>>> >>>> get
>>> >>>>>> >>>> >> >>> attention for
>>> >>>>>> >>>> >> >>> > >>>> their contributions.
>>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be
>>> better,
>>> >>>>>> if we
>>> >>>>>> >>>> want
>>> >>>>>> >>>> >> >>> features
>>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>> >>>>>> infra, and
>>> >>>>>> >>>> endorsed
>>> >>>>>> >>>> >> >>> by
>>> >>>>>> >>>> >> >>> > >>>> the community.
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software
>>> that
>>> >>>>>> we
>>> >>>>>> >>>> could use?
>>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>>> >>>>>> Linux. The
>>> >>>>>> >>>> source
>>> >>>>>> >>>> >> >>> code of this
>>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>> >>>>>> structure is
>>> >>>>>> >>>> not an
>>> >>>>>> >>>> >> >>> ideal fit for
>>> >>>>>> >>>> >> >>> > >>>> our requirements)
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> Best,
>>> >>>>>> >>>> >> >>> > >>>> Robert
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>> >>>>>> >>>> becket.qin@gmail.com>
>>> >>>>>> >>>> >> >>> > >>>> wrote:
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread
>>> about
>>> >>>>>> creating
>>> >>>>>> >>>> a Flink
>>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>> >>>>>> contributors
>>> >>>>>> >>>> who
>>> >>>>>> >>>> >> >>> have developed
>>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with
>>> the
>>> >>>>>> >>>> community.
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>>
>>> >>>>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>> >>>>>> >>>> >> >>> > >>>>>
>>> >>>>>> >>>> >> >>> > >>>>
>>> >>>>>> >>>> >> >>>
>>> >>>>>> >>>> >> >>
>>> >>>>>> >>>>
>>> >>>>>> >>>>
>>> >>>>>> >>>>
>>> >>>>>> >>>> --
>>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>>> >>>>>> >>>>
>>> >>>>>> >>>> Niels Basjes
>>> >>>>>> >>>>
>>> >>>>>> >>>
>>> >>>>>>
>>> >>>>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Oytun Tez <oy...@motaword.com>]

Thank you, all! If there are operational tasks about the ecosystem page(s),
let me know (organizing the content etc, whatever).

---
Oytun Tez

*M O T A W O R D*
The World's Fastest Human Translation Platform.
oytun@motaword.com — www.motaword.com


On Thu, Mar 21, 2019 at 2:14 PM Becket Qin <be...@gmail.com> wrote:

> Thanks for the update Robert! Looking forward to the prototype!
>
> On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Quick summary of our call:
>> Daryl will soon start with a front end, build against a very simple
>> mock-backend.
>> Congxian will start implementing the Spring-based backend early April.
>>
>> As soon as the first prototype of the UI is ready, we'll share it here for
>> feedback.
>>
>> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>> > Okay, great.
>> >
>> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET,
>> 9pm
>> > China time about the design of the ecosystem page (see:
>> > https://github.com/rmetzger/flink-community-tools/issues/4)
>> > Please let me know if others want to join as well, I can add them to the
>> > invite.
>> >
>> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com>
>> wrote:
>> >
>> >> I agree. We can start with english-only and see how it goes. The
>> comments
>> >> and descriptions can always be multi-lingual but that is up to the
>> package
>> >> owners.
>> >>
>> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
>> >> wrote:
>> >>
>> >>> Thanks.
>> >>>
>> >>> Do we actually want this page to be multi-language?
>> >>>
>> >>> I propose to make the website english-only, but maybe consider
>> allowing
>> >>> comments in different languages.
>> >>> If we would make it multi-language, then we might have problems with
>> >>> people submitting packages in non-english languages.
>> >>>
>> >>>
>> >>>
>> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
>> wrote:
>> >>>
>> >>>> Done. The writeup looks great!
>> >>>>
>> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>>> Nice, really good news on the INFRA front!
>> >>>>> I think the hardware specs sound reasonable. And a periodic backup
>> of
>> >>>>> the website's database to Infra's backup solution sounds reasonable
>> too.
>> >>>>>
>> >>>>> Can you accept and review my proposal for the website?
>> >>>>>
>> >>>>>
>> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>> >>>>> wrote:
>> >>>>>
>> >>>>>> >
>> >>>>>> > I have a very capable and motivated frontend developer who would
>> be
>> >>>>>> > willing to implement what I've mocked in my proposal.
>> >>>>>>
>> >>>>>>
>> >>>>>> That is awesome!
>> >>>>>>
>> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
>> >>>>>> looks that
>> >>>>>> Apache infra team could provide a decent VM. The last piece is how
>> to
>> >>>>>> ensure the data is persisted so we won't lose the project info /
>> user
>> >>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>> >>>>>> persistent storage for DB backup, we can always ask for multiple
>> VMs
>> >>>>>> and do
>> >>>>>> the fault tolerance by ourselves. It seems we can almost say the
>> >>>>>> hardware
>> >>>>>> side is also ready.
>> >>>>>>
>> >>>>>> Thanks,
>> >>>>>>
>> >>>>>> Jiangjie (Becket) Qin
>> >>>>>>
>> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>> >>>>>>
>> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <
>> rmetzger@apache.org>
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>> > Thank you for reaching out to Infra and the ember client.
>> >>>>>> > When I first saw the Ember repository, I thought it is the whole
>> >>>>>> thing
>> >>>>>> > (frontend and backend), but while testing it, I realized it is
>> >>>>>> "only" the
>> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>> >>>>>> observer
>> >>>>>> > client, or just write a simple UI from scratch.
>> >>>>>> > I have a very capable and motivated frontend developer who would
>> be
>> >>>>>> > willing to implement what I've mocked in my proposal.
>> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be
>> eager
>> >>>>>> to help
>> >>>>>> > with this project for the backend:
>> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>> >>>>>> >
>> >>>>>> > For Infra: I made the same experience when asking for more GitHub
>> >>>>>> > permissions for "flinkbot": They didn't respond on their mailing
>> >>>>>> list, only
>> >>>>>> > on Jira.
>> >>>>>> >
>> >>>>>> >
>> >>>>>> >
>> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <becket.qin@gmail.com
>> >
>> >>>>>> wrote:
>> >>>>>> >
>> >>>>>> >> Thanks for writing up the specifications.
>> >>>>>> >>
>> >>>>>> >> Regarding the website source code, Austin found a website[1]
>> whose
>> >>>>>> >> frontend code[2] is available publicly. It lacks some support
>> (e.g
>> >>>>>> login),
>> >>>>>> >> but it is still a good starting point. One thing is that I did
>> not
>> >>>>>> find a
>> >>>>>> >> License statement for that source code. I'll reach out to the
>> >>>>>> author to see
>> >>>>>> >> if they have any concern over our usage.
>> >>>>>> >>
>> >>>>>> >> Apache Infra has not replied to my email regarding some details
>> >>>>>> about the
>> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>> >>>>>> response.
>> >>>>>> >>
>> >>>>>> >> Thanks,
>> >>>>>> >>
>> >>>>>> >> Jiangjie (Becket) Qin
>> >>>>>> >>
>> >>>>>> >> [1] https://emberobserver.com/
>> >>>>>> >> [2] https://github.com/emberobserver/client
>> >>>>>> >>
>> >>>>>> >>
>> >>>>>> >>
>> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>> >>>>>> rmetzger@apache.org>
>> >>>>>> >> wrote:
>> >>>>>> >>
>> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>> >>>>>> company
>> >>>>>> >>> website. I guess the likelihood that they give out code from
>> >>>>>> their company
>> >>>>>> >>> website is fairly low.
>> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which
>> we'll
>> >>>>>> >>> reactivate as part of this PR:
>> >>>>>> >>> https://github.com/apache/flink-web/pull/187
>> >>>>>> >>>
>> >>>>>> >>> Spark-packages.org did not respond to my request.
>> >>>>>> >>> I will propose a short specification in Becket's initial
>> document.
>> >>>>>> >>>
>> >>>>>> >>>
>> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Niels@basjes.nl
>> >
>> >>>>>> wrote:
>> >>>>>> >>>
>> >>>>>> >>>> Hi,
>> >>>>>> >>>>
>> >>>>>> >>>> The Beam project has something in this area that is simply a
>> page
>> >>>>>> >>>> within their documentation website:
>> >>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>> >>>>>> >>>>
>> >>>>>> >>>> Niels Basjes
>> >>>>>> >>>>
>> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bowenli86@gmail.com
>> >
>> >>>>>> wrote:
>> >>>>>> >>>> >
>> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
>> kind. I
>> >>>>>> >>>> personally like it over the spark site. May worth checking it
>> >>>>>> out with
>> >>>>>> >>>> Kafka folks
>> >>>>>> >>>> >
>> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>> >>>>>> becket.qin@gmail.com>
>> >>>>>> >>>> wrote:
>> >>>>>> >>>> >>
>> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>> >>>>>> update the
>> >>>>>> >>>> >> ecosystem page and the navigation.
>> >>>>>> >>>> >>
>> >>>>>> >>>> >> Thanks,
>> >>>>>> >>>> >>
>> >>>>>> >>>> >> Jiangjie (Becket) Qin
>> >>>>>> >>>> >>
>> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>> >>>>>> rmetzger@apache.org>
>> >>>>>> >>>> wrote:
>> >>>>>> >>>> >>
>> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
>> >>>>>> they are
>> >>>>>> >>>> willing
>> >>>>>> >>>> >> > to share.
>> >>>>>> >>>> >> >
>> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>> >>>>>> (maybe sync
>> >>>>>> >>>> with
>> >>>>>> >>>> >> > the "Software Projects" listed here:
>> >>>>>> >>>> >> >
>> >>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink
>> )
>> >>>>>> >>>> and
>> >>>>>> >>>> >> > link it in the navigation?
>> >>>>>> >>>> >> >
>> >>>>>> >>>> >> > Best,
>> >>>>>> >>>> >> > Robert
>> >>>>>> >>>> >> >
>> >>>>>> >>>> >> >
>> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>> >>>>>> becket.qin@gmail.com>
>> >>>>>> >>>> wrote:
>> >>>>>> >>>> >> >
>> >>>>>> >>>> >> >> Hi Robert,
>> >>>>>> >>>> >> >>
>> >>>>>> >>>> >> >> I think it at least worths checking if
>> spark-packages.org
>> >>>>>> owners
>> >>>>>> >>>> are
>> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>> >>>>>> requirement
>> >>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>> >>>>>> >>>> >> >>
>> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will need
>> >>>>>> it to
>> >>>>>> >>>> redirect
>> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
>> >>>>>> while
>> >>>>>> >>>> working on
>> >>>>>> >>>> >> >> the dynamic website?
>> >>>>>> >>>> >> >>
>> >>>>>> >>>> >> >> Thanks,
>> >>>>>> >>>> >> >>
>> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
>> >>>>>> >>>> >> >>
>> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
>> uce@apache.org
>> >>>>>> >
>> >>>>>> >>>> wrote:
>> >>>>>> >>>> >> >>
>> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site
>> first.
>> >>>>>> We
>> >>>>>> >>>> could then
>> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course,
>> >>>>>> if we
>> >>>>>> >>>> have the
>> >>>>>> >>>> >> >>> resources in the community to quickly start with a
>> >>>>>> dynamic site,
>> >>>>>> >>>> I'm
>> >>>>>> >>>> >> >>> not apposed.
>> >>>>>> >>>> >> >>>
>> >>>>>> >>>> >> >>> – Ufuk
>> >>>>>> >>>> >> >>>
>> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>> >>>>>> >>>> rmetzger@apache.org>
>> >>>>>> >>>> >> >>> wrote:
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket!
>> The
>> >>>>>> VMs
>> >>>>>> >>>> hosted by
>> >>>>>> >>>> >> >>> Infra
>> >>>>>> >>>> >> >>> > look suitable.
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page.
>> It
>> >>>>>> used to
>> >>>>>> >>>> be
>> >>>>>> >>>> >> >>> linked,
>> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for some
>> >>>>>> reason.
>> >>>>>> >>>> This is
>> >>>>>> >>>> >> >>> the
>> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>> >>>>>> >>>> >> >>> > We could update the page and add it back to the
>> >>>>>> navigation bar
>> >>>>>> >>>> for the
>> >>>>>> >>>> >> >>> > coming weeks. What do you think?
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page
>> right
>> >>>>>> away.
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
>> >>>>>> about
>> >>>>>> >>>> sending the
>> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they
>> are
>> >>>>>> >>>> interested in
>> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
>> together
>> >>>>>> in a
>> >>>>>> >>>> public
>> >>>>>> >>>> >> >>> repo.
>> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide
>> not
>> >>>>>> to ask
>> >>>>>> >>>> in the
>> >>>>>> >>>> >> >>> first
>> >>>>>> >>>> >> >>> > place, I'm happy to write down a short description of
>> >>>>>> the
>> >>>>>> >>>> requirements,
>> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>> >>>>>> somebody here
>> >>>>>> >>>> in the
>> >>>>>> >>>> >> >>> > community who's willing to implement it.
>> >>>>>> >>>> >> >>> > Given the number of people who are eager to
>> contribute,
>> >>>>>> I
>> >>>>>> >>>> believe we
>> >>>>>> >>>> >> >>> will
>> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>> >>>>>> >>>> becket.qin@gmail.com>
>> >>>>>> >>>> >> >>> wrote:
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> > > Forgot to provide the link...
>> >>>>>> >>>> >> >>> > >
>> >>>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>> >>>>>> (Apache
>> >>>>>> >>>> infra
>> >>>>>> >>>> >> >>> services)
>> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>> >>>>>> (FreeBSD Jail
>> >>>>>> >>>> provided
>> >>>>>> >>>> >> >>> by
>> >>>>>> >>>> >> >>> > > Apache Infra)
>> >>>>>> >>>> >> >>> > >
>> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>> >>>>>> >>>> becket.qin@gmail.com>
>> >>>>>> >>>> >> >>> wrote:
>> >>>>>> >>>> >> >>> > >
>> >>>>>> >>>> >> >>> > >> Hi Robert,
>> >>>>>> >>>> >> >>> > >>
>> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>> >>>>>> should
>> >>>>>> >>>> absolutely
>> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>> >>>>>> interactions in
>> >>>>>> >>>> the
>> >>>>>> >>>> >> >>> community.
>> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
>> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source
>> solution
>> >>>>>> would
>> >>>>>> >>>> be great.
>> >>>>>> >>>> >> >>> TBH,
>> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
>> website.
>> >>>>>> It'll
>> >>>>>> >>>> be great
>> >>>>>> >>>> >> >>> if
>> >>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>> >>>>>> provides
>> >>>>>> >>>> a few
>> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I
>> did
>> >>>>>> not see
>> >>>>>> >>>> >> >>> database
>> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>> >>>>>> FreeBSD
>> >>>>>> >>>> jail[2].
>> >>>>>> >>>> >> >>> > >>
>> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>> >>>>>> >>>> >> >>> > >>
>> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable
>> to
>> >>>>>> me. We
>> >>>>>> >>>> >> >>> probably need
>> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even
>> just
>> >>>>>> >>>> provide links
>> >>>>>> >>>> >> >>> it to
>> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors
>> in
>> >>>>>> that
>> >>>>>> >>>> static
>> >>>>>> >>>> >> >>> page seems
>> >>>>>> >>>> >> >>> > >> something we could start with while we are working
>> >>>>>> on the
>> >>>>>> >>>> dynamic
>> >>>>>> >>>> >> >>> pages.
>> >>>>>> >>>> >> >>> > >>
>> >>>>>> >>>> >> >>> > >> Thanks,
>> >>>>>> >>>> >> >>> > >>
>> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>> >>>>>> >>>> >> >>> > >>
>> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>> >>>>>> >>>> wshaoxuan@gmail.com>
>> >>>>>> >>>> >> >>> > >> wrote:
>> >>>>>> >>>> >> >>> > >>
>> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>> >>>>>> >>>> >> >>> > >>>
>> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with
>> Flink
>> >>>>>> >>>> connectors at
>> >>>>>> >>>> >> >>> the
>> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static page,
>> >>>>>> and
>> >>>>>> >>>> upgrade it
>> >>>>>> >>>> >> >>> when we
>> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>> >>>>>> functions.
>> >>>>>> >>>> >> >>> > >>>
>> >>>>>> >>>> >> >>> > >>> Regards,
>> >>>>>> >>>> >> >>> > >>> Shaoxuan
>> >>>>>> >>>> >> >>> > >>>
>> >>>>>> >>>> >> >>> > >>>
>> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>> >>>>>> >>>> rmetzger@apache.org
>> >>>>>> >>>> >> >>> >
>> >>>>>> >>>> >> >>> > >>> wrote:
>> >>>>>> >>>> >> >>> > >>>
>> >>>>>> >>>> >> >>> > >>>> Hey Becket,
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>> > >>>> This is a great idea!
>> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure
>> >>>>>> the page
>> >>>>>> >>>> is placed
>> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>> >>>>>> something will
>> >>>>>> >>>> get
>> >>>>>> >>>> >> >>> attention for
>> >>>>>> >>>> >> >>> > >>>> their contributions.
>> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better,
>> >>>>>> if we
>> >>>>>> >>>> want
>> >>>>>> >>>> >> >>> features
>> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>> >>>>>> infra, and
>> >>>>>> >>>> endorsed
>> >>>>>> >>>> >> >>> by
>> >>>>>> >>>> >> >>> > >>>> the community.
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software
>> that
>> >>>>>> we
>> >>>>>> >>>> could use?
>> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>> >>>>>> >>>> >> >>> https://aur.archlinux.org/
>> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>> >>>>>> Linux. The
>> >>>>>> >>>> source
>> >>>>>> >>>> >> >>> code of this
>> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>> >>>>>> structure is
>> >>>>>> >>>> not an
>> >>>>>> >>>> >> >>> ideal fit for
>> >>>>>> >>>> >> >>> > >>>> our requirements)
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>> > >>>> Best,
>> >>>>>> >>>> >> >>> > >>>> Robert
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>> >>>>>> >>>> becket.qin@gmail.com>
>> >>>>>> >>>> >> >>> > >>>> wrote:
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>> > >>>>> Hi folks,
>> >>>>>> >>>> >> >>> > >>>>>
>> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>> >>>>>> creating
>> >>>>>> >>>> a Flink
>> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>> >>>>>> contributors
>> >>>>>> >>>> who
>> >>>>>> >>>> >> >>> have developed
>> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>> >>>>>> >>>> community.
>> >>>>>> >>>> >> >>> > >>>>>
>> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>> >>>>>> >>>> >> >>> > >>>>>
>> >>>>>> >>>> >> >>> > >>>>>
>> >>>>>> >>>> >> >>>
>> >>>>>> >>>>
>> >>>>>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> >>>>>> >>>> >> >>> > >>>>>
>> >>>>>> >>>> >> >>> > >>>>> Thanks,
>> >>>>>> >>>> >> >>> > >>>>>
>> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>> >>>>>> >>>> >> >>> > >>>>>
>> >>>>>> >>>> >> >>> > >>>>
>> >>>>>> >>>> >> >>>
>> >>>>>> >>>> >> >>
>> >>>>>> >>>>
>> >>>>>> >>>>
>> >>>>>> >>>>
>> >>>>>> >>>> --
>> >>>>>> >>>> Best regards / Met vriendelijke groeten,
>> >>>>>> >>>>
>> >>>>>> >>>> Niels Basjes
>> >>>>>> >>>>
>> >>>>>> >>>
>> >>>>>>
>> >>>>>
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Thanks for the update Robert! Looking forward to the prototype!

On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org> wrote:

> Quick summary of our call:
> Daryl will soon start with a front end, build against a very simple
> mock-backend.
> Congxian will start implementing the Spring-based backend early April.
>
> As soon as the first prototype of the UI is ready, we'll share it here for
> feedback.
>
> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
> wrote:
>
> > Okay, great.
> >
> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET,
> 9pm
> > China time about the design of the ecosystem page (see:
> > https://github.com/rmetzger/flink-community-tools/issues/4)
> > Please let me know if others want to join as well, I can add them to the
> > invite.
> >
> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com> wrote:
> >
> >> I agree. We can start with english-only and see how it goes. The
> comments
> >> and descriptions can always be multi-lingual but that is up to the
> package
> >> owners.
> >>
> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
> >> wrote:
> >>
> >>> Thanks.
> >>>
> >>> Do we actually want this page to be multi-language?
> >>>
> >>> I propose to make the website english-only, but maybe consider allowing
> >>> comments in different languages.
> >>> If we would make it multi-language, then we might have problems with
> >>> people submitting packages in non-english languages.
> >>>
> >>>
> >>>
> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
> wrote:
> >>>
> >>>> Done. The writeup looks great!
> >>>>
> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Nice, really good news on the INFRA front!
> >>>>> I think the hardware specs sound reasonable. And a periodic backup of
> >>>>> the website's database to Infra's backup solution sounds reasonable
> too.
> >>>>>
> >>>>> Can you accept and review my proposal for the website?
> >>>>>
> >>>>>
> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> >
> >>>>>> > I have a very capable and motivated frontend developer who would
> be
> >>>>>> > willing to implement what I've mocked in my proposal.
> >>>>>>
> >>>>>>
> >>>>>> That is awesome!
> >>>>>>
> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
> >>>>>> looks that
> >>>>>> Apache infra team could provide a decent VM. The last piece is how
> to
> >>>>>> ensure the data is persisted so we won't lose the project info /
> user
> >>>>>> feedbacks when the VM is down. If Apache infra does not provide a
> >>>>>> persistent storage for DB backup, we can always ask for multiple VMs
> >>>>>> and do
> >>>>>> the fault tolerance by ourselves. It seems we can almost say the
> >>>>>> hardware
> >>>>>> side is also ready.
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> Jiangjie (Becket) Qin
> >>>>>>
> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
> >>>>>>
> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rmetzger@apache.org
> >
> >>>>>> wrote:
> >>>>>>
> >>>>>> > Thank you for reaching out to Infra and the ember client.
> >>>>>> > When I first saw the Ember repository, I thought it is the whole
> >>>>>> thing
> >>>>>> > (frontend and backend), but while testing it, I realized it is
> >>>>>> "only" the
> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
> >>>>>> observer
> >>>>>> > client, or just write a simple UI from scratch.
> >>>>>> > I have a very capable and motivated frontend developer who would
> be
> >>>>>> > willing to implement what I've mocked in my proposal.
> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager
> >>>>>> to help
> >>>>>> > with this project for the backend:
> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
> >>>>>> >
> >>>>>> > For Infra: I made the same experience when asking for more GitHub
> >>>>>> > permissions for "flinkbot": They didn't respond on their mailing
> >>>>>> list, only
> >>>>>> > on Jira.
> >>>>>> >
> >>>>>> >
> >>>>>> >
> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
> >>>>>> wrote:
> >>>>>> >
> >>>>>> >> Thanks for writing up the specifications.
> >>>>>> >>
> >>>>>> >> Regarding the website source code, Austin found a website[1]
> whose
> >>>>>> >> frontend code[2] is available publicly. It lacks some support
> (e.g
> >>>>>> login),
> >>>>>> >> but it is still a good starting point. One thing is that I did
> not
> >>>>>> find a
> >>>>>> >> License statement for that source code. I'll reach out to the
> >>>>>> author to see
> >>>>>> >> if they have any concern over our usage.
> >>>>>> >>
> >>>>>> >> Apache Infra has not replied to my email regarding some details
> >>>>>> about the
> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
> >>>>>> response.
> >>>>>> >>
> >>>>>> >> Thanks,
> >>>>>> >>
> >>>>>> >> Jiangjie (Becket) Qin
> >>>>>> >>
> >>>>>> >> [1] https://emberobserver.com/
> >>>>>> >> [2] https://github.com/emberobserver/client
> >>>>>> >>
> >>>>>> >>
> >>>>>> >>
> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
> >>>>>> rmetzger@apache.org>
> >>>>>> >> wrote:
> >>>>>> >>
> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
> >>>>>> company
> >>>>>> >>> website. I guess the likelihood that they give out code from
> >>>>>> their company
> >>>>>> >>> website is fairly low.
> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
> >>>>>> >>> reactivate as part of this PR:
> >>>>>> >>> https://github.com/apache/flink-web/pull/187
> >>>>>> >>>
> >>>>>> >>> Spark-packages.org did not respond to my request.
> >>>>>> >>> I will propose a short specification in Becket's initial
> document.
> >>>>>> >>>
> >>>>>> >>>
> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
> >>>>>> wrote:
> >>>>>> >>>
> >>>>>> >>>> Hi,
> >>>>>> >>>>
> >>>>>> >>>> The Beam project has something in this area that is simply a
> page
> >>>>>> >>>> within their documentation website:
> >>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
> >>>>>> >>>>
> >>>>>> >>>> Niels Basjes
> >>>>>> >>>>
> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
> >>>>>> wrote:
> >>>>>> >>>> >
> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
> kind. I
> >>>>>> >>>> personally like it over the spark site. May worth checking it
> >>>>>> out with
> >>>>>> >>>> Kafka folks
> >>>>>> >>>> >
> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
> >>>>>> becket.qin@gmail.com>
> >>>>>> >>>> wrote:
> >>>>>> >>>> >>
> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
> >>>>>> update the
> >>>>>> >>>> >> ecosystem page and the navigation.
> >>>>>> >>>> >>
> >>>>>> >>>> >> Thanks,
> >>>>>> >>>> >>
> >>>>>> >>>> >> Jiangjie (Becket) Qin
> >>>>>> >>>> >>
> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
> >>>>>> rmetzger@apache.org>
> >>>>>> >>>> wrote:
> >>>>>> >>>> >>
> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
> >>>>>> they are
> >>>>>> >>>> willing
> >>>>>> >>>> >> > to share.
> >>>>>> >>>> >> >
> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
> >>>>>> (maybe sync
> >>>>>> >>>> with
> >>>>>> >>>> >> > the "Software Projects" listed here:
> >>>>>> >>>> >> >
> >>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
> >>>>>> >>>> and
> >>>>>> >>>> >> > link it in the navigation?
> >>>>>> >>>> >> >
> >>>>>> >>>> >> > Best,
> >>>>>> >>>> >> > Robert
> >>>>>> >>>> >> >
> >>>>>> >>>> >> >
> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
> >>>>>> becket.qin@gmail.com>
> >>>>>> >>>> wrote:
> >>>>>> >>>> >> >
> >>>>>> >>>> >> >> Hi Robert,
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> I think it at least worths checking if
> spark-packages.org
> >>>>>> owners
> >>>>>> >>>> are
> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
> >>>>>> requirement
> >>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will need
> >>>>>> it to
> >>>>>> >>>> redirect
> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
> >>>>>> while
> >>>>>> >>>> working on
> >>>>>> >>>> >> >> the dynamic website?
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> Thanks,
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
> uce@apache.org
> >>>>>> >
> >>>>>> >>>> wrote:
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first.
> >>>>>> We
> >>>>>> >>>> could then
> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course,
> >>>>>> if we
> >>>>>> >>>> have the
> >>>>>> >>>> >> >>> resources in the community to quickly start with a
> >>>>>> dynamic site,
> >>>>>> >>>> I'm
> >>>>>> >>>> >> >>> not apposed.
> >>>>>> >>>> >> >>>
> >>>>>> >>>> >> >>> – Ufuk
> >>>>>> >>>> >> >>>
> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
> >>>>>> >>>> rmetzger@apache.org>
> >>>>>> >>>> >> >>> wrote:
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket!
> The
> >>>>>> VMs
> >>>>>> >>>> hosted by
> >>>>>> >>>> >> >>> Infra
> >>>>>> >>>> >> >>> > look suitable.
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
> >>>>>> used to
> >>>>>> >>>> be
> >>>>>> >>>> >> >>> linked,
> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for some
> >>>>>> reason.
> >>>>>> >>>> This is
> >>>>>> >>>> >> >>> the
> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
> >>>>>> >>>> >> >>> > We could update the page and add it back to the
> >>>>>> navigation bar
> >>>>>> >>>> for the
> >>>>>> >>>> >> >>> > coming weeks. What do you think?
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
> >>>>>> away.
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
> >>>>>> about
> >>>>>> >>>> sending the
> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they
> are
> >>>>>> >>>> interested in
> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
> together
> >>>>>> in a
> >>>>>> >>>> public
> >>>>>> >>>> >> >>> repo.
> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide
> not
> >>>>>> to ask
> >>>>>> >>>> in the
> >>>>>> >>>> >> >>> first
> >>>>>> >>>> >> >>> > place, I'm happy to write down a short description of
> >>>>>> the
> >>>>>> >>>> requirements,
> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
> >>>>>> somebody here
> >>>>>> >>>> in the
> >>>>>> >>>> >> >>> > community who's willing to implement it.
> >>>>>> >>>> >> >>> > Given the number of people who are eager to
> contribute,
> >>>>>> I
> >>>>>> >>>> believe we
> >>>>>> >>>> >> >>> will
> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
> >>>>>> >>>> becket.qin@gmail.com>
> >>>>>> >>>> >> >>> wrote:
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > > Forgot to provide the link...
> >>>>>> >>>> >> >>> > >
> >>>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
> >>>>>> (Apache
> >>>>>> >>>> infra
> >>>>>> >>>> >> >>> services)
> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
> >>>>>> (FreeBSD Jail
> >>>>>> >>>> provided
> >>>>>> >>>> >> >>> by
> >>>>>> >>>> >> >>> > > Apache Infra)
> >>>>>> >>>> >> >>> > >
> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
> >>>>>> >>>> becket.qin@gmail.com>
> >>>>>> >>>> >> >>> wrote:
> >>>>>> >>>> >> >>> > >
> >>>>>> >>>> >> >>> > >> Hi Robert,
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
> >>>>>> should
> >>>>>> >>>> absolutely
> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
> >>>>>> interactions in
> >>>>>> >>>> the
> >>>>>> >>>> >> >>> community.
> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
> >>>>>> would
> >>>>>> >>>> be great.
> >>>>>> >>>> >> >>> TBH,
> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
> website.
> >>>>>> It'll
> >>>>>> >>>> be great
> >>>>>> >>>> >> >>> if
> >>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
> >>>>>> provides
> >>>>>> >>>> a few
> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I
> did
> >>>>>> not see
> >>>>>> >>>> >> >>> database
> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
> >>>>>> FreeBSD
> >>>>>> >>>> jail[2].
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable
> to
> >>>>>> me. We
> >>>>>> >>>> >> >>> probably need
> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even
> just
> >>>>>> >>>> provide links
> >>>>>> >>>> >> >>> it to
> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
> >>>>>> that
> >>>>>> >>>> static
> >>>>>> >>>> >> >>> page seems
> >>>>>> >>>> >> >>> > >> something we could start with while we are working
> >>>>>> on the
> >>>>>> >>>> dynamic
> >>>>>> >>>> >> >>> pages.
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> Thanks,
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> >>>>>> >>>> wshaoxuan@gmail.com>
> >>>>>> >>>> >> >>> > >> wrote:
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
> >>>>>> >>>> connectors at
> >>>>>> >>>> >> >>> the
> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static page,
> >>>>>> and
> >>>>>> >>>> upgrade it
> >>>>>> >>>> >> >>> when we
> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
> >>>>>> functions.
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>> Regards,
> >>>>>> >>>> >> >>> > >>> Shaoxuan
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> >>>>>> >>>> rmetzger@apache.org
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > >>> wrote:
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>>> Hey Becket,
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> This is a great idea!
> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure
> >>>>>> the page
> >>>>>> >>>> is placed
> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
> >>>>>> something will
> >>>>>> >>>> get
> >>>>>> >>>> >> >>> attention for
> >>>>>> >>>> >> >>> > >>>> their contributions.
> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better,
> >>>>>> if we
> >>>>>> >>>> want
> >>>>>> >>>> >> >>> features
> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
> >>>>>> infra, and
> >>>>>> >>>> endorsed
> >>>>>> >>>> >> >>> by
> >>>>>> >>>> >> >>> > >>>> the community.
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that
> >>>>>> we
> >>>>>> >>>> could use?
> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
> >>>>>> >>>> >> >>> https://aur.archlinux.org/
> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
> >>>>>> Linux. The
> >>>>>> >>>> source
> >>>>>> >>>> >> >>> code of this
> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
> >>>>>> structure is
> >>>>>> >>>> not an
> >>>>>> >>>> >> >>> ideal fit for
> >>>>>> >>>> >> >>> > >>>> our requirements)
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> Best,
> >>>>>> >>>> >> >>> > >>>> Robert
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> >>>>>> >>>> becket.qin@gmail.com>
> >>>>>> >>>> >> >>> > >>>> wrote:
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>>> Hi folks,
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
> >>>>>> creating
> >>>>>> >>>> a Flink
> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
> >>>>>> contributors
> >>>>>> >>>> who
> >>>>>> >>>> >> >>> have developed
> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
> >>>>>> >>>> community.
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>>
> >>>>>> >>>>
> >>>>>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> Thanks,
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>>
> >>>>>> >>>> >> >>
> >>>>>> >>>>
> >>>>>> >>>>
> >>>>>> >>>>
> >>>>>> >>>> --
> >>>>>> >>>> Best regards / Met vriendelijke groeten,
> >>>>>> >>>>
> >>>>>> >>>> Niels Basjes
> >>>>>> >>>>
> >>>>>> >>>
> >>>>>>
> >>>>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Thanks for the update Robert! Looking forward to the prototype!

On Thu, Mar 21, 2019 at 10:07 PM Robert Metzger <rm...@apache.org> wrote:

> Quick summary of our call:
> Daryl will soon start with a front end, build against a very simple
> mock-backend.
> Congxian will start implementing the Spring-based backend early April.
>
> As soon as the first prototype of the UI is ready, we'll share it here for
> feedback.
>
> On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org>
> wrote:
>
> > Okay, great.
> >
> > Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET,
> 9pm
> > China time about the design of the ecosystem page (see:
> > https://github.com/rmetzger/flink-community-tools/issues/4)
> > Please let me know if others want to join as well, I can add them to the
> > invite.
> >
> > On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com> wrote:
> >
> >> I agree. We can start with english-only and see how it goes. The
> comments
> >> and descriptions can always be multi-lingual but that is up to the
> package
> >> owners.
> >>
> >> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
> >> wrote:
> >>
> >>> Thanks.
> >>>
> >>> Do we actually want this page to be multi-language?
> >>>
> >>> I propose to make the website english-only, but maybe consider allowing
> >>> comments in different languages.
> >>> If we would make it multi-language, then we might have problems with
> >>> people submitting packages in non-english languages.
> >>>
> >>>
> >>>
> >>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com>
> wrote:
> >>>
> >>>> Done. The writeup looks great!
> >>>>
> >>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Nice, really good news on the INFRA front!
> >>>>> I think the hardware specs sound reasonable. And a periodic backup of
> >>>>> the website's database to Infra's backup solution sounds reasonable
> too.
> >>>>>
> >>>>> Can you accept and review my proposal for the website?
> >>>>>
> >>>>>
> >>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> >
> >>>>>> > I have a very capable and motivated frontend developer who would
> be
> >>>>>> > willing to implement what I've mocked in my proposal.
> >>>>>>
> >>>>>>
> >>>>>> That is awesome!
> >>>>>>
> >>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
> >>>>>> looks that
> >>>>>> Apache infra team could provide a decent VM. The last piece is how
> to
> >>>>>> ensure the data is persisted so we won't lose the project info /
> user
> >>>>>> feedbacks when the VM is down. If Apache infra does not provide a
> >>>>>> persistent storage for DB backup, we can always ask for multiple VMs
> >>>>>> and do
> >>>>>> the fault tolerance by ourselves. It seems we can almost say the
> >>>>>> hardware
> >>>>>> side is also ready.
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> Jiangjie (Becket) Qin
> >>>>>>
> >>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
> >>>>>>
> >>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rmetzger@apache.org
> >
> >>>>>> wrote:
> >>>>>>
> >>>>>> > Thank you for reaching out to Infra and the ember client.
> >>>>>> > When I first saw the Ember repository, I thought it is the whole
> >>>>>> thing
> >>>>>> > (frontend and backend), but while testing it, I realized it is
> >>>>>> "only" the
> >>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
> >>>>>> observer
> >>>>>> > client, or just write a simple UI from scratch.
> >>>>>> > I have a very capable and motivated frontend developer who would
> be
> >>>>>> > willing to implement what I've mocked in my proposal.
> >>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager
> >>>>>> to help
> >>>>>> > with this project for the backend:
> >>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
> >>>>>> >
> >>>>>> > For Infra: I made the same experience when asking for more GitHub
> >>>>>> > permissions for "flinkbot": They didn't respond on their mailing
> >>>>>> list, only
> >>>>>> > on Jira.
> >>>>>> >
> >>>>>> >
> >>>>>> >
> >>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
> >>>>>> wrote:
> >>>>>> >
> >>>>>> >> Thanks for writing up the specifications.
> >>>>>> >>
> >>>>>> >> Regarding the website source code, Austin found a website[1]
> whose
> >>>>>> >> frontend code[2] is available publicly. It lacks some support
> (e.g
> >>>>>> login),
> >>>>>> >> but it is still a good starting point. One thing is that I did
> not
> >>>>>> find a
> >>>>>> >> License statement for that source code. I'll reach out to the
> >>>>>> author to see
> >>>>>> >> if they have any concern over our usage.
> >>>>>> >>
> >>>>>> >> Apache Infra has not replied to my email regarding some details
> >>>>>> about the
> >>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
> >>>>>> response.
> >>>>>> >>
> >>>>>> >> Thanks,
> >>>>>> >>
> >>>>>> >> Jiangjie (Becket) Qin
> >>>>>> >>
> >>>>>> >> [1] https://emberobserver.com/
> >>>>>> >> [2] https://github.com/emberobserver/client
> >>>>>> >>
> >>>>>> >>
> >>>>>> >>
> >>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
> >>>>>> rmetzger@apache.org>
> >>>>>> >> wrote:
> >>>>>> >>
> >>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
> >>>>>> company
> >>>>>> >>> website. I guess the likelihood that they give out code from
> >>>>>> their company
> >>>>>> >>> website is fairly low.
> >>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
> >>>>>> >>> reactivate as part of this PR:
> >>>>>> >>> https://github.com/apache/flink-web/pull/187
> >>>>>> >>>
> >>>>>> >>> Spark-packages.org did not respond to my request.
> >>>>>> >>> I will propose a short specification in Becket's initial
> document.
> >>>>>> >>>
> >>>>>> >>>
> >>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
> >>>>>> wrote:
> >>>>>> >>>
> >>>>>> >>>> Hi,
> >>>>>> >>>>
> >>>>>> >>>> The Beam project has something in this area that is simply a
> page
> >>>>>> >>>> within their documentation website:
> >>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
> >>>>>> >>>>
> >>>>>> >>>> Niels Basjes
> >>>>>> >>>>
> >>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
> >>>>>> wrote:
> >>>>>> >>>> >
> >>>>>> >>>> > Confluent hub for Kafka is another good example of this
> kind. I
> >>>>>> >>>> personally like it over the spark site. May worth checking it
> >>>>>> out with
> >>>>>> >>>> Kafka folks
> >>>>>> >>>> >
> >>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
> >>>>>> becket.qin@gmail.com>
> >>>>>> >>>> wrote:
> >>>>>> >>>> >>
> >>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
> >>>>>> update the
> >>>>>> >>>> >> ecosystem page and the navigation.
> >>>>>> >>>> >>
> >>>>>> >>>> >> Thanks,
> >>>>>> >>>> >>
> >>>>>> >>>> >> Jiangjie (Becket) Qin
> >>>>>> >>>> >>
> >>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
> >>>>>> rmetzger@apache.org>
> >>>>>> >>>> wrote:
> >>>>>> >>>> >>
> >>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
> >>>>>> they are
> >>>>>> >>>> willing
> >>>>>> >>>> >> > to share.
> >>>>>> >>>> >> >
> >>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
> >>>>>> (maybe sync
> >>>>>> >>>> with
> >>>>>> >>>> >> > the "Software Projects" listed here:
> >>>>>> >>>> >> >
> >>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
> >>>>>> >>>> and
> >>>>>> >>>> >> > link it in the navigation?
> >>>>>> >>>> >> >
> >>>>>> >>>> >> > Best,
> >>>>>> >>>> >> > Robert
> >>>>>> >>>> >> >
> >>>>>> >>>> >> >
> >>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
> >>>>>> becket.qin@gmail.com>
> >>>>>> >>>> wrote:
> >>>>>> >>>> >> >
> >>>>>> >>>> >> >> Hi Robert,
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> I think it at least worths checking if
> spark-packages.org
> >>>>>> owners
> >>>>>> >>>> are
> >>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
> >>>>>> requirement
> >>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> Since a static page has almost no cost, and we will need
> >>>>>> it to
> >>>>>> >>>> redirect
> >>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
> >>>>>> while
> >>>>>> >>>> working on
> >>>>>> >>>> >> >> the dynamic website?
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> Thanks,
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> Jiangjie (Becket) Qin
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <
> uce@apache.org
> >>>>>> >
> >>>>>> >>>> wrote:
> >>>>>> >>>> >> >>
> >>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first.
> >>>>>> We
> >>>>>> >>>> could then
> >>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course,
> >>>>>> if we
> >>>>>> >>>> have the
> >>>>>> >>>> >> >>> resources in the community to quickly start with a
> >>>>>> dynamic site,
> >>>>>> >>>> I'm
> >>>>>> >>>> >> >>> not apposed.
> >>>>>> >>>> >> >>>
> >>>>>> >>>> >> >>> – Ufuk
> >>>>>> >>>> >> >>>
> >>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
> >>>>>> >>>> rmetzger@apache.org>
> >>>>>> >>>> >> >>> wrote:
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket!
> The
> >>>>>> VMs
> >>>>>> >>>> hosted by
> >>>>>> >>>> >> >>> Infra
> >>>>>> >>>> >> >>> > look suitable.
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
> >>>>>> used to
> >>>>>> >>>> be
> >>>>>> >>>> >> >>> linked,
> >>>>>> >>>> >> >>> > but has been removed from the navigation bar for some
> >>>>>> reason.
> >>>>>> >>>> This is
> >>>>>> >>>> >> >>> the
> >>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
> >>>>>> >>>> >> >>> > We could update the page and add it back to the
> >>>>>> navigation bar
> >>>>>> >>>> for the
> >>>>>> >>>> >> >>> > coming weeks. What do you think?
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
> >>>>>> away.
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
> >>>>>> about
> >>>>>> >>>> sending the
> >>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they
> are
> >>>>>> >>>> interested in
> >>>>>> >>>> >> >>> > sharing the source? We could maintain the code
> together
> >>>>>> in a
> >>>>>> >>>> public
> >>>>>> >>>> >> >>> repo.
> >>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide
> not
> >>>>>> to ask
> >>>>>> >>>> in the
> >>>>>> >>>> >> >>> first
> >>>>>> >>>> >> >>> > place, I'm happy to write down a short description of
> >>>>>> the
> >>>>>> >>>> requirements,
> >>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
> >>>>>> somebody here
> >>>>>> >>>> in the
> >>>>>> >>>> >> >>> > community who's willing to implement it.
> >>>>>> >>>> >> >>> > Given the number of people who are eager to
> contribute,
> >>>>>> I
> >>>>>> >>>> believe we
> >>>>>> >>>> >> >>> will
> >>>>>> >>>> >> >>> > be able to find somebody pretty soon.
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
> >>>>>> >>>> becket.qin@gmail.com>
> >>>>>> >>>> >> >>> wrote:
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > > Forgot to provide the link...
> >>>>>> >>>> >> >>> > >
> >>>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
> >>>>>> (Apache
> >>>>>> >>>> infra
> >>>>>> >>>> >> >>> services)
> >>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
> >>>>>> (FreeBSD Jail
> >>>>>> >>>> provided
> >>>>>> >>>> >> >>> by
> >>>>>> >>>> >> >>> > > Apache Infra)
> >>>>>> >>>> >> >>> > >
> >>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
> >>>>>> >>>> becket.qin@gmail.com>
> >>>>>> >>>> >> >>> wrote:
> >>>>>> >>>> >> >>> > >
> >>>>>> >>>> >> >>> > >> Hi Robert,
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
> >>>>>> should
> >>>>>> >>>> absolutely
> >>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
> >>>>>> interactions in
> >>>>>> >>>> the
> >>>>>> >>>> >> >>> community.
> >>>>>> >>>> >> >>> > >> There might be a few things to solve:
> >>>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
> >>>>>> would
> >>>>>> >>>> be great.
> >>>>>> >>>> >> >>> TBH,
> >>>>>> >>>> >> >>> > >> I do not have much experience on building a
> website.
> >>>>>> It'll
> >>>>>> >>>> be great
> >>>>>> >>>> >> >>> if
> >>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
> >>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
> >>>>>> provides
> >>>>>> >>>> a few
> >>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I
> did
> >>>>>> not see
> >>>>>> >>>> >> >>> database
> >>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
> >>>>>> FreeBSD
> >>>>>> >>>> jail[2].
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable
> to
> >>>>>> me. We
> >>>>>> >>>> >> >>> probably need
> >>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even
> just
> >>>>>> >>>> provide links
> >>>>>> >>>> >> >>> it to
> >>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
> >>>>>> that
> >>>>>> >>>> static
> >>>>>> >>>> >> >>> page seems
> >>>>>> >>>> >> >>> > >> something we could start with while we are working
> >>>>>> on the
> >>>>>> >>>> dynamic
> >>>>>> >>>> >> >>> pages.
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> Thanks,
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> >>>>>> >>>> wshaoxuan@gmail.com>
> >>>>>> >>>> >> >>> > >> wrote:
> >>>>>> >>>> >> >>> > >>
> >>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
> >>>>>> >>>> connectors at
> >>>>>> >>>> >> >>> the
> >>>>>> >>>> >> >>> > >>> first beginning. We can start with a static page,
> >>>>>> and
> >>>>>> >>>> upgrade it
> >>>>>> >>>> >> >>> when we
> >>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
> >>>>>> functions.
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>> Regards,
> >>>>>> >>>> >> >>> > >>> Shaoxuan
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> >>>>>> >>>> rmetzger@apache.org
> >>>>>> >>>> >> >>> >
> >>>>>> >>>> >> >>> > >>> wrote:
> >>>>>> >>>> >> >>> > >>>
> >>>>>> >>>> >> >>> > >>>> Hey Becket,
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> This is a great idea!
> >>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure
> >>>>>> the page
> >>>>>> >>>> is placed
> >>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
> >>>>>> something will
> >>>>>> >>>> get
> >>>>>> >>>> >> >>> attention for
> >>>>>> >>>> >> >>> > >>>> their contributions.
> >>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better,
> >>>>>> if we
> >>>>>> >>>> want
> >>>>>> >>>> >> >>> features
> >>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
> >>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
> >>>>>> infra, and
> >>>>>> >>>> endorsed
> >>>>>> >>>> >> >>> by
> >>>>>> >>>> >> >>> > >>>> the community.
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that
> >>>>>> we
> >>>>>> >>>> could use?
> >>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
> >>>>>> >>>> >> >>> https://aur.archlinux.org/
> >>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
> >>>>>> Linux. The
> >>>>>> >>>> source
> >>>>>> >>>> >> >>> code of this
> >>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
> >>>>>> structure is
> >>>>>> >>>> not an
> >>>>>> >>>> >> >>> ideal fit for
> >>>>>> >>>> >> >>> > >>>> our requirements)
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> Best,
> >>>>>> >>>> >> >>> > >>>> Robert
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> >>>>>> >>>> becket.qin@gmail.com>
> >>>>>> >>>> >> >>> > >>>> wrote:
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>> > >>>>> Hi folks,
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
> >>>>>> creating
> >>>>>> >>>> a Flink
> >>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
> >>>>>> contributors
> >>>>>> >>>> who
> >>>>>> >>>> >> >>> have developed
> >>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
> >>>>>> >>>> community.
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>>
> >>>>>> >>>>
> >>>>>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> Thanks,
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
> >>>>>> >>>> >> >>> > >>>>>
> >>>>>> >>>> >> >>> > >>>>
> >>>>>> >>>> >> >>>
> >>>>>> >>>> >> >>
> >>>>>> >>>>
> >>>>>> >>>>
> >>>>>> >>>>
> >>>>>> >>>> --
> >>>>>> >>>> Best regards / Met vriendelijke groeten,
> >>>>>> >>>>
> >>>>>> >>>> Niels Basjes
> >>>>>> >>>>
> >>>>>> >>>
> >>>>>>
> >>>>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Quick summary of our call:
Daryl will soon start with a front end, build against a very simple
mock-backend.
Congxian will start implementing the Spring-based backend early April.

As soon as the first prototype of the UI is ready, we'll share it here for
feedback.

On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org> wrote:

> Okay, great.
>
> Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET, 9pm
> China time about the design of the ecosystem page (see:
> https://github.com/rmetzger/flink-community-tools/issues/4)
> Please let me know if others want to join as well, I can add them to the
> invite.
>
> On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com> wrote:
>
>> I agree. We can start with english-only and see how it goes. The comments
>> and descriptions can always be multi-lingual but that is up to the package
>> owners.
>>
>> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Thanks.
>>>
>>> Do we actually want this page to be multi-language?
>>>
>>> I propose to make the website english-only, but maybe consider allowing
>>> comments in different languages.
>>> If we would make it multi-language, then we might have problems with
>>> people submitting packages in non-english languages.
>>>
>>>
>>>
>>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> Done. The writeup looks great!
>>>>
>>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>>> Nice, really good news on the INFRA front!
>>>>> I think the hardware specs sound reasonable. And a periodic backup of
>>>>> the website's database to Infra's backup solution sounds reasonable too.
>>>>>
>>>>> Can you accept and review my proposal for the website?
>>>>>
>>>>>
>>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> >
>>>>>> > I have a very capable and motivated frontend developer who would be
>>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>
>>>>>>
>>>>>> That is awesome!
>>>>>>
>>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
>>>>>> looks that
>>>>>> Apache infra team could provide a decent VM. The last piece is how to
>>>>>> ensure the data is persisted so we won't lose the project info / user
>>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>>>>> persistent storage for DB backup, we can always ask for multiple VMs
>>>>>> and do
>>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>>>> hardware
>>>>>> side is also ready.
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Jiangjie (Becket) Qin
>>>>>>
>>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>>
>>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>>> > When I first saw the Ember repository, I thought it is the whole
>>>>>> thing
>>>>>> > (frontend and backend), but while testing it, I realized it is
>>>>>> "only" the
>>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>>>>> observer
>>>>>> > client, or just write a simple UI from scratch.
>>>>>> > I have a very capable and motivated frontend developer who would be
>>>>>> > willing to implement what I've mocked in my proposal.
>>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager
>>>>>> to help
>>>>>> > with this project for the backend:
>>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>>> >
>>>>>> > For Infra: I made the same experience when asking for more GitHub
>>>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>>>>> list, only
>>>>>> > on Jira.
>>>>>> >
>>>>>> >
>>>>>> >
>>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>>>>> wrote:
>>>>>> >
>>>>>> >> Thanks for writing up the specifications.
>>>>>> >>
>>>>>> >> Regarding the website source code, Austin found a website[1] whose
>>>>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>>>>> login),
>>>>>> >> but it is still a good starting point. One thing is that I did not
>>>>>> find a
>>>>>> >> License statement for that source code. I'll reach out to the
>>>>>> author to see
>>>>>> >> if they have any concern over our usage.
>>>>>> >>
>>>>>> >> Apache Infra has not replied to my email regarding some details
>>>>>> about the
>>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>>>>> response.
>>>>>> >>
>>>>>> >> Thanks,
>>>>>> >>
>>>>>> >> Jiangjie (Becket) Qin
>>>>>> >>
>>>>>> >> [1] https://emberobserver.com/
>>>>>> >> [2] https://github.com/emberobserver/client
>>>>>> >>
>>>>>> >>
>>>>>> >>
>>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>>> rmetzger@apache.org>
>>>>>> >> wrote:
>>>>>> >>
>>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>>>>> company
>>>>>> >>> website. I guess the likelihood that they give out code from
>>>>>> their company
>>>>>> >>> website is fairly low.
>>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>>>>> >>> reactivate as part of this PR:
>>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>>> >>>
>>>>>> >>> Spark-packages.org did not respond to my request.
>>>>>> >>> I will propose a short specification in Becket's initial document.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>>>>> wrote:
>>>>>> >>>
>>>>>> >>>> Hi,
>>>>>> >>>>
>>>>>> >>>> The Beam project has something in this area that is simply a page
>>>>>> >>>> within their documentation website:
>>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>>> >>>>
>>>>>> >>>> Niels Basjes
>>>>>> >>>>
>>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>>>>> wrote:
>>>>>> >>>> >
>>>>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>>>>> >>>> personally like it over the spark site. May worth checking it
>>>>>> out with
>>>>>> >>>> Kafka folks
>>>>>> >>>> >
>>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>>> becket.qin@gmail.com>
>>>>>> >>>> wrote:
>>>>>> >>>> >>
>>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>>>>>> update the
>>>>>> >>>> >> ecosystem page and the navigation.
>>>>>> >>>> >>
>>>>>> >>>> >> Thanks,
>>>>>> >>>> >>
>>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>>> >>>> >>
>>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>>> rmetzger@apache.org>
>>>>>> >>>> wrote:
>>>>>> >>>> >>
>>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
>>>>>> they are
>>>>>> >>>> willing
>>>>>> >>>> >> > to share.
>>>>>> >>>> >> >
>>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>>>>> (maybe sync
>>>>>> >>>> with
>>>>>> >>>> >> > the "Software Projects" listed here:
>>>>>> >>>> >> >
>>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>>> >>>> and
>>>>>> >>>> >> > link it in the navigation?
>>>>>> >>>> >> >
>>>>>> >>>> >> > Best,
>>>>>> >>>> >> > Robert
>>>>>> >>>> >> >
>>>>>> >>>> >> >
>>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>>> becket.qin@gmail.com>
>>>>>> >>>> wrote:
>>>>>> >>>> >> >
>>>>>> >>>> >> >> Hi Robert,
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>>>>> owners
>>>>>> >>>> are
>>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>>>>> requirement
>>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> Since a static page has almost no cost, and we will need
>>>>>> it to
>>>>>> >>>> redirect
>>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
>>>>>> while
>>>>>> >>>> working on
>>>>>> >>>> >> >> the dynamic website?
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> Thanks,
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uce@apache.org
>>>>>> >
>>>>>> >>>> wrote:
>>>>>> >>>> >> >>
>>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first.
>>>>>> We
>>>>>> >>>> could then
>>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course,
>>>>>> if we
>>>>>> >>>> have the
>>>>>> >>>> >> >>> resources in the community to quickly start with a
>>>>>> dynamic site,
>>>>>> >>>> I'm
>>>>>> >>>> >> >>> not apposed.
>>>>>> >>>> >> >>>
>>>>>> >>>> >> >>> – Ufuk
>>>>>> >>>> >> >>>
>>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>>> >>>> rmetzger@apache.org>
>>>>>> >>>> >> >>> wrote:
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The
>>>>>> VMs
>>>>>> >>>> hosted by
>>>>>> >>>> >> >>> Infra
>>>>>> >>>> >> >>> > look suitable.
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>>>>> used to
>>>>>> >>>> be
>>>>>> >>>> >> >>> linked,
>>>>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>>>>> reason.
>>>>>> >>>> This is
>>>>>> >>>> >> >>> the
>>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>>> navigation bar
>>>>>> >>>> for the
>>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>>>>> away.
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
>>>>>> about
>>>>>> >>>> sending the
>>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>>>> >>>> interested in
>>>>>> >>>> >> >>> > sharing the source? We could maintain the code together
>>>>>> in a
>>>>>> >>>> public
>>>>>> >>>> >> >>> repo.
>>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide not
>>>>>> to ask
>>>>>> >>>> in the
>>>>>> >>>> >> >>> first
>>>>>> >>>> >> >>> > place, I'm happy to write down a short description of
>>>>>> the
>>>>>> >>>> requirements,
>>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>>>> somebody here
>>>>>> >>>> in the
>>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>>> >>>> >> >>> > Given the number of people who are eager to contribute,
>>>>>> I
>>>>>> >>>> believe we
>>>>>> >>>> >> >>> will
>>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>> >> >>> wrote:
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>>> >>>> >> >>> > >
>>>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>>>>> (Apache
>>>>>> >>>> infra
>>>>>> >>>> >> >>> services)
>>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>>>>> (FreeBSD Jail
>>>>>> >>>> provided
>>>>>> >>>> >> >>> by
>>>>>> >>>> >> >>> > > Apache Infra)
>>>>>> >>>> >> >>> > >
>>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>> >> >>> wrote:
>>>>>> >>>> >> >>> > >
>>>>>> >>>> >> >>> > >> Hi Robert,
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>>>>> should
>>>>>> >>>> absolutely
>>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>>> interactions in
>>>>>> >>>> the
>>>>>> >>>> >> >>> community.
>>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>>>>> would
>>>>>> >>>> be great.
>>>>>> >>>> >> >>> TBH,
>>>>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>>>>> It'll
>>>>>> >>>> be great
>>>>>> >>>> >> >>> if
>>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>>>>> provides
>>>>>> >>>> a few
>>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>>>>> not see
>>>>>> >>>> >> >>> database
>>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>>>>> FreeBSD
>>>>>> >>>> jail[2].
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>>>>> me. We
>>>>>> >>>> >> >>> probably need
>>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>>>> >>>> provide links
>>>>>> >>>> >> >>> it to
>>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
>>>>>> that
>>>>>> >>>> static
>>>>>> >>>> >> >>> page seems
>>>>>> >>>> >> >>> > >> something we could start with while we are working
>>>>>> on the
>>>>>> >>>> dynamic
>>>>>> >>>> >> >>> pages.
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> Thanks,
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>>>> >>>> wshaoxuan@gmail.com>
>>>>>> >>>> >> >>> > >> wrote:
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>>>> >>>> connectors at
>>>>>> >>>> >> >>> the
>>>>>> >>>> >> >>> > >>> first beginning. We can start with a static page,
>>>>>> and
>>>>>> >>>> upgrade it
>>>>>> >>>> >> >>> when we
>>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>>>>> functions.
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>> Regards,
>>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>>>> >>>> rmetzger@apache.org
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > >>> wrote:
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure
>>>>>> the page
>>>>>> >>>> is placed
>>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>>>> something will
>>>>>> >>>> get
>>>>>> >>>> >> >>> attention for
>>>>>> >>>> >> >>> > >>>> their contributions.
>>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better,
>>>>>> if we
>>>>>> >>>> want
>>>>>> >>>> >> >>> features
>>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>>>>> infra, and
>>>>>> >>>> endorsed
>>>>>> >>>> >> >>> by
>>>>>> >>>> >> >>> > >>>> the community.
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that
>>>>>> we
>>>>>> >>>> could use?
>>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>>>>>> Linux. The
>>>>>> >>>> source
>>>>>> >>>> >> >>> code of this
>>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>>>> structure is
>>>>>> >>>> not an
>>>>>> >>>> >> >>> ideal fit for
>>>>>> >>>> >> >>> > >>>> our requirements)
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> Best,
>>>>>> >>>> >> >>> > >>>> Robert
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>> >> >>> > >>>> wrote:
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>>>>> creating
>>>>>> >>>> a Flink
>>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>>>> contributors
>>>>>> >>>> who
>>>>>> >>>> >> >>> have developed
>>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>>>>> >>>> community.
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>>
>>>>>> >>>>
>>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>>
>>>>>> >>>> >> >>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>> --
>>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>>> >>>>
>>>>>> >>>> Niels Basjes
>>>>>> >>>>
>>>>>> >>>
>>>>>>
>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Quick summary of our call:
Daryl will soon start with a front end, build against a very simple
mock-backend.
Congxian will start implementing the Spring-based backend early April.

As soon as the first prototype of the UI is ready, we'll share it here for
feedback.

On Thu, Mar 21, 2019 at 10:08 AM Robert Metzger <rm...@apache.org> wrote:

> Okay, great.
>
> Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET, 9pm
> China time about the design of the ecosystem page (see:
> https://github.com/rmetzger/flink-community-tools/issues/4)
> Please let me know if others want to join as well, I can add them to the
> invite.
>
> On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com> wrote:
>
>> I agree. We can start with english-only and see how it goes. The comments
>> and descriptions can always be multi-lingual but that is up to the package
>> owners.
>>
>> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Thanks.
>>>
>>> Do we actually want this page to be multi-language?
>>>
>>> I propose to make the website english-only, but maybe consider allowing
>>> comments in different languages.
>>> If we would make it multi-language, then we might have problems with
>>> people submitting packages in non-english languages.
>>>
>>>
>>>
>>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> Done. The writeup looks great!
>>>>
>>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>>> Nice, really good news on the INFRA front!
>>>>> I think the hardware specs sound reasonable. And a periodic backup of
>>>>> the website's database to Infra's backup solution sounds reasonable too.
>>>>>
>>>>> Can you accept and review my proposal for the website?
>>>>>
>>>>>
>>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> >
>>>>>> > I have a very capable and motivated frontend developer who would be
>>>>>> > willing to implement what I've mocked in my proposal.
>>>>>>
>>>>>>
>>>>>> That is awesome!
>>>>>>
>>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It
>>>>>> looks that
>>>>>> Apache infra team could provide a decent VM. The last piece is how to
>>>>>> ensure the data is persisted so we won't lose the project info / user
>>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>>>>> persistent storage for DB backup, we can always ask for multiple VMs
>>>>>> and do
>>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>>>> hardware
>>>>>> side is also ready.
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Jiangjie (Becket) Qin
>>>>>>
>>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>>
>>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>>> > When I first saw the Ember repository, I thought it is the whole
>>>>>> thing
>>>>>> > (frontend and backend), but while testing it, I realized it is
>>>>>> "only" the
>>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember
>>>>>> observer
>>>>>> > client, or just write a simple UI from scratch.
>>>>>> > I have a very capable and motivated frontend developer who would be
>>>>>> > willing to implement what I've mocked in my proposal.
>>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager
>>>>>> to help
>>>>>> > with this project for the backend:
>>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>>> >
>>>>>> > For Infra: I made the same experience when asking for more GitHub
>>>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>>>>> list, only
>>>>>> > on Jira.
>>>>>> >
>>>>>> >
>>>>>> >
>>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>>>>> wrote:
>>>>>> >
>>>>>> >> Thanks for writing up the specifications.
>>>>>> >>
>>>>>> >> Regarding the website source code, Austin found a website[1] whose
>>>>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>>>>> login),
>>>>>> >> but it is still a good starting point. One thing is that I did not
>>>>>> find a
>>>>>> >> License statement for that source code. I'll reach out to the
>>>>>> author to see
>>>>>> >> if they have any concern over our usage.
>>>>>> >>
>>>>>> >> Apache Infra has not replied to my email regarding some details
>>>>>> about the
>>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>>>>> response.
>>>>>> >>
>>>>>> >> Thanks,
>>>>>> >>
>>>>>> >> Jiangjie (Becket) Qin
>>>>>> >>
>>>>>> >> [1] https://emberobserver.com/
>>>>>> >> [2] https://github.com/emberobserver/client
>>>>>> >>
>>>>>> >>
>>>>>> >>
>>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <
>>>>>> rmetzger@apache.org>
>>>>>> >> wrote:
>>>>>> >>
>>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>>>>> company
>>>>>> >>> website. I guess the likelihood that they give out code from
>>>>>> their company
>>>>>> >>> website is fairly low.
>>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>>>>> >>> reactivate as part of this PR:
>>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>>> >>>
>>>>>> >>> Spark-packages.org did not respond to my request.
>>>>>> >>> I will propose a short specification in Becket's initial document.
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>>>>> wrote:
>>>>>> >>>
>>>>>> >>>> Hi,
>>>>>> >>>>
>>>>>> >>>> The Beam project has something in this area that is simply a page
>>>>>> >>>> within their documentation website:
>>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>>> >>>>
>>>>>> >>>> Niels Basjes
>>>>>> >>>>
>>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>>>>> wrote:
>>>>>> >>>> >
>>>>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>>>>> >>>> personally like it over the spark site. May worth checking it
>>>>>> out with
>>>>>> >>>> Kafka folks
>>>>>> >>>> >
>>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <
>>>>>> becket.qin@gmail.com>
>>>>>> >>>> wrote:
>>>>>> >>>> >>
>>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to
>>>>>> update the
>>>>>> >>>> >> ecosystem page and the navigation.
>>>>>> >>>> >>
>>>>>> >>>> >> Thanks,
>>>>>> >>>> >>
>>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>>> >>>> >>
>>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>>> rmetzger@apache.org>
>>>>>> >>>> wrote:
>>>>>> >>>> >>
>>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
>>>>>> they are
>>>>>> >>>> willing
>>>>>> >>>> >> > to share.
>>>>>> >>>> >> >
>>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>>>>> (maybe sync
>>>>>> >>>> with
>>>>>> >>>> >> > the "Software Projects" listed here:
>>>>>> >>>> >> >
>>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>>> >>>> and
>>>>>> >>>> >> > link it in the navigation?
>>>>>> >>>> >> >
>>>>>> >>>> >> > Best,
>>>>>> >>>> >> > Robert
>>>>>> >>>> >> >
>>>>>> >>>> >> >
>>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>>> becket.qin@gmail.com>
>>>>>> >>>> wrote:
>>>>>> >>>> >> >
>>>>>> >>>> >> >> Hi Robert,
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>>>>> owners
>>>>>> >>>> are
>>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>>>>> requirement
>>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> Since a static page has almost no cost, and we will need
>>>>>> it to
>>>>>> >>>> redirect
>>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
>>>>>> while
>>>>>> >>>> working on
>>>>>> >>>> >> >> the dynamic website?
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> Thanks,
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>>> >>>> >> >>
>>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uce@apache.org
>>>>>> >
>>>>>> >>>> wrote:
>>>>>> >>>> >> >>
>>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first.
>>>>>> We
>>>>>> >>>> could then
>>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course,
>>>>>> if we
>>>>>> >>>> have the
>>>>>> >>>> >> >>> resources in the community to quickly start with a
>>>>>> dynamic site,
>>>>>> >>>> I'm
>>>>>> >>>> >> >>> not apposed.
>>>>>> >>>> >> >>>
>>>>>> >>>> >> >>> – Ufuk
>>>>>> >>>> >> >>>
>>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>>> >>>> rmetzger@apache.org>
>>>>>> >>>> >> >>> wrote:
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The
>>>>>> VMs
>>>>>> >>>> hosted by
>>>>>> >>>> >> >>> Infra
>>>>>> >>>> >> >>> > look suitable.
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>>>>> used to
>>>>>> >>>> be
>>>>>> >>>> >> >>> linked,
>>>>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>>>>> reason.
>>>>>> >>>> This is
>>>>>> >>>> >> >>> the
>>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>>> navigation bar
>>>>>> >>>> for the
>>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>>>>> away.
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
>>>>>> about
>>>>>> >>>> sending the
>>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>>>> >>>> interested in
>>>>>> >>>> >> >>> > sharing the source? We could maintain the code together
>>>>>> in a
>>>>>> >>>> public
>>>>>> >>>> >> >>> repo.
>>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide not
>>>>>> to ask
>>>>>> >>>> in the
>>>>>> >>>> >> >>> first
>>>>>> >>>> >> >>> > place, I'm happy to write down a short description of
>>>>>> the
>>>>>> >>>> requirements,
>>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>>>> somebody here
>>>>>> >>>> in the
>>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>>> >>>> >> >>> > Given the number of people who are eager to contribute,
>>>>>> I
>>>>>> >>>> believe we
>>>>>> >>>> >> >>> will
>>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>> >> >>> wrote:
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>>> >>>> >> >>> > >
>>>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>>>>> (Apache
>>>>>> >>>> infra
>>>>>> >>>> >> >>> services)
>>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails
>>>>>> (FreeBSD Jail
>>>>>> >>>> provided
>>>>>> >>>> >> >>> by
>>>>>> >>>> >> >>> > > Apache Infra)
>>>>>> >>>> >> >>> > >
>>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>> >> >>> wrote:
>>>>>> >>>> >> >>> > >
>>>>>> >>>> >> >>> > >> Hi Robert,
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>>>>> should
>>>>>> >>>> absolutely
>>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>>> interactions in
>>>>>> >>>> the
>>>>>> >>>> >> >>> community.
>>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>>>>> would
>>>>>> >>>> be great.
>>>>>> >>>> >> >>> TBH,
>>>>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>>>>> It'll
>>>>>> >>>> be great
>>>>>> >>>> >> >>> if
>>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>>>>> provides
>>>>>> >>>> a few
>>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>>>>> not see
>>>>>> >>>> >> >>> database
>>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>>>>> FreeBSD
>>>>>> >>>> jail[2].
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>>>>> me. We
>>>>>> >>>> >> >>> probably need
>>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>>>> >>>> provide links
>>>>>> >>>> >> >>> it to
>>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
>>>>>> that
>>>>>> >>>> static
>>>>>> >>>> >> >>> page seems
>>>>>> >>>> >> >>> > >> something we could start with while we are working
>>>>>> on the
>>>>>> >>>> dynamic
>>>>>> >>>> >> >>> pages.
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> Thanks,
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>>>> >>>> wshaoxuan@gmail.com>
>>>>>> >>>> >> >>> > >> wrote:
>>>>>> >>>> >> >>> > >>
>>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>>>> >>>> connectors at
>>>>>> >>>> >> >>> the
>>>>>> >>>> >> >>> > >>> first beginning. We can start with a static page,
>>>>>> and
>>>>>> >>>> upgrade it
>>>>>> >>>> >> >>> when we
>>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>>>>> functions.
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>> Regards,
>>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>>>> >>>> rmetzger@apache.org
>>>>>> >>>> >> >>> >
>>>>>> >>>> >> >>> > >>> wrote:
>>>>>> >>>> >> >>> > >>>
>>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure
>>>>>> the page
>>>>>> >>>> is placed
>>>>>> >>>> >> >>> > >>>> prominently so that the people submitting
>>>>>> something will
>>>>>> >>>> get
>>>>>> >>>> >> >>> attention for
>>>>>> >>>> >> >>> > >>>> their contributions.
>>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better,
>>>>>> if we
>>>>>> >>>> want
>>>>>> >>>> >> >>> features
>>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>>>>> infra, and
>>>>>> >>>> endorsed
>>>>>> >>>> >> >>> by
>>>>>> >>>> >> >>> > >>>> the community.
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that
>>>>>> we
>>>>>> >>>> could use?
>>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch
>>>>>> Linux. The
>>>>>> >>>> source
>>>>>> >>>> >> >>> code of this
>>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and
>>>>>> structure is
>>>>>> >>>> not an
>>>>>> >>>> >> >>> ideal fit for
>>>>>> >>>> >> >>> > >>>> our requirements)
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> Best,
>>>>>> >>>> >> >>> > >>>> Robert
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>>>> >>>> becket.qin@gmail.com>
>>>>>> >>>> >> >>> > >>>> wrote:
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>>>>> creating
>>>>>> >>>> a Flink
>>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>>>> contributors
>>>>>> >>>> who
>>>>>> >>>> >> >>> have developed
>>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>>>>> >>>> community.
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>>
>>>>>> >>>>
>>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>>> >>>> >> >>> > >>>>>
>>>>>> >>>> >> >>> > >>>>
>>>>>> >>>> >> >>>
>>>>>> >>>> >> >>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>> --
>>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>>> >>>>
>>>>>> >>>> Niels Basjes
>>>>>> >>>>
>>>>>> >>>
>>>>>>
>>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Okay, great.

Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET, 9pm
China time about the design of the ecosystem page (see:
https://github.com/rmetzger/flink-community-tools/issues/4)
Please let me know if others want to join as well, I can add them to the
invite.

On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com> wrote:

> I agree. We can start with english-only and see how it goes. The comments
> and descriptions can always be multi-lingual but that is up to the package
> owners.
>
> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Thanks.
>>
>> Do we actually want this page to be multi-language?
>>
>> I propose to make the website english-only, but maybe consider allowing
>> comments in different languages.
>> If we would make it multi-language, then we might have problems with
>> people submitting packages in non-english languages.
>>
>>
>>
>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> Done. The writeup looks great!
>>>
>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Nice, really good news on the INFRA front!
>>>> I think the hardware specs sound reasonable. And a periodic backup of
>>>> the website's database to Infra's backup solution sounds reasonable too.
>>>>
>>>> Can you accept and review my proposal for the website?
>>>>
>>>>
>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>>
>>>>> >
>>>>> > I have a very capable and motivated frontend developer who would be
>>>>> > willing to implement what I've mocked in my proposal.
>>>>>
>>>>>
>>>>> That is awesome!
>>>>>
>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>>>>> that
>>>>> Apache infra team could provide a decent VM. The last piece is how to
>>>>> ensure the data is persisted so we won't lose the project info / user
>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>>>> persistent storage for DB backup, we can always ask for multiple VMs
>>>>> and do
>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>>> hardware
>>>>> side is also ready.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Jiangjie (Becket) Qin
>>>>>
>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>
>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>>>> wrote:
>>>>>
>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>> > When I first saw the Ember repository, I thought it is the whole
>>>>> thing
>>>>> > (frontend and backend), but while testing it, I realized it is
>>>>> "only" the
>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>>>>> > client, or just write a simple UI from scratch.
>>>>> > I have a very capable and motivated frontend developer who would be
>>>>> > willing to implement what I've mocked in my proposal.
>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager
>>>>> to help
>>>>> > with this project for the backend:
>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>> >
>>>>> > For Infra: I made the same experience when asking for more GitHub
>>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>>>> list, only
>>>>> > on Jira.
>>>>> >
>>>>> >
>>>>> >
>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>> >
>>>>> >> Thanks for writing up the specifications.
>>>>> >>
>>>>> >> Regarding the website source code, Austin found a website[1] whose
>>>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>>>> login),
>>>>> >> but it is still a good starting point. One thing is that I did not
>>>>> find a
>>>>> >> License statement for that source code. I'll reach out to the
>>>>> author to see
>>>>> >> if they have any concern over our usage.
>>>>> >>
>>>>> >> Apache Infra has not replied to my email regarding some details
>>>>> about the
>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>>>> response.
>>>>> >>
>>>>> >> Thanks,
>>>>> >>
>>>>> >> Jiangjie (Becket) Qin
>>>>> >>
>>>>> >> [1] https://emberobserver.com/
>>>>> >> [2] https://github.com/emberobserver/client
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rmetzger@apache.org
>>>>> >
>>>>> >> wrote:
>>>>> >>
>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>>>> company
>>>>> >>> website. I guess the likelihood that they give out code from their
>>>>> company
>>>>> >>> website is fairly low.
>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>>>> >>> reactivate as part of this PR:
>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>> >>>
>>>>> >>> Spark-packages.org did not respond to my request.
>>>>> >>> I will propose a short specification in Becket's initial document.
>>>>> >>>
>>>>> >>>
>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>>>> wrote:
>>>>> >>>
>>>>> >>>> Hi,
>>>>> >>>>
>>>>> >>>> The Beam project has something in this area that is simply a page
>>>>> >>>> within their documentation website:
>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>> >>>>
>>>>> >>>> Niels Basjes
>>>>> >>>>
>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>>>> wrote:
>>>>> >>>> >
>>>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>>>> >>>> personally like it over the spark site. May worth checking it out
>>>>> with
>>>>> >>>> Kafka folks
>>>>> >>>> >
>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <becket.qin@gmail.com
>>>>> >
>>>>> >>>> wrote:
>>>>> >>>> >>
>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update
>>>>> the
>>>>> >>>> >> ecosystem page and the navigation.
>>>>> >>>> >>
>>>>> >>>> >> Thanks,
>>>>> >>>> >>
>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>> >>>> >>
>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>> rmetzger@apache.org>
>>>>> >>>> wrote:
>>>>> >>>> >>
>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
>>>>> they are
>>>>> >>>> willing
>>>>> >>>> >> > to share.
>>>>> >>>> >> >
>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>>>> (maybe sync
>>>>> >>>> with
>>>>> >>>> >> > the "Software Projects" listed here:
>>>>> >>>> >> >
>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>> >>>> and
>>>>> >>>> >> > link it in the navigation?
>>>>> >>>> >> >
>>>>> >>>> >> > Best,
>>>>> >>>> >> > Robert
>>>>> >>>> >> >
>>>>> >>>> >> >
>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>> becket.qin@gmail.com>
>>>>> >>>> wrote:
>>>>> >>>> >> >
>>>>> >>>> >> >> Hi Robert,
>>>>> >>>> >> >>
>>>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>>>> owners
>>>>> >>>> are
>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>>>> requirement
>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>>> >>>> >> >>
>>>>> >>>> >> >> Since a static page has almost no cost, and we will need it
>>>>> to
>>>>> >>>> redirect
>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
>>>>> while
>>>>> >>>> working on
>>>>> >>>> >> >> the dynamic website?
>>>>> >>>> >> >>
>>>>> >>>> >> >> Thanks,
>>>>> >>>> >> >>
>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>> >>>> >> >>
>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>>>> >>>> wrote:
>>>>> >>>> >> >>
>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>>>> >>>> could then
>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if
>>>>> we
>>>>> >>>> have the
>>>>> >>>> >> >>> resources in the community to quickly start with a dynamic
>>>>> site,
>>>>> >>>> I'm
>>>>> >>>> >> >>> not apposed.
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> – Ufuk
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>> >>>> rmetzger@apache.org>
>>>>> >>>> >> >>> wrote:
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The
>>>>> VMs
>>>>> >>>> hosted by
>>>>> >>>> >> >>> Infra
>>>>> >>>> >> >>> > look suitable.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>>>> used to
>>>>> >>>> be
>>>>> >>>> >> >>> linked,
>>>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>>>> reason.
>>>>> >>>> This is
>>>>> >>>> >> >>> the
>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>> navigation bar
>>>>> >>>> for the
>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>>>> away.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
>>>>> about
>>>>> >>>> sending the
>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>>> >>>> interested in
>>>>> >>>> >> >>> > sharing the source? We could maintain the code together
>>>>> in a
>>>>> >>>> public
>>>>> >>>> >> >>> repo.
>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide not
>>>>> to ask
>>>>> >>>> in the
>>>>> >>>> >> >>> first
>>>>> >>>> >> >>> > place, I'm happy to write down a short description of the
>>>>> >>>> requirements,
>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>>> somebody here
>>>>> >>>> in the
>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>>>>> >>>> believe we
>>>>> >>>> >> >>> will
>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>> >> >>> wrote:
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>> >>>> >> >>> > >
>>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>>>> (Apache
>>>>> >>>> infra
>>>>> >>>> >> >>> services)
>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>>>>> Jail
>>>>> >>>> provided
>>>>> >>>> >> >>> by
>>>>> >>>> >> >>> > > Apache Infra)
>>>>> >>>> >> >>> > >
>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>> >> >>> wrote:
>>>>> >>>> >> >>> > >
>>>>> >>>> >> >>> > >> Hi Robert,
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>>>> should
>>>>> >>>> absolutely
>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>> interactions in
>>>>> >>>> the
>>>>> >>>> >> >>> community.
>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>>>> would
>>>>> >>>> be great.
>>>>> >>>> >> >>> TBH,
>>>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>>>> It'll
>>>>> >>>> be great
>>>>> >>>> >> >>> if
>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>>>> provides
>>>>> >>>> a few
>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>>>> not see
>>>>> >>>> >> >>> database
>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>>>> FreeBSD
>>>>> >>>> jail[2].
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>>>> me. We
>>>>> >>>> >> >>> probably need
>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>>> >>>> provide links
>>>>> >>>> >> >>> it to
>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
>>>>> that
>>>>> >>>> static
>>>>> >>>> >> >>> page seems
>>>>> >>>> >> >>> > >> something we could start with while we are working on
>>>>> the
>>>>> >>>> dynamic
>>>>> >>>> >> >>> pages.
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> Thanks,
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>>> >>>> wshaoxuan@gmail.com>
>>>>> >>>> >> >>> > >> wrote:
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>>> >>>> connectors at
>>>>> >>>> >> >>> the
>>>>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>>>>> >>>> upgrade it
>>>>> >>>> >> >>> when we
>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>>>> functions.
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>> Regards,
>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>>> >>>> rmetzger@apache.org
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > >>> wrote:
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>>>>> page
>>>>> >>>> is placed
>>>>> >>>> >> >>> > >>>> prominently so that the people submitting something
>>>>> will
>>>>> >>>> get
>>>>> >>>> >> >>> attention for
>>>>> >>>> >> >>> > >>>> their contributions.
>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if
>>>>> we
>>>>> >>>> want
>>>>> >>>> >> >>> features
>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>>>> infra, and
>>>>> >>>> endorsed
>>>>> >>>> >> >>> by
>>>>> >>>> >> >>> > >>>> the community.
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>>>>> >>>> could use?
>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux.
>>>>> The
>>>>> >>>> source
>>>>> >>>> >> >>> code of this
>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and structure
>>>>> is
>>>>> >>>> not an
>>>>> >>>> >> >>> ideal fit for
>>>>> >>>> >> >>> > >>>> our requirements)
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> Best,
>>>>> >>>> >> >>> > >>>> Robert
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>> >> >>> > >>>> wrote:
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>>>> creating
>>>>> >>>> a Flink
>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>>> contributors
>>>>> >>>> who
>>>>> >>>> >> >>> have developed
>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>>>> >>>> community.
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>>
>>>>> >>>>
>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>>
>>>>> >>>> >> >>
>>>>> >>>>
>>>>> >>>>
>>>>> >>>>
>>>>> >>>> --
>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>> >>>>
>>>>> >>>> Niels Basjes
>>>>> >>>>
>>>>> >>>
>>>>>
>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Okay, great.

Congxian Qiu, Daryl and I have a kick-off call later today at 2pm CET, 9pm
China time about the design of the ecosystem page (see:
https://github.com/rmetzger/flink-community-tools/issues/4)
Please let me know if others want to join as well, I can add them to the
invite.

On Wed, Mar 20, 2019 at 4:10 AM Becket Qin <be...@gmail.com> wrote:

> I agree. We can start with english-only and see how it goes. The comments
> and descriptions can always be multi-lingual but that is up to the package
> owners.
>
> On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Thanks.
>>
>> Do we actually want this page to be multi-language?
>>
>> I propose to make the website english-only, but maybe consider allowing
>> comments in different languages.
>> If we would make it multi-language, then we might have problems with
>> people submitting packages in non-english languages.
>>
>>
>>
>> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:
>>
>>> Done. The writeup looks great!
>>>
>>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Nice, really good news on the INFRA front!
>>>> I think the hardware specs sound reasonable. And a periodic backup of
>>>> the website's database to Infra's backup solution sounds reasonable too.
>>>>
>>>> Can you accept and review my proposal for the website?
>>>>
>>>>
>>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>>
>>>>> >
>>>>> > I have a very capable and motivated frontend developer who would be
>>>>> > willing to implement what I've mocked in my proposal.
>>>>>
>>>>>
>>>>> That is awesome!
>>>>>
>>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>>>>> that
>>>>> Apache infra team could provide a decent VM. The last piece is how to
>>>>> ensure the data is persisted so we won't lose the project info / user
>>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>>>> persistent storage for DB backup, we can always ask for multiple VMs
>>>>> and do
>>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>>> hardware
>>>>> side is also ready.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Jiangjie (Becket) Qin
>>>>>
>>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>>
>>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>>>> wrote:
>>>>>
>>>>> > Thank you for reaching out to Infra and the ember client.
>>>>> > When I first saw the Ember repository, I thought it is the whole
>>>>> thing
>>>>> > (frontend and backend), but while testing it, I realized it is
>>>>> "only" the
>>>>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>>>>> > client, or just write a simple UI from scratch.
>>>>> > I have a very capable and motivated frontend developer who would be
>>>>> > willing to implement what I've mocked in my proposal.
>>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager
>>>>> to help
>>>>> > with this project for the backend:
>>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>>> >
>>>>> > For Infra: I made the same experience when asking for more GitHub
>>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>>>> list, only
>>>>> > on Jira.
>>>>> >
>>>>> >
>>>>> >
>>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>>>> wrote:
>>>>> >
>>>>> >> Thanks for writing up the specifications.
>>>>> >>
>>>>> >> Regarding the website source code, Austin found a website[1] whose
>>>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>>>> login),
>>>>> >> but it is still a good starting point. One thing is that I did not
>>>>> find a
>>>>> >> License statement for that source code. I'll reach out to the
>>>>> author to see
>>>>> >> if they have any concern over our usage.
>>>>> >>
>>>>> >> Apache Infra has not replied to my email regarding some details
>>>>> about the
>>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>>>> response.
>>>>> >>
>>>>> >> Thanks,
>>>>> >>
>>>>> >> Jiangjie (Becket) Qin
>>>>> >>
>>>>> >> [1] https://emberobserver.com/
>>>>> >> [2] https://github.com/emberobserver/client
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rmetzger@apache.org
>>>>> >
>>>>> >> wrote:
>>>>> >>
>>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>>>> company
>>>>> >>> website. I guess the likelihood that they give out code from their
>>>>> company
>>>>> >>> website is fairly low.
>>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>>>> >>> reactivate as part of this PR:
>>>>> >>> https://github.com/apache/flink-web/pull/187
>>>>> >>>
>>>>> >>> Spark-packages.org did not respond to my request.
>>>>> >>> I will propose a short specification in Becket's initial document.
>>>>> >>>
>>>>> >>>
>>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>>>> wrote:
>>>>> >>>
>>>>> >>>> Hi,
>>>>> >>>>
>>>>> >>>> The Beam project has something in this area that is simply a page
>>>>> >>>> within their documentation website:
>>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>> >>>>
>>>>> >>>> Niels Basjes
>>>>> >>>>
>>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>>>> wrote:
>>>>> >>>> >
>>>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>>>> >>>> personally like it over the spark site. May worth checking it out
>>>>> with
>>>>> >>>> Kafka folks
>>>>> >>>> >
>>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <becket.qin@gmail.com
>>>>> >
>>>>> >>>> wrote:
>>>>> >>>> >>
>>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update
>>>>> the
>>>>> >>>> >> ecosystem page and the navigation.
>>>>> >>>> >>
>>>>> >>>> >> Thanks,
>>>>> >>>> >>
>>>>> >>>> >> Jiangjie (Becket) Qin
>>>>> >>>> >>
>>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>>> rmetzger@apache.org>
>>>>> >>>> wrote:
>>>>> >>>> >>
>>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if
>>>>> they are
>>>>> >>>> willing
>>>>> >>>> >> > to share.
>>>>> >>>> >> >
>>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page
>>>>> (maybe sync
>>>>> >>>> with
>>>>> >>>> >> > the "Software Projects" listed here:
>>>>> >>>> >> >
>>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>>> >>>> and
>>>>> >>>> >> > link it in the navigation?
>>>>> >>>> >> >
>>>>> >>>> >> > Best,
>>>>> >>>> >> > Robert
>>>>> >>>> >> >
>>>>> >>>> >> >
>>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>>> becket.qin@gmail.com>
>>>>> >>>> wrote:
>>>>> >>>> >> >
>>>>> >>>> >> >> Hi Robert,
>>>>> >>>> >> >>
>>>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>>>> owners
>>>>> >>>> are
>>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>>>> requirement
>>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>>> >>>> >> >>
>>>>> >>>> >> >> Since a static page has almost no cost, and we will need it
>>>>> to
>>>>> >>>> redirect
>>>>> >>>> >> >> to the dynamic site anyways, how about we first do that
>>>>> while
>>>>> >>>> working on
>>>>> >>>> >> >> the dynamic website?
>>>>> >>>> >> >>
>>>>> >>>> >> >> Thanks,
>>>>> >>>> >> >>
>>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>>> >>>> >> >>
>>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>>>> >>>> wrote:
>>>>> >>>> >> >>
>>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>>>> >>>> could then
>>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if
>>>>> we
>>>>> >>>> have the
>>>>> >>>> >> >>> resources in the community to quickly start with a dynamic
>>>>> site,
>>>>> >>>> I'm
>>>>> >>>> >> >>> not apposed.
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> – Ufuk
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>>> >>>> rmetzger@apache.org>
>>>>> >>>> >> >>> wrote:
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The
>>>>> VMs
>>>>> >>>> hosted by
>>>>> >>>> >> >>> Infra
>>>>> >>>> >> >>> > look suitable.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>>>> used to
>>>>> >>>> be
>>>>> >>>> >> >>> linked,
>>>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>>>> reason.
>>>>> >>>> This is
>>>>> >>>> >> >>> the
>>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>>> >>>> >> >>> > We could update the page and add it back to the
>>>>> navigation bar
>>>>> >>>> for the
>>>>> >>>> >> >>> > coming weeks. What do you think?
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>>>> away.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel
>>>>> about
>>>>> >>>> sending the
>>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>>> >>>> interested in
>>>>> >>>> >> >>> > sharing the source? We could maintain the code together
>>>>> in a
>>>>> >>>> public
>>>>> >>>> >> >>> repo.
>>>>> >>>> >> >>> > If they are not interested in sharing, or we decide not
>>>>> to ask
>>>>> >>>> in the
>>>>> >>>> >> >>> first
>>>>> >>>> >> >>> > place, I'm happy to write down a short description of the
>>>>> >>>> requirements,
>>>>> >>>> >> >>> > maybe some mockups. We could then see if we find
>>>>> somebody here
>>>>> >>>> in the
>>>>> >>>> >> >>> > community who's willing to implement it.
>>>>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>>>>> >>>> believe we
>>>>> >>>> >> >>> will
>>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>> >> >>> wrote:
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > > Forgot to provide the link...
>>>>> >>>> >> >>> > >
>>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>>>> (Apache
>>>>> >>>> infra
>>>>> >>>> >> >>> services)
>>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>>>>> Jail
>>>>> >>>> provided
>>>>> >>>> >> >>> by
>>>>> >>>> >> >>> > > Apache Infra)
>>>>> >>>> >> >>> > >
>>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>> >> >>> wrote:
>>>>> >>>> >> >>> > >
>>>>> >>>> >> >>> > >> Hi Robert,
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>>>> should
>>>>> >>>> absolutely
>>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>>> interactions in
>>>>> >>>> the
>>>>> >>>> >> >>> community.
>>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>>>> would
>>>>> >>>> be great.
>>>>> >>>> >> >>> TBH,
>>>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>>>> It'll
>>>>> >>>> be great
>>>>> >>>> >> >>> if
>>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>>>> provides
>>>>> >>>> a few
>>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>>>> not see
>>>>> >>>> >> >>> database
>>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>>>> FreeBSD
>>>>> >>>> jail[2].
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>>>> me. We
>>>>> >>>> >> >>> probably need
>>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>>> >>>> provide links
>>>>> >>>> >> >>> it to
>>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
>>>>> that
>>>>> >>>> static
>>>>> >>>> >> >>> page seems
>>>>> >>>> >> >>> > >> something we could start with while we are working on
>>>>> the
>>>>> >>>> dynamic
>>>>> >>>> >> >>> pages.
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> Thanks,
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>>> >>>> wshaoxuan@gmail.com>
>>>>> >>>> >> >>> > >> wrote:
>>>>> >>>> >> >>> > >>
>>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>>> >>>> connectors at
>>>>> >>>> >> >>> the
>>>>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>>>>> >>>> upgrade it
>>>>> >>>> >> >>> when we
>>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>>>> functions.
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>> Regards,
>>>>> >>>> >> >>> > >>> Shaoxuan
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>>> >>>> rmetzger@apache.org
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > >>> wrote:
>>>>> >>>> >> >>> > >>>
>>>>> >>>> >> >>> > >>>> Hey Becket,
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> This is a great idea!
>>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>>>>> page
>>>>> >>>> is placed
>>>>> >>>> >> >>> > >>>> prominently so that the people submitting something
>>>>> will
>>>>> >>>> get
>>>>> >>>> >> >>> attention for
>>>>> >>>> >> >>> > >>>> their contributions.
>>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if
>>>>> we
>>>>> >>>> want
>>>>> >>>> >> >>> features
>>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache
>>>>> infra, and
>>>>> >>>> endorsed
>>>>> >>>> >> >>> by
>>>>> >>>> >> >>> > >>>> the community.
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>>>>> >>>> could use?
>>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>>> >>>> >> >>> https://aur.archlinux.org/
>>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux.
>>>>> The
>>>>> >>>> source
>>>>> >>>> >> >>> code of this
>>>>> >>>> >> >>> > >>>> portal is open source, but the layout and structure
>>>>> is
>>>>> >>>> not an
>>>>> >>>> >> >>> ideal fit for
>>>>> >>>> >> >>> > >>>> our requirements)
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> Best,
>>>>> >>>> >> >>> > >>>> Robert
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>>> >>>> becket.qin@gmail.com>
>>>>> >>>> >> >>> > >>>> wrote:
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>> > >>>>> Hi folks,
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>>>> creating
>>>>> >>>> a Flink
>>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>>> contributors
>>>>> >>>> who
>>>>> >>>> >> >>> have developed
>>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>>>> >>>> community.
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>>
>>>>> >>>>
>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> Thanks,
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>>> >>>> >> >>> > >>>>>
>>>>> >>>> >> >>> > >>>>
>>>>> >>>> >> >>>
>>>>> >>>> >> >>
>>>>> >>>>
>>>>> >>>>
>>>>> >>>>
>>>>> >>>> --
>>>>> >>>> Best regards / Met vriendelijke groeten,
>>>>> >>>>
>>>>> >>>> Niels Basjes
>>>>> >>>>
>>>>> >>>
>>>>>
>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

I agree. We can start with english-only and see how it goes. The comments
and descriptions can always be multi-lingual but that is up to the package
owners.

On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org> wrote:

> Thanks.
>
> Do we actually want this page to be multi-language?
>
> I propose to make the website english-only, but maybe consider allowing
> comments in different languages.
> If we would make it multi-language, then we might have problems with
> people submitting packages in non-english languages.
>
>
>
> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:
>
>> Done. The writeup looks great!
>>
>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Nice, really good news on the INFRA front!
>>> I think the hardware specs sound reasonable. And a periodic backup of
>>> the website's database to Infra's backup solution sounds reasonable too.
>>>
>>> Can you accept and review my proposal for the website?
>>>
>>>
>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> >
>>>> > I have a very capable and motivated frontend developer who would be
>>>> > willing to implement what I've mocked in my proposal.
>>>>
>>>>
>>>> That is awesome!
>>>>
>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>>>> that
>>>> Apache infra team could provide a decent VM. The last piece is how to
>>>> ensure the data is persisted so we won't lose the project info / user
>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>>> persistent storage for DB backup, we can always ask for multiple VMs
>>>> and do
>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>> hardware
>>>> side is also ready.
>>>>
>>>> Thanks,
>>>>
>>>> Jiangjie (Becket) Qin
>>>>
>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>
>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>> > Thank you for reaching out to Infra and the ember client.
>>>> > When I first saw the Ember repository, I thought it is the whole thing
>>>> > (frontend and backend), but while testing it, I realized it is "only"
>>>> the
>>>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>>>> > client, or just write a simple UI from scratch.
>>>> > I have a very capable and motivated frontend developer who would be
>>>> > willing to implement what I've mocked in my proposal.
>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
>>>> help
>>>> > with this project for the backend:
>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>> >
>>>> > For Infra: I made the same experience when asking for more GitHub
>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>>> list, only
>>>> > on Jira.
>>>> >
>>>> >
>>>> >
>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >
>>>> >> Thanks for writing up the specifications.
>>>> >>
>>>> >> Regarding the website source code, Austin found a website[1] whose
>>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>>> login),
>>>> >> but it is still a good starting point. One thing is that I did not
>>>> find a
>>>> >> License statement for that source code. I'll reach out to the author
>>>> to see
>>>> >> if they have any concern over our usage.
>>>> >>
>>>> >> Apache Infra has not replied to my email regarding some details
>>>> about the
>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>>> response.
>>>> >>
>>>> >> Thanks,
>>>> >>
>>>> >> Jiangjie (Becket) Qin
>>>> >>
>>>> >> [1] https://emberobserver.com/
>>>> >> [2] https://github.com/emberobserver/client
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>>>> >> wrote:
>>>> >>
>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>>> company
>>>> >>> website. I guess the likelihood that they give out code from their
>>>> company
>>>> >>> website is fairly low.
>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>>> >>> reactivate as part of this PR:
>>>> >>> https://github.com/apache/flink-web/pull/187
>>>> >>>
>>>> >>> Spark-packages.org did not respond to my request.
>>>> >>> I will propose a short specification in Becket's initial document.
>>>> >>>
>>>> >>>
>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>>> wrote:
>>>> >>>
>>>> >>>> Hi,
>>>> >>>>
>>>> >>>> The Beam project has something in this area that is simply a page
>>>> >>>> within their documentation website:
>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>> >>>>
>>>> >>>> Niels Basjes
>>>> >>>>
>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>>> wrote:
>>>> >>>> >
>>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>>> >>>> personally like it over the spark site. May worth checking it out
>>>> with
>>>> >>>> Kafka folks
>>>> >>>> >
>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update
>>>> the
>>>> >>>> >> ecosystem page and the navigation.
>>>> >>>> >>
>>>> >>>> >> Thanks,
>>>> >>>> >>
>>>> >>>> >> Jiangjie (Becket) Qin
>>>> >>>> >>
>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if they
>>>> are
>>>> >>>> willing
>>>> >>>> >> > to share.
>>>> >>>> >> >
>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
>>>> sync
>>>> >>>> with
>>>> >>>> >> > the "Software Projects" listed here:
>>>> >>>> >> >
>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>> >>>> and
>>>> >>>> >> > link it in the navigation?
>>>> >>>> >> >
>>>> >>>> >> > Best,
>>>> >>>> >> > Robert
>>>> >>>> >> >
>>>> >>>> >> >
>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >>>> wrote:
>>>> >>>> >> >
>>>> >>>> >> >> Hi Robert,
>>>> >>>> >> >>
>>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>>> owners
>>>> >>>> are
>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>>> requirement
>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>> >>>> >> >>
>>>> >>>> >> >> Since a static page has almost no cost, and we will need it
>>>> to
>>>> >>>> redirect
>>>> >>>> >> >> to the dynamic site anyways, how about we first do that while
>>>> >>>> working on
>>>> >>>> >> >> the dynamic website?
>>>> >>>> >> >>
>>>> >>>> >> >> Thanks,
>>>> >>>> >> >>
>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>> >>>> >> >>
>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>>> >>>> wrote:
>>>> >>>> >> >>
>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>>> >>>> could then
>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if
>>>> we
>>>> >>>> have the
>>>> >>>> >> >>> resources in the community to quickly start with a dynamic
>>>> site,
>>>> >>>> I'm
>>>> >>>> >> >>> not apposed.
>>>> >>>> >> >>>
>>>> >>>> >> >>> – Ufuk
>>>> >>>> >> >>>
>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>> >>>> rmetzger@apache.org>
>>>> >>>> >> >>> wrote:
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The
>>>> VMs
>>>> >>>> hosted by
>>>> >>>> >> >>> Infra
>>>> >>>> >> >>> > look suitable.
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>>> used to
>>>> >>>> be
>>>> >>>> >> >>> linked,
>>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>>> reason.
>>>> >>>> This is
>>>> >>>> >> >>> the
>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>> >>>> >> >>> > We could update the page and add it back to the
>>>> navigation bar
>>>> >>>> for the
>>>> >>>> >> >>> > coming weeks. What do you think?
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>>> away.
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>>> >>>> sending the
>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>> >>>> interested in
>>>> >>>> >> >>> > sharing the source? We could maintain the code together
>>>> in a
>>>> >>>> public
>>>> >>>> >> >>> repo.
>>>> >>>> >> >>> > If they are not interested in sharing, or we decide not
>>>> to ask
>>>> >>>> in the
>>>> >>>> >> >>> first
>>>> >>>> >> >>> > place, I'm happy to write down a short description of the
>>>> >>>> requirements,
>>>> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
>>>> here
>>>> >>>> in the
>>>> >>>> >> >>> > community who's willing to implement it.
>>>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>>>> >>>> believe we
>>>> >>>> >> >>> will
>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>> >>>> >> >>> >
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>> >>>> becket.qin@gmail.com>
>>>> >>>> >> >>> wrote:
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > > Forgot to provide the link...
>>>> >>>> >> >>> > >
>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>>> (Apache
>>>> >>>> infra
>>>> >>>> >> >>> services)
>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>>>> Jail
>>>> >>>> provided
>>>> >>>> >> >>> by
>>>> >>>> >> >>> > > Apache Infra)
>>>> >>>> >> >>> > >
>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>> >>>> becket.qin@gmail.com>
>>>> >>>> >> >>> wrote:
>>>> >>>> >> >>> > >
>>>> >>>> >> >>> > >> Hi Robert,
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>>> should
>>>> >>>> absolutely
>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>> interactions in
>>>> >>>> the
>>>> >>>> >> >>> community.
>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>>> would
>>>> >>>> be great.
>>>> >>>> >> >>> TBH,
>>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>>> It'll
>>>> >>>> be great
>>>> >>>> >> >>> if
>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>>> provides
>>>> >>>> a few
>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>>> not see
>>>> >>>> >> >>> database
>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>>> FreeBSD
>>>> >>>> jail[2].
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>>> me. We
>>>> >>>> >> >>> probably need
>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>> >>>> provide links
>>>> >>>> >> >>> it to
>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
>>>> that
>>>> >>>> static
>>>> >>>> >> >>> page seems
>>>> >>>> >> >>> > >> something we could start with while we are working on
>>>> the
>>>> >>>> dynamic
>>>> >>>> >> >>> pages.
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> Thanks,
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>> >>>> wshaoxuan@gmail.com>
>>>> >>>> >> >>> > >> wrote:
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>> >>>> connectors at
>>>> >>>> >> >>> the
>>>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>>>> >>>> upgrade it
>>>> >>>> >> >>> when we
>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>>> functions.
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>> Regards,
>>>> >>>> >> >>> > >>> Shaoxuan
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>> >>>> rmetzger@apache.org
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > >>> wrote:
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>>> Hey Becket,
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> This is a great idea!
>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>>>> page
>>>> >>>> is placed
>>>> >>>> >> >>> > >>>> prominently so that the people submitting something
>>>> will
>>>> >>>> get
>>>> >>>> >> >>> attention for
>>>> >>>> >> >>> > >>>> their contributions.
>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if
>>>> we
>>>> >>>> want
>>>> >>>> >> >>> features
>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra,
>>>> and
>>>> >>>> endorsed
>>>> >>>> >> >>> by
>>>> >>>> >> >>> > >>>> the community.
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>>>> >>>> could use?
>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>> >>>> >> >>> https://aur.archlinux.org/
>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux.
>>>> The
>>>> >>>> source
>>>> >>>> >> >>> code of this
>>>> >>>> >> >>> > >>>> portal is open source, but the layout and structure
>>>> is
>>>> >>>> not an
>>>> >>>> >> >>> ideal fit for
>>>> >>>> >> >>> > >>>> our requirements)
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> Best,
>>>> >>>> >> >>> > >>>> Robert
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>> >>>> becket.qin@gmail.com>
>>>> >>>> >> >>> > >>>> wrote:
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>>> Hi folks,
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>>> creating
>>>> >>>> a Flink
>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>> contributors
>>>> >>>> who
>>>> >>>> >> >>> have developed
>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>>> >>>> community.
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>>
>>>> >>>>
>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> Thanks,
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>>
>>>> >>>> >> >>
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> --
>>>> >>>> Best regards / Met vriendelijke groeten,
>>>> >>>>
>>>> >>>> Niels Basjes
>>>> >>>>
>>>> >>>
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

I agree. We can start with english-only and see how it goes. The comments
and descriptions can always be multi-lingual but that is up to the package
owners.

On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger <rm...@apache.org> wrote:

> Thanks.
>
> Do we actually want this page to be multi-language?
>
> I propose to make the website english-only, but maybe consider allowing
> comments in different languages.
> If we would make it multi-language, then we might have problems with
> people submitting packages in non-english languages.
>
>
>
> On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:
>
>> Done. The writeup looks great!
>>
>> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Nice, really good news on the INFRA front!
>>> I think the hardware specs sound reasonable. And a periodic backup of
>>> the website's database to Infra's backup solution sounds reasonable too.
>>>
>>> Can you accept and review my proposal for the website?
>>>
>>>
>>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> >
>>>> > I have a very capable and motivated frontend developer who would be
>>>> > willing to implement what I've mocked in my proposal.
>>>>
>>>>
>>>> That is awesome!
>>>>
>>>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>>>> that
>>>> Apache infra team could provide a decent VM. The last piece is how to
>>>> ensure the data is persisted so we won't lose the project info / user
>>>> feedbacks when the VM is down. If Apache infra does not provide a
>>>> persistent storage for DB backup, we can always ask for multiple VMs
>>>> and do
>>>> the fault tolerance by ourselves. It seems we can almost say the
>>>> hardware
>>>> side is also ready.
>>>>
>>>> Thanks,
>>>>
>>>> Jiangjie (Becket) Qin
>>>>
>>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>>
>>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>>
>>>> > Thank you for reaching out to Infra and the ember client.
>>>> > When I first saw the Ember repository, I thought it is the whole thing
>>>> > (frontend and backend), but while testing it, I realized it is "only"
>>>> the
>>>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>>>> > client, or just write a simple UI from scratch.
>>>> > I have a very capable and motivated frontend developer who would be
>>>> > willing to implement what I've mocked in my proposal.
>>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
>>>> help
>>>> > with this project for the backend:
>>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>>> >
>>>> > For Infra: I made the same experience when asking for more GitHub
>>>> > permissions for "flinkbot": They didn't respond on their mailing
>>>> list, only
>>>> > on Jira.
>>>> >
>>>> >
>>>> >
>>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >
>>>> >> Thanks for writing up the specifications.
>>>> >>
>>>> >> Regarding the website source code, Austin found a website[1] whose
>>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>>> login),
>>>> >> but it is still a good starting point. One thing is that I did not
>>>> find a
>>>> >> License statement for that source code. I'll reach out to the author
>>>> to see
>>>> >> if they have any concern over our usage.
>>>> >>
>>>> >> Apache Infra has not replied to my email regarding some details
>>>> about the
>>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>>> response.
>>>> >>
>>>> >> Thanks,
>>>> >>
>>>> >> Jiangjie (Becket) Qin
>>>> >>
>>>> >> [1] https://emberobserver.com/
>>>> >> [2] https://github.com/emberobserver/client
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>>>> >> wrote:
>>>> >>
>>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>>> company
>>>> >>> website. I guess the likelihood that they give out code from their
>>>> company
>>>> >>> website is fairly low.
>>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>>> >>> reactivate as part of this PR:
>>>> >>> https://github.com/apache/flink-web/pull/187
>>>> >>>
>>>> >>> Spark-packages.org did not respond to my request.
>>>> >>> I will propose a short specification in Becket's initial document.
>>>> >>>
>>>> >>>
>>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>>> wrote:
>>>> >>>
>>>> >>>> Hi,
>>>> >>>>
>>>> >>>> The Beam project has something in this area that is simply a page
>>>> >>>> within their documentation website:
>>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>> >>>>
>>>> >>>> Niels Basjes
>>>> >>>>
>>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>>> wrote:
>>>> >>>> >
>>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>>> >>>> personally like it over the spark site. May worth checking it out
>>>> with
>>>> >>>> Kafka folks
>>>> >>>> >
>>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update
>>>> the
>>>> >>>> >> ecosystem page and the navigation.
>>>> >>>> >>
>>>> >>>> >> Thanks,
>>>> >>>> >>
>>>> >>>> >> Jiangjie (Becket) Qin
>>>> >>>> >>
>>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if they
>>>> are
>>>> >>>> willing
>>>> >>>> >> > to share.
>>>> >>>> >> >
>>>> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
>>>> sync
>>>> >>>> with
>>>> >>>> >> > the "Software Projects" listed here:
>>>> >>>> >> >
>>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>> >>>> and
>>>> >>>> >> > link it in the navigation?
>>>> >>>> >> >
>>>> >>>> >> > Best,
>>>> >>>> >> > Robert
>>>> >>>> >> >
>>>> >>>> >> >
>>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >>>> wrote:
>>>> >>>> >> >
>>>> >>>> >> >> Hi Robert,
>>>> >>>> >> >>
>>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>>> owners
>>>> >>>> are
>>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>>> requirement
>>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>>> >>>> >> >>
>>>> >>>> >> >> Since a static page has almost no cost, and we will need it
>>>> to
>>>> >>>> redirect
>>>> >>>> >> >> to the dynamic site anyways, how about we first do that while
>>>> >>>> working on
>>>> >>>> >> >> the dynamic website?
>>>> >>>> >> >>
>>>> >>>> >> >> Thanks,
>>>> >>>> >> >>
>>>> >>>> >> >> Jiangjie (Becket) Qin
>>>> >>>> >> >>
>>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>>> >>>> wrote:
>>>> >>>> >> >>
>>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>>> >>>> could then
>>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if
>>>> we
>>>> >>>> have the
>>>> >>>> >> >>> resources in the community to quickly start with a dynamic
>>>> site,
>>>> >>>> I'm
>>>> >>>> >> >>> not apposed.
>>>> >>>> >> >>>
>>>> >>>> >> >>> – Ufuk
>>>> >>>> >> >>>
>>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>> >>>> rmetzger@apache.org>
>>>> >>>> >> >>> wrote:
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The
>>>> VMs
>>>> >>>> hosted by
>>>> >>>> >> >>> Infra
>>>> >>>> >> >>> > look suitable.
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>>> used to
>>>> >>>> be
>>>> >>>> >> >>> linked,
>>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>>> reason.
>>>> >>>> This is
>>>> >>>> >> >>> the
>>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>> >>>> >> >>> > We could update the page and add it back to the
>>>> navigation bar
>>>> >>>> for the
>>>> >>>> >> >>> > coming weeks. What do you think?
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>>> away.
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>>> >>>> sending the
>>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>> >>>> interested in
>>>> >>>> >> >>> > sharing the source? We could maintain the code together
>>>> in a
>>>> >>>> public
>>>> >>>> >> >>> repo.
>>>> >>>> >> >>> > If they are not interested in sharing, or we decide not
>>>> to ask
>>>> >>>> in the
>>>> >>>> >> >>> first
>>>> >>>> >> >>> > place, I'm happy to write down a short description of the
>>>> >>>> requirements,
>>>> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
>>>> here
>>>> >>>> in the
>>>> >>>> >> >>> > community who's willing to implement it.
>>>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>>>> >>>> believe we
>>>> >>>> >> >>> will
>>>> >>>> >> >>> > be able to find somebody pretty soon.
>>>> >>>> >> >>> >
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>> >>>> becket.qin@gmail.com>
>>>> >>>> >> >>> wrote:
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > > Forgot to provide the link...
>>>> >>>> >> >>> > >
>>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>>> (Apache
>>>> >>>> infra
>>>> >>>> >> >>> services)
>>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>>>> Jail
>>>> >>>> provided
>>>> >>>> >> >>> by
>>>> >>>> >> >>> > > Apache Infra)
>>>> >>>> >> >>> > >
>>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>> >>>> becket.qin@gmail.com>
>>>> >>>> >> >>> wrote:
>>>> >>>> >> >>> > >
>>>> >>>> >> >>> > >> Hi Robert,
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>>> should
>>>> >>>> absolutely
>>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>>> interactions in
>>>> >>>> the
>>>> >>>> >> >>> community.
>>>> >>>> >> >>> > >> There might be a few things to solve:
>>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>>> would
>>>> >>>> be great.
>>>> >>>> >> >>> TBH,
>>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>>> It'll
>>>> >>>> be great
>>>> >>>> >> >>> if
>>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>>> provides
>>>> >>>> a few
>>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>>> not see
>>>> >>>> >> >>> database
>>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>>> FreeBSD
>>>> >>>> jail[2].
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>>> me. We
>>>> >>>> >> >>> probably need
>>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>> >>>> provide links
>>>> >>>> >> >>> it to
>>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in
>>>> that
>>>> >>>> static
>>>> >>>> >> >>> page seems
>>>> >>>> >> >>> > >> something we could start with while we are working on
>>>> the
>>>> >>>> dynamic
>>>> >>>> >> >>> pages.
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> Thanks,
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>> >>>> wshaoxuan@gmail.com>
>>>> >>>> >> >>> > >> wrote:
>>>> >>>> >> >>> > >>
>>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>> >>>> connectors at
>>>> >>>> >> >>> the
>>>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>>>> >>>> upgrade it
>>>> >>>> >> >>> when we
>>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>>> functions.
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>> Regards,
>>>> >>>> >> >>> > >>> Shaoxuan
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>> >>>> rmetzger@apache.org
>>>> >>>> >> >>> >
>>>> >>>> >> >>> > >>> wrote:
>>>> >>>> >> >>> > >>>
>>>> >>>> >> >>> > >>>> Hey Becket,
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> This is a great idea!
>>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>>>> page
>>>> >>>> is placed
>>>> >>>> >> >>> > >>>> prominently so that the people submitting something
>>>> will
>>>> >>>> get
>>>> >>>> >> >>> attention for
>>>> >>>> >> >>> > >>>> their contributions.
>>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if
>>>> we
>>>> >>>> want
>>>> >>>> >> >>> features
>>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra,
>>>> and
>>>> >>>> endorsed
>>>> >>>> >> >>> by
>>>> >>>> >> >>> > >>>> the community.
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>>>> >>>> could use?
>>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>> >>>> >> >>> https://aur.archlinux.org/
>>>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux.
>>>> The
>>>> >>>> source
>>>> >>>> >> >>> code of this
>>>> >>>> >> >>> > >>>> portal is open source, but the layout and structure
>>>> is
>>>> >>>> not an
>>>> >>>> >> >>> ideal fit for
>>>> >>>> >> >>> > >>>> our requirements)
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> Best,
>>>> >>>> >> >>> > >>>> Robert
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>> >>>> becket.qin@gmail.com>
>>>> >>>> >> >>> > >>>> wrote:
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>> > >>>>> Hi folks,
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>>> creating
>>>> >>>> a Flink
>>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>>> contributors
>>>> >>>> who
>>>> >>>> >> >>> have developed
>>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>>> >>>> community.
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>>
>>>> >>>>
>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> Thanks,
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>> >>>> >> >>> > >>>>>
>>>> >>>> >> >>> > >>>>
>>>> >>>> >> >>>
>>>> >>>> >> >>
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> --
>>>> >>>> Best regards / Met vriendelijke groeten,
>>>> >>>>
>>>> >>>> Niels Basjes
>>>> >>>>
>>>> >>>
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Thanks.

Do we actually want this page to be multi-language?

I propose to make the website english-only, but maybe consider allowing
comments in different languages.
If we would make it multi-language, then we might have problems with people
submitting packages in non-english languages.



On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:

> Done. The writeup looks great!
>
> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Nice, really good news on the INFRA front!
>> I think the hardware specs sound reasonable. And a periodic backup of the
>> website's database to Infra's backup solution sounds reasonable too.
>>
>> Can you accept and review my proposal for the website?
>>
>>
>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:
>>
>>> >
>>> > I have a very capable and motivated frontend developer who would be
>>> > willing to implement what I've mocked in my proposal.
>>>
>>>
>>> That is awesome!
>>>
>>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>>> that
>>> Apache infra team could provide a decent VM. The last piece is how to
>>> ensure the data is persisted so we won't lose the project info / user
>>> feedbacks when the VM is down. If Apache infra does not provide a
>>> persistent storage for DB backup, we can always ask for multiple VMs and
>>> do
>>> the fault tolerance by ourselves. It seems we can almost say the hardware
>>> side is also ready.
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>
>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>> > Thank you for reaching out to Infra and the ember client.
>>> > When I first saw the Ember repository, I thought it is the whole thing
>>> > (frontend and backend), but while testing it, I realized it is "only"
>>> the
>>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>>> > client, or just write a simple UI from scratch.
>>> > I have a very capable and motivated frontend developer who would be
>>> > willing to implement what I've mocked in my proposal.
>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
>>> help
>>> > with this project for the backend:
>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>> >
>>> > For Infra: I made the same experience when asking for more GitHub
>>> > permissions for "flinkbot": They didn't respond on their mailing list,
>>> only
>>> > on Jira.
>>> >
>>> >
>>> >
>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >
>>> >> Thanks for writing up the specifications.
>>> >>
>>> >> Regarding the website source code, Austin found a website[1] whose
>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>> login),
>>> >> but it is still a good starting point. One thing is that I did not
>>> find a
>>> >> License statement for that source code. I'll reach out to the author
>>> to see
>>> >> if they have any concern over our usage.
>>> >>
>>> >> Apache Infra has not replied to my email regarding some details about
>>> the
>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>> response.
>>> >>
>>> >> Thanks,
>>> >>
>>> >> Jiangjie (Becket) Qin
>>> >>
>>> >> [1] https://emberobserver.com/
>>> >> [2] https://github.com/emberobserver/client
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>>> >> wrote:
>>> >>
>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>> company
>>> >>> website. I guess the likelihood that they give out code from their
>>> company
>>> >>> website is fairly low.
>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>> >>> reactivate as part of this PR:
>>> >>> https://github.com/apache/flink-web/pull/187
>>> >>>
>>> >>> Spark-packages.org did not respond to my request.
>>> >>> I will propose a short specification in Becket's initial document.
>>> >>>
>>> >>>
>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>> wrote:
>>> >>>
>>> >>>> Hi,
>>> >>>>
>>> >>>> The Beam project has something in this area that is simply a page
>>> >>>> within their documentation website:
>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>> >>>>
>>> >>>> Niels Basjes
>>> >>>>
>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>> wrote:
>>> >>>> >
>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>> >>>> personally like it over the spark site. May worth checking it out
>>> with
>>> >>>> Kafka folks
>>> >>>> >
>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update
>>> the
>>> >>>> >> ecosystem page and the navigation.
>>> >>>> >>
>>> >>>> >> Thanks,
>>> >>>> >>
>>> >>>> >> Jiangjie (Becket) Qin
>>> >>>> >>
>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>> rmetzger@apache.org>
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if they
>>> are
>>> >>>> willing
>>> >>>> >> > to share.
>>> >>>> >> >
>>> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
>>> sync
>>> >>>> with
>>> >>>> >> > the "Software Projects" listed here:
>>> >>>> >> >
>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>> >>>> and
>>> >>>> >> > link it in the navigation?
>>> >>>> >> >
>>> >>>> >> > Best,
>>> >>>> >> > Robert
>>> >>>> >> >
>>> >>>> >> >
>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>> becket.qin@gmail.com>
>>> >>>> wrote:
>>> >>>> >> >
>>> >>>> >> >> Hi Robert,
>>> >>>> >> >>
>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>> owners
>>> >>>> are
>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>> requirement
>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>> >>>> >> >>
>>> >>>> >> >> Since a static page has almost no cost, and we will need it to
>>> >>>> redirect
>>> >>>> >> >> to the dynamic site anyways, how about we first do that while
>>> >>>> working on
>>> >>>> >> >> the dynamic website?
>>> >>>> >> >>
>>> >>>> >> >> Thanks,
>>> >>>> >> >>
>>> >>>> >> >> Jiangjie (Becket) Qin
>>> >>>> >> >>
>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>> >>>> wrote:
>>> >>>> >> >>
>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>> >>>> could then
>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>>> >>>> have the
>>> >>>> >> >>> resources in the community to quickly start with a dynamic
>>> site,
>>> >>>> I'm
>>> >>>> >> >>> not apposed.
>>> >>>> >> >>>
>>> >>>> >> >>> – Ufuk
>>> >>>> >> >>>
>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>> >>>> rmetzger@apache.org>
>>> >>>> >> >>> wrote:
>>> >>>> >> >>> >
>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>>> >>>> hosted by
>>> >>>> >> >>> Infra
>>> >>>> >> >>> > look suitable.
>>> >>>> >> >>> >
>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>> used to
>>> >>>> be
>>> >>>> >> >>> linked,
>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>> reason.
>>> >>>> This is
>>> >>>> >> >>> the
>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>> >>>> >> >>> > We could update the page and add it back to the navigation
>>> bar
>>> >>>> for the
>>> >>>> >> >>> > coming weeks. What do you think?
>>> >>>> >> >>> >
>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>> away.
>>> >>>> >> >>> >
>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>> >>>> sending the
>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>> >>>> interested in
>>> >>>> >> >>> > sharing the source? We could maintain the code together in
>>> a
>>> >>>> public
>>> >>>> >> >>> repo.
>>> >>>> >> >>> > If they are not interested in sharing, or we decide not to
>>> ask
>>> >>>> in the
>>> >>>> >> >>> first
>>> >>>> >> >>> > place, I'm happy to write down a short description of the
>>> >>>> requirements,
>>> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
>>> here
>>> >>>> in the
>>> >>>> >> >>> > community who's willing to implement it.
>>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>>> >>>> believe we
>>> >>>> >> >>> will
>>> >>>> >> >>> > be able to find somebody pretty soon.
>>> >>>> >> >>> >
>>> >>>> >> >>> >
>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>> >>>> becket.qin@gmail.com>
>>> >>>> >> >>> wrote:
>>> >>>> >> >>> >
>>> >>>> >> >>> > > Forgot to provide the link...
>>> >>>> >> >>> > >
>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>> (Apache
>>> >>>> infra
>>> >>>> >> >>> services)
>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>>> Jail
>>> >>>> provided
>>> >>>> >> >>> by
>>> >>>> >> >>> > > Apache Infra)
>>> >>>> >> >>> > >
>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>> >>>> becket.qin@gmail.com>
>>> >>>> >> >>> wrote:
>>> >>>> >> >>> > >
>>> >>>> >> >>> > >> Hi Robert,
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>> should
>>> >>>> absolutely
>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>> interactions in
>>> >>>> the
>>> >>>> >> >>> community.
>>> >>>> >> >>> > >> There might be a few things to solve:
>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>> would
>>> >>>> be great.
>>> >>>> >> >>> TBH,
>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>> It'll
>>> >>>> be great
>>> >>>> >> >>> if
>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>> provides
>>> >>>> a few
>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>> not see
>>> >>>> >> >>> database
>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>> FreeBSD
>>> >>>> jail[2].
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>> me. We
>>> >>>> >> >>> probably need
>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>> >>>> provide links
>>> >>>> >> >>> it to
>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>>> >>>> static
>>> >>>> >> >>> page seems
>>> >>>> >> >>> > >> something we could start with while we are working on
>>> the
>>> >>>> dynamic
>>> >>>> >> >>> pages.
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> Thanks,
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>> >>>> wshaoxuan@gmail.com>
>>> >>>> >> >>> > >> wrote:
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>> >>>> connectors at
>>> >>>> >> >>> the
>>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>>> >>>> upgrade it
>>> >>>> >> >>> when we
>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>> functions.
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>> Regards,
>>> >>>> >> >>> > >>> Shaoxuan
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>> >>>> rmetzger@apache.org
>>> >>>> >> >>> >
>>> >>>> >> >>> > >>> wrote:
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>>> Hey Becket,
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> This is a great idea!
>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>>> page
>>> >>>> is placed
>>> >>>> >> >>> > >>>> prominently so that the people submitting something
>>> will
>>> >>>> get
>>> >>>> >> >>> attention for
>>> >>>> >> >>> > >>>> their contributions.
>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
>>> >>>> want
>>> >>>> >> >>> features
>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra,
>>> and
>>> >>>> endorsed
>>> >>>> >> >>> by
>>> >>>> >> >>> > >>>> the community.
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>>> >>>> could use?
>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>> >>>> >> >>> https://aur.archlinux.org/
>>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux.
>>> The
>>> >>>> source
>>> >>>> >> >>> code of this
>>> >>>> >> >>> > >>>> portal is open source, but the layout and structure is
>>> >>>> not an
>>> >>>> >> >>> ideal fit for
>>> >>>> >> >>> > >>>> our requirements)
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> Best,
>>> >>>> >> >>> > >>>> Robert
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>> >>>> becket.qin@gmail.com>
>>> >>>> >> >>> > >>>> wrote:
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>>> Hi folks,
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>> creating
>>> >>>> a Flink
>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>> contributors
>>> >>>> who
>>> >>>> >> >>> have developed
>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>> >>>> community.
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>>
>>> >>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> Thanks,
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>>
>>> >>>> >> >>
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> --
>>> >>>> Best regards / Met vriendelijke groeten,
>>> >>>>
>>> >>>> Niels Basjes
>>> >>>>
>>> >>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Thanks.

Do we actually want this page to be multi-language?

I propose to make the website english-only, but maybe consider allowing
comments in different languages.
If we would make it multi-language, then we might have problems with people
submitting packages in non-english languages.



On Tue, Mar 19, 2019 at 2:42 AM Becket Qin <be...@gmail.com> wrote:

> Done. The writeup looks great!
>
> On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org>
> wrote:
>
>> Nice, really good news on the INFRA front!
>> I think the hardware specs sound reasonable. And a periodic backup of the
>> website's database to Infra's backup solution sounds reasonable too.
>>
>> Can you accept and review my proposal for the website?
>>
>>
>> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:
>>
>>> >
>>> > I have a very capable and motivated frontend developer who would be
>>> > willing to implement what I've mocked in my proposal.
>>>
>>>
>>> That is awesome!
>>>
>>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>>> that
>>> Apache infra team could provide a decent VM. The last piece is how to
>>> ensure the data is persisted so we won't lose the project info / user
>>> feedbacks when the VM is down. If Apache infra does not provide a
>>> persistent storage for DB backup, we can always ask for multiple VMs and
>>> do
>>> the fault tolerance by ourselves. It seems we can almost say the hardware
>>> side is also ready.
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>>
>>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>> > Thank you for reaching out to Infra and the ember client.
>>> > When I first saw the Ember repository, I thought it is the whole thing
>>> > (frontend and backend), but while testing it, I realized it is "only"
>>> the
>>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>>> > client, or just write a simple UI from scratch.
>>> > I have a very capable and motivated frontend developer who would be
>>> > willing to implement what I've mocked in my proposal.
>>> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
>>> help
>>> > with this project for the backend:
>>> > https://github.com/rmetzger/flink-community-tools/issues/4
>>> >
>>> > For Infra: I made the same experience when asking for more GitHub
>>> > permissions for "flinkbot": They didn't respond on their mailing list,
>>> only
>>> > on Jira.
>>> >
>>> >
>>> >
>>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >
>>> >> Thanks for writing up the specifications.
>>> >>
>>> >> Regarding the website source code, Austin found a website[1] whose
>>> >> frontend code[2] is available publicly. It lacks some support (e.g
>>> login),
>>> >> but it is still a good starting point. One thing is that I did not
>>> find a
>>> >> License statement for that source code. I'll reach out to the author
>>> to see
>>> >> if they have any concern over our usage.
>>> >>
>>> >> Apache Infra has not replied to my email regarding some details about
>>> the
>>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>>> response.
>>> >>
>>> >> Thanks,
>>> >>
>>> >> Jiangjie (Becket) Qin
>>> >>
>>> >> [1] https://emberobserver.com/
>>> >> [2] https://github.com/emberobserver/client
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>>> >> wrote:
>>> >>
>>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their
>>> company
>>> >>> website. I guess the likelihood that they give out code from their
>>> company
>>> >>> website is fairly low.
>>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>> >>> reactivate as part of this PR:
>>> >>> https://github.com/apache/flink-web/pull/187
>>> >>>
>>> >>> Spark-packages.org did not respond to my request.
>>> >>> I will propose a short specification in Becket's initial document.
>>> >>>
>>> >>>
>>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>>> wrote:
>>> >>>
>>> >>>> Hi,
>>> >>>>
>>> >>>> The Beam project has something in this area that is simply a page
>>> >>>> within their documentation website:
>>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>> >>>>
>>> >>>> Niels Basjes
>>> >>>>
>>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>>> wrote:
>>> >>>> >
>>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>>> >>>> personally like it over the spark site. May worth checking it out
>>> with
>>> >>>> Kafka folks
>>> >>>> >
>>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update
>>> the
>>> >>>> >> ecosystem page and the navigation.
>>> >>>> >>
>>> >>>> >> Thanks,
>>> >>>> >>
>>> >>>> >> Jiangjie (Becket) Qin
>>> >>>> >>
>>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>>> rmetzger@apache.org>
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >> > Okay. I will reach out to spark-packages.org and see if they
>>> are
>>> >>>> willing
>>> >>>> >> > to share.
>>> >>>> >> >
>>> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
>>> sync
>>> >>>> with
>>> >>>> >> > the "Software Projects" listed here:
>>> >>>> >> >
>>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>> >>>> and
>>> >>>> >> > link it in the navigation?
>>> >>>> >> >
>>> >>>> >> > Best,
>>> >>>> >> > Robert
>>> >>>> >> >
>>> >>>> >> >
>>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>>> becket.qin@gmail.com>
>>> >>>> wrote:
>>> >>>> >> >
>>> >>>> >> >> Hi Robert,
>>> >>>> >> >>
>>> >>>> >> >> I think it at least worths checking if spark-packages.org
>>> owners
>>> >>>> are
>>> >>>> >> >> willing to share. Thanks for volunteering to write the
>>> requirement
>>> >>>> >> >> descriptions! In any case, that will be very helpful.
>>> >>>> >> >>
>>> >>>> >> >> Since a static page has almost no cost, and we will need it to
>>> >>>> redirect
>>> >>>> >> >> to the dynamic site anyways, how about we first do that while
>>> >>>> working on
>>> >>>> >> >> the dynamic website?
>>> >>>> >> >>
>>> >>>> >> >> Thanks,
>>> >>>> >> >>
>>> >>>> >> >> Jiangjie (Becket) Qin
>>> >>>> >> >>
>>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>> >>>> wrote:
>>> >>>> >> >>
>>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>> >>>> could then
>>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>>> >>>> have the
>>> >>>> >> >>> resources in the community to quickly start with a dynamic
>>> site,
>>> >>>> I'm
>>> >>>> >> >>> not apposed.
>>> >>>> >> >>>
>>> >>>> >> >>> – Ufuk
>>> >>>> >> >>>
>>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>> >>>> rmetzger@apache.org>
>>> >>>> >> >>> wrote:
>>> >>>> >> >>> >
>>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>>> >>>> hosted by
>>> >>>> >> >>> Infra
>>> >>>> >> >>> > look suitable.
>>> >>>> >> >>> >
>>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It
>>> used to
>>> >>>> be
>>> >>>> >> >>> linked,
>>> >>>> >> >>> > but has been removed from the navigation bar for some
>>> reason.
>>> >>>> This is
>>> >>>> >> >>> the
>>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>> >>>> >> >>> > We could update the page and add it back to the navigation
>>> bar
>>> >>>> for the
>>> >>>> >> >>> > coming weeks. What do you think?
>>> >>>> >> >>> >
>>> >>>> >> >>> > I would actually like to push for a dynamic page right
>>> away.
>>> >>>> >> >>> >
>>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>> >>>> sending the
>>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>>> >>>> interested in
>>> >>>> >> >>> > sharing the source? We could maintain the code together in
>>> a
>>> >>>> public
>>> >>>> >> >>> repo.
>>> >>>> >> >>> > If they are not interested in sharing, or we decide not to
>>> ask
>>> >>>> in the
>>> >>>> >> >>> first
>>> >>>> >> >>> > place, I'm happy to write down a short description of the
>>> >>>> requirements,
>>> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
>>> here
>>> >>>> in the
>>> >>>> >> >>> > community who's willing to implement it.
>>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>>> >>>> believe we
>>> >>>> >> >>> will
>>> >>>> >> >>> > be able to find somebody pretty soon.
>>> >>>> >> >>> >
>>> >>>> >> >>> >
>>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>> >>>> becket.qin@gmail.com>
>>> >>>> >> >>> wrote:
>>> >>>> >> >>> >
>>> >>>> >> >>> > > Forgot to provide the link...
>>> >>>> >> >>> > >
>>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>>> (Apache
>>> >>>> infra
>>> >>>> >> >>> services)
>>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>>> Jail
>>> >>>> provided
>>> >>>> >> >>> by
>>> >>>> >> >>> > > Apache Infra)
>>> >>>> >> >>> > >
>>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>> >>>> becket.qin@gmail.com>
>>> >>>> >> >>> wrote:
>>> >>>> >> >>> > >
>>> >>>> >> >>> > >> Hi Robert,
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We
>>> should
>>> >>>> absolutely
>>> >>>> >> >>> > >> shoot for a dynamic website to support more
>>> interactions in
>>> >>>> the
>>> >>>> >> >>> community.
>>> >>>> >> >>> > >> There might be a few things to solve:
>>> >>>> >> >>> > >> 1. The website code itself. An open source solution
>>> would
>>> >>>> be great.
>>> >>>> >> >>> TBH,
>>> >>>> >> >>> > >> I do not have much experience on building a website.
>>> It'll
>>> >>>> be great
>>> >>>> >> >>> if
>>> >>>> >> >>> > >> someone could help comment on the solution here.
>>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>>> provides
>>> >>>> a few
>>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did
>>> not see
>>> >>>> >> >>> database
>>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>>> FreeBSD
>>> >>>> jail[2].
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to
>>> me. We
>>> >>>> >> >>> probably need
>>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>>> >>>> provide links
>>> >>>> >> >>> it to
>>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>>> >>>> static
>>> >>>> >> >>> page seems
>>> >>>> >> >>> > >> something we could start with while we are working on
>>> the
>>> >>>> dynamic
>>> >>>> >> >>> pages.
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> Thanks,
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>> >>>> wshaoxuan@gmail.com>
>>> >>>> >> >>> > >> wrote:
>>> >>>> >> >>> > >>
>>> >>>> >> >>> > >>> Hi Becket and Robert,
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>> >>>> connectors at
>>> >>>> >> >>> the
>>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>>> >>>> upgrade it
>>> >>>> >> >>> when we
>>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>>> functions.
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>> Regards,
>>> >>>> >> >>> > >>> Shaoxuan
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>> >>>> rmetzger@apache.org
>>> >>>> >> >>> >
>>> >>>> >> >>> > >>> wrote:
>>> >>>> >> >>> > >>>
>>> >>>> >> >>> > >>>> Hey Becket,
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> This is a great idea!
>>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>>> page
>>> >>>> is placed
>>> >>>> >> >>> > >>>> prominently so that the people submitting something
>>> will
>>> >>>> get
>>> >>>> >> >>> attention for
>>> >>>> >> >>> > >>>> their contributions.
>>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
>>> >>>> want
>>> >>>> >> >>> features
>>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra,
>>> and
>>> >>>> endorsed
>>> >>>> >> >>> by
>>> >>>> >> >>> > >>>> the community.
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>>> >>>> could use?
>>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>>> >>>> >> >>> https://aur.archlinux.org/
>>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux.
>>> The
>>> >>>> source
>>> >>>> >> >>> code of this
>>> >>>> >> >>> > >>>> portal is open source, but the layout and structure is
>>> >>>> not an
>>> >>>> >> >>> ideal fit for
>>> >>>> >> >>> > >>>> our requirements)
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> Best,
>>> >>>> >> >>> > >>>> Robert
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>> >>>> becket.qin@gmail.com>
>>> >>>> >> >>> > >>>> wrote:
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>> > >>>>> Hi folks,
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>>> creating
>>> >>>> a Flink
>>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>>> contributors
>>> >>>> who
>>> >>>> >> >>> have developed
>>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>>> >>>> community.
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>>
>>> >>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> Thanks,
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>> >>>> >> >>> > >>>>>
>>> >>>> >> >>> > >>>>
>>> >>>> >> >>>
>>> >>>> >> >>
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> --
>>> >>>> Best regards / Met vriendelijke groeten,
>>> >>>>
>>> >>>> Niels Basjes
>>> >>>>
>>> >>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Done. The writeup looks great!

On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org> wrote:

> Nice, really good news on the INFRA front!
> I think the hardware specs sound reasonable. And a periodic backup of the
> website's database to Infra's backup solution sounds reasonable too.
>
> Can you accept and review my proposal for the website?
>
>
> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:
>
>> >
>> > I have a very capable and motivated frontend developer who would be
>> > willing to implement what I've mocked in my proposal.
>>
>>
>> That is awesome!
>>
>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>> that
>> Apache infra team could provide a decent VM. The last piece is how to
>> ensure the data is persisted so we won't lose the project info / user
>> feedbacks when the VM is down. If Apache infra does not provide a
>> persistent storage for DB backup, we can always ask for multiple VMs and
>> do
>> the fault tolerance by ourselves. It seems we can almost say the hardware
>> side is also ready.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>
>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>> > Thank you for reaching out to Infra and the ember client.
>> > When I first saw the Ember repository, I thought it is the whole thing
>> > (frontend and backend), but while testing it, I realized it is "only"
>> the
>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>> > client, or just write a simple UI from scratch.
>> > I have a very capable and motivated frontend developer who would be
>> > willing to implement what I've mocked in my proposal.
>> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
>> help
>> > with this project for the backend:
>> > https://github.com/rmetzger/flink-community-tools/issues/4
>> >
>> > For Infra: I made the same experience when asking for more GitHub
>> > permissions for "flinkbot": They didn't respond on their mailing list,
>> only
>> > on Jira.
>> >
>> >
>> >
>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>> wrote:
>> >
>> >> Thanks for writing up the specifications.
>> >>
>> >> Regarding the website source code, Austin found a website[1] whose
>> >> frontend code[2] is available publicly. It lacks some support (e.g
>> login),
>> >> but it is still a good starting point. One thing is that I did not
>> find a
>> >> License statement for that source code. I'll reach out to the author
>> to see
>> >> if they have any concern over our usage.
>> >>
>> >> Apache Infra has not replied to my email regarding some details about
>> the
>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>> response.
>> >>
>> >> Thanks,
>> >>
>> >> Jiangjie (Becket) Qin
>> >>
>> >> [1] https://emberobserver.com/
>> >> [2] https://github.com/emberobserver/client
>> >>
>> >>
>> >>
>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>> >> wrote:
>> >>
>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
>> >>> website. I guess the likelihood that they give out code from their
>> company
>> >>> website is fairly low.
>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>> >>> reactivate as part of this PR:
>> >>> https://github.com/apache/flink-web/pull/187
>> >>>
>> >>> Spark-packages.org did not respond to my request.
>> >>> I will propose a short specification in Becket's initial document.
>> >>>
>> >>>
>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>> wrote:
>> >>>
>> >>>> Hi,
>> >>>>
>> >>>> The Beam project has something in this area that is simply a page
>> >>>> within their documentation website:
>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>> >>>>
>> >>>> Niels Basjes
>> >>>>
>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>> wrote:
>> >>>> >
>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>> >>>> personally like it over the spark site. May worth checking it out
>> with
>> >>>> Kafka folks
>> >>>> >
>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>> >>>> wrote:
>> >>>> >>
>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>> >>>> >> ecosystem page and the navigation.
>> >>>> >>
>> >>>> >> Thanks,
>> >>>> >>
>> >>>> >> Jiangjie (Becket) Qin
>> >>>> >>
>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>> rmetzger@apache.org>
>> >>>> wrote:
>> >>>> >>
>> >>>> >> > Okay. I will reach out to spark-packages.org and see if they
>> are
>> >>>> willing
>> >>>> >> > to share.
>> >>>> >> >
>> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
>> sync
>> >>>> with
>> >>>> >> > the "Software Projects" listed here:
>> >>>> >> >
>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>> >>>> and
>> >>>> >> > link it in the navigation?
>> >>>> >> >
>> >>>> >> > Best,
>> >>>> >> > Robert
>> >>>> >> >
>> >>>> >> >
>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>> becket.qin@gmail.com>
>> >>>> wrote:
>> >>>> >> >
>> >>>> >> >> Hi Robert,
>> >>>> >> >>
>> >>>> >> >> I think it at least worths checking if spark-packages.org
>> owners
>> >>>> are
>> >>>> >> >> willing to share. Thanks for volunteering to write the
>> requirement
>> >>>> >> >> descriptions! In any case, that will be very helpful.
>> >>>> >> >>
>> >>>> >> >> Since a static page has almost no cost, and we will need it to
>> >>>> redirect
>> >>>> >> >> to the dynamic site anyways, how about we first do that while
>> >>>> working on
>> >>>> >> >> the dynamic website?
>> >>>> >> >>
>> >>>> >> >> Thanks,
>> >>>> >> >>
>> >>>> >> >> Jiangjie (Becket) Qin
>> >>>> >> >>
>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>> >>>> wrote:
>> >>>> >> >>
>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>> >>>> could then
>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>> >>>> have the
>> >>>> >> >>> resources in the community to quickly start with a dynamic
>> site,
>> >>>> I'm
>> >>>> >> >>> not apposed.
>> >>>> >> >>>
>> >>>> >> >>> – Ufuk
>> >>>> >> >>>
>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>> >>>> rmetzger@apache.org>
>> >>>> >> >>> wrote:
>> >>>> >> >>> >
>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>> >>>> hosted by
>> >>>> >> >>> Infra
>> >>>> >> >>> > look suitable.
>> >>>> >> >>> >
>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It used
>> to
>> >>>> be
>> >>>> >> >>> linked,
>> >>>> >> >>> > but has been removed from the navigation bar for some
>> reason.
>> >>>> This is
>> >>>> >> >>> the
>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>> >>>> >> >>> > We could update the page and add it back to the navigation
>> bar
>> >>>> for the
>> >>>> >> >>> > coming weeks. What do you think?
>> >>>> >> >>> >
>> >>>> >> >>> > I would actually like to push for a dynamic page right away.
>> >>>> >> >>> >
>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>> >>>> sending the
>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>> >>>> interested in
>> >>>> >> >>> > sharing the source? We could maintain the code together in a
>> >>>> public
>> >>>> >> >>> repo.
>> >>>> >> >>> > If they are not interested in sharing, or we decide not to
>> ask
>> >>>> in the
>> >>>> >> >>> first
>> >>>> >> >>> > place, I'm happy to write down a short description of the
>> >>>> requirements,
>> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
>> here
>> >>>> in the
>> >>>> >> >>> > community who's willing to implement it.
>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>> >>>> believe we
>> >>>> >> >>> will
>> >>>> >> >>> > be able to find somebody pretty soon.
>> >>>> >> >>> >
>> >>>> >> >>> >
>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>> >>>> becket.qin@gmail.com>
>> >>>> >> >>> wrote:
>> >>>> >> >>> >
>> >>>> >> >>> > > Forgot to provide the link...
>> >>>> >> >>> > >
>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>> (Apache
>> >>>> infra
>> >>>> >> >>> services)
>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>> Jail
>> >>>> provided
>> >>>> >> >>> by
>> >>>> >> >>> > > Apache Infra)
>> >>>> >> >>> > >
>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>> >>>> becket.qin@gmail.com>
>> >>>> >> >>> wrote:
>> >>>> >> >>> > >
>> >>>> >> >>> > >> Hi Robert,
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We should
>> >>>> absolutely
>> >>>> >> >>> > >> shoot for a dynamic website to support more interactions
>> in
>> >>>> the
>> >>>> >> >>> community.
>> >>>> >> >>> > >> There might be a few things to solve:
>> >>>> >> >>> > >> 1. The website code itself. An open source solution would
>> >>>> be great.
>> >>>> >> >>> TBH,
>> >>>> >> >>> > >> I do not have much experience on building a website.
>> It'll
>> >>>> be great
>> >>>> >> >>> if
>> >>>> >> >>> > >> someone could help comment on the solution here.
>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>> provides
>> >>>> a few
>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did not
>> see
>> >>>> >> >>> database
>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>> FreeBSD
>> >>>> jail[2].
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me.
>> We
>> >>>> >> >>> probably need
>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>> >>>> provide links
>> >>>> >> >>> it to
>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>> >>>> static
>> >>>> >> >>> page seems
>> >>>> >> >>> > >> something we could start with while we are working on the
>> >>>> dynamic
>> >>>> >> >>> pages.
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> Thanks,
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>> >>>> wshaoxuan@gmail.com>
>> >>>> >> >>> > >> wrote:
>> >>>> >> >>> > >>
>> >>>> >> >>> > >>> Hi Becket and Robert,
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>> >>>> connectors at
>> >>>> >> >>> the
>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>> >>>> upgrade it
>> >>>> >> >>> when we
>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>> functions.
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>> Regards,
>> >>>> >> >>> > >>> Shaoxuan
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>> >>>> rmetzger@apache.org
>> >>>> >> >>> >
>> >>>> >> >>> > >>> wrote:
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>>> Hey Becket,
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> This is a great idea!
>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>> page
>> >>>> is placed
>> >>>> >> >>> > >>>> prominently so that the people submitting something
>> will
>> >>>> get
>> >>>> >> >>> attention for
>> >>>> >> >>> > >>>> their contributions.
>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
>> >>>> want
>> >>>> >> >>> features
>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra,
>> and
>> >>>> endorsed
>> >>>> >> >>> by
>> >>>> >> >>> > >>>> the community.
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>> >>>> could use?
>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>> >>>> >> >>> https://aur.archlinux.org/
>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>> >>>> source
>> >>>> >> >>> code of this
>> >>>> >> >>> > >>>> portal is open source, but the layout and structure is
>> >>>> not an
>> >>>> >> >>> ideal fit for
>> >>>> >> >>> > >>>> our requirements)
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> Best,
>> >>>> >> >>> > >>>> Robert
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>> >>>> becket.qin@gmail.com>
>> >>>> >> >>> > >>>> wrote:
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>>> Hi folks,
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>> creating
>> >>>> a Flink
>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>> contributors
>> >>>> who
>> >>>> >> >>> have developed
>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>> >>>> community.
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>>
>> >>>> >> >>>
>> >>>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> Thanks,
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>
>> >>>> >> >>>
>> >>>> >> >>
>> >>>>
>> >>>>
>> >>>>
>> >>>> --
>> >>>> Best regards / Met vriendelijke groeten,
>> >>>>
>> >>>> Niels Basjes
>> >>>>
>> >>>
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Done. The writeup looks great!

On Mon, Mar 18, 2019 at 9:09 PM Robert Metzger <rm...@apache.org> wrote:

> Nice, really good news on the INFRA front!
> I think the hardware specs sound reasonable. And a periodic backup of the
> website's database to Infra's backup solution sounds reasonable too.
>
> Can you accept and review my proposal for the website?
>
>
> On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:
>
>> >
>> > I have a very capable and motivated frontend developer who would be
>> > willing to implement what I've mocked in my proposal.
>>
>>
>> That is awesome!
>>
>> I created a Jira ticket[1] to Apache Infra and got the reply. It looks
>> that
>> Apache infra team could provide a decent VM. The last piece is how to
>> ensure the data is persisted so we won't lose the project info / user
>> feedbacks when the VM is down. If Apache infra does not provide a
>> persistent storage for DB backup, we can always ask for multiple VMs and
>> do
>> the fault tolerance by ourselves. It seems we can almost say the hardware
>> side is also ready.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> [1] https://issues.apache.org/jira/browse/INFRA-18010
>>
>> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>> > Thank you for reaching out to Infra and the ember client.
>> > When I first saw the Ember repository, I thought it is the whole thing
>> > (frontend and backend), but while testing it, I realized it is "only"
>> the
>> > frontend. I'm not sure if it makes sense to adjust the Ember observer
>> > client, or just write a simple UI from scratch.
>> > I have a very capable and motivated frontend developer who would be
>> > willing to implement what I've mocked in my proposal.
>> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
>> help
>> > with this project for the backend:
>> > https://github.com/rmetzger/flink-community-tools/issues/4
>> >
>> > For Infra: I made the same experience when asking for more GitHub
>> > permissions for "flinkbot": They didn't respond on their mailing list,
>> only
>> > on Jira.
>> >
>> >
>> >
>> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com>
>> wrote:
>> >
>> >> Thanks for writing up the specifications.
>> >>
>> >> Regarding the website source code, Austin found a website[1] whose
>> >> frontend code[2] is available publicly. It lacks some support (e.g
>> login),
>> >> but it is still a good starting point. One thing is that I did not
>> find a
>> >> License statement for that source code. I'll reach out to the author
>> to see
>> >> if they have any concern over our usage.
>> >>
>> >> Apache Infra has not replied to my email regarding some details about
>> the
>> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
>> response.
>> >>
>> >> Thanks,
>> >>
>> >> Jiangjie (Becket) Qin
>> >>
>> >> [1] https://emberobserver.com/
>> >> [2] https://github.com/emberobserver/client
>> >>
>> >>
>> >>
>> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>> >> wrote:
>> >>
>> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
>> >>> website. I guess the likelihood that they give out code from their
>> company
>> >>> website is fairly low.
>> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>> >>> reactivate as part of this PR:
>> >>> https://github.com/apache/flink-web/pull/187
>> >>>
>> >>> Spark-packages.org did not respond to my request.
>> >>> I will propose a short specification in Becket's initial document.
>> >>>
>> >>>
>> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl>
>> wrote:
>> >>>
>> >>>> Hi,
>> >>>>
>> >>>> The Beam project has something in this area that is simply a page
>> >>>> within their documentation website:
>> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>> >>>>
>> >>>> Niels Basjes
>> >>>>
>> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com>
>> wrote:
>> >>>> >
>> >>>> > Confluent hub for Kafka is another good example of this kind. I
>> >>>> personally like it over the spark site. May worth checking it out
>> with
>> >>>> Kafka folks
>> >>>> >
>> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>> >>>> wrote:
>> >>>> >>
>> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>> >>>> >> ecosystem page and the navigation.
>> >>>> >>
>> >>>> >> Thanks,
>> >>>> >>
>> >>>> >> Jiangjie (Becket) Qin
>> >>>> >>
>> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <
>> rmetzger@apache.org>
>> >>>> wrote:
>> >>>> >>
>> >>>> >> > Okay. I will reach out to spark-packages.org and see if they
>> are
>> >>>> willing
>> >>>> >> > to share.
>> >>>> >> >
>> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
>> sync
>> >>>> with
>> >>>> >> > the "Software Projects" listed here:
>> >>>> >> >
>> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>> >>>> and
>> >>>> >> > link it in the navigation?
>> >>>> >> >
>> >>>> >> > Best,
>> >>>> >> > Robert
>> >>>> >> >
>> >>>> >> >
>> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <
>> becket.qin@gmail.com>
>> >>>> wrote:
>> >>>> >> >
>> >>>> >> >> Hi Robert,
>> >>>> >> >>
>> >>>> >> >> I think it at least worths checking if spark-packages.org
>> owners
>> >>>> are
>> >>>> >> >> willing to share. Thanks for volunteering to write the
>> requirement
>> >>>> >> >> descriptions! In any case, that will be very helpful.
>> >>>> >> >>
>> >>>> >> >> Since a static page has almost no cost, and we will need it to
>> >>>> redirect
>> >>>> >> >> to the dynamic site anyways, how about we first do that while
>> >>>> working on
>> >>>> >> >> the dynamic website?
>> >>>> >> >>
>> >>>> >> >> Thanks,
>> >>>> >> >>
>> >>>> >> >> Jiangjie (Becket) Qin
>> >>>> >> >>
>> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>> >>>> wrote:
>> >>>> >> >>
>> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>> >>>> could then
>> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>> >>>> have the
>> >>>> >> >>> resources in the community to quickly start with a dynamic
>> site,
>> >>>> I'm
>> >>>> >> >>> not apposed.
>> >>>> >> >>>
>> >>>> >> >>> – Ufuk
>> >>>> >> >>>
>> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>> >>>> rmetzger@apache.org>
>> >>>> >> >>> wrote:
>> >>>> >> >>> >
>> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>> >>>> hosted by
>> >>>> >> >>> Infra
>> >>>> >> >>> > look suitable.
>> >>>> >> >>> >
>> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It used
>> to
>> >>>> be
>> >>>> >> >>> linked,
>> >>>> >> >>> > but has been removed from the navigation bar for some
>> reason.
>> >>>> This is
>> >>>> >> >>> the
>> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>> >>>> >> >>> > We could update the page and add it back to the navigation
>> bar
>> >>>> for the
>> >>>> >> >>> > coming weeks. What do you think?
>> >>>> >> >>> >
>> >>>> >> >>> > I would actually like to push for a dynamic page right away.
>> >>>> >> >>> >
>> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>> >>>> sending the
>> >>>> >> >>> > owners of spark-packages.org a short note, if they are
>> >>>> interested in
>> >>>> >> >>> > sharing the source? We could maintain the code together in a
>> >>>> public
>> >>>> >> >>> repo.
>> >>>> >> >>> > If they are not interested in sharing, or we decide not to
>> ask
>> >>>> in the
>> >>>> >> >>> first
>> >>>> >> >>> > place, I'm happy to write down a short description of the
>> >>>> requirements,
>> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
>> here
>> >>>> in the
>> >>>> >> >>> > community who's willing to implement it.
>> >>>> >> >>> > Given the number of people who are eager to contribute, I
>> >>>> believe we
>> >>>> >> >>> will
>> >>>> >> >>> > be able to find somebody pretty soon.
>> >>>> >> >>> >
>> >>>> >> >>> >
>> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>> >>>> becket.qin@gmail.com>
>> >>>> >> >>> wrote:
>> >>>> >> >>> >
>> >>>> >> >>> > > Forgot to provide the link...
>> >>>> >> >>> > >
>> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs
>> (Apache
>> >>>> infra
>> >>>> >> >>> services)
>> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD
>> Jail
>> >>>> provided
>> >>>> >> >>> by
>> >>>> >> >>> > > Apache Infra)
>> >>>> >> >>> > >
>> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>> >>>> becket.qin@gmail.com>
>> >>>> >> >>> wrote:
>> >>>> >> >>> > >
>> >>>> >> >>> > >> Hi Robert,
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> Thanks for the feedback. These are good points. We should
>> >>>> absolutely
>> >>>> >> >>> > >> shoot for a dynamic website to support more interactions
>> in
>> >>>> the
>> >>>> >> >>> community.
>> >>>> >> >>> > >> There might be a few things to solve:
>> >>>> >> >>> > >> 1. The website code itself. An open source solution would
>> >>>> be great.
>> >>>> >> >>> TBH,
>> >>>> >> >>> > >> I do not have much experience on building a website.
>> It'll
>> >>>> be great
>> >>>> >> >>> if
>> >>>> >> >>> > >> someone could help comment on the solution here.
>> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra
>> provides
>> >>>> a few
>> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did not
>> see
>> >>>> >> >>> database
>> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in
>> FreeBSD
>> >>>> jail[2].
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me.
>> We
>> >>>> >> >>> probably need
>> >>>> >> >>> > >> a page in the Flink official site anyways, even just
>> >>>> provide links
>> >>>> >> >>> it to
>> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>> >>>> static
>> >>>> >> >>> page seems
>> >>>> >> >>> > >> something we could start with while we are working on the
>> >>>> dynamic
>> >>>> >> >>> pages.
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> Thanks,
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> Jiangjie (Becket) Qin
>> >>>> >> >>> > >>
>> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>> >>>> wshaoxuan@gmail.com>
>> >>>> >> >>> > >> wrote:
>> >>>> >> >>> > >>
>> >>>> >> >>> > >>> Hi Becket and Robert,
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>> >>>> connectors at
>> >>>> >> >>> the
>> >>>> >> >>> > >>> first beginning. We can start with a static page, and
>> >>>> upgrade it
>> >>>> >> >>> when we
>> >>>> >> >>> > >>> find a better solution for dynamic one with rich
>> functions.
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>> Regards,
>> >>>> >> >>> > >>> Shaoxuan
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>> >>>> rmetzger@apache.org
>> >>>> >> >>> >
>> >>>> >> >>> > >>> wrote:
>> >>>> >> >>> > >>>
>> >>>> >> >>> > >>>> Hey Becket,
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> This is a great idea!
>> >>>> >> >>> > >>>> For this to be successful, we need to make sure the
>> page
>> >>>> is placed
>> >>>> >> >>> > >>>> prominently so that the people submitting something
>> will
>> >>>> get
>> >>>> >> >>> attention for
>> >>>> >> >>> > >>>> their contributions.
>> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
>> >>>> want
>> >>>> >> >>> features
>> >>>> >> >>> > >>>> such as up and downvoting or comments.
>> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra,
>> and
>> >>>> endorsed
>> >>>> >> >>> by
>> >>>> >> >>> > >>>> the community.
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> Does anybody here know any existing software that we
>> >>>> could use?
>> >>>> >> >>> > >>>> The only think I was able to find is AUR:
>> >>>> >> >>> https://aur.archlinux.org/
>> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>> >>>> source
>> >>>> >> >>> code of this
>> >>>> >> >>> > >>>> portal is open source, but the layout and structure is
>> >>>> not an
>> >>>> >> >>> ideal fit for
>> >>>> >> >>> > >>>> our requirements)
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> Best,
>> >>>> >> >>> > >>>> Robert
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>> >>>> becket.qin@gmail.com>
>> >>>> >> >>> > >>>> wrote:
>> >>>> >> >>> > >>>>
>> >>>> >> >>> > >>>>> Hi folks,
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> I would like to start a discussion thread about
>> creating
>> >>>> a Flink
>> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
>> contributors
>> >>>> who
>> >>>> >> >>> have developed
>> >>>> >> >>> > >>>>> projects around Flink share their work with the
>> >>>> community.
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> Please see the following doc for more details.
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>>
>> >>>> >> >>>
>> >>>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> Thanks,
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>> >>>> >> >>> > >>>>>
>> >>>> >> >>> > >>>>
>> >>>> >> >>>
>> >>>> >> >>
>> >>>>
>> >>>>
>> >>>>
>> >>>> --
>> >>>> Best regards / Met vriendelijke groeten,
>> >>>>
>> >>>> Niels Basjes
>> >>>>
>> >>>
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Nice, really good news on the INFRA front!
I think the hardware specs sound reasonable. And a periodic backup of the
website's database to Infra's backup solution sounds reasonable too.

Can you accept and review my proposal for the website?


On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:

> >
> > I have a very capable and motivated frontend developer who would be
> > willing to implement what I've mocked in my proposal.
>
>
> That is awesome!
>
> I created a Jira ticket[1] to Apache Infra and got the reply. It looks that
> Apache infra team could provide a decent VM. The last piece is how to
> ensure the data is persisted so we won't lose the project info / user
> feedbacks when the VM is down. If Apache infra does not provide a
> persistent storage for DB backup, we can always ask for multiple VMs and do
> the fault tolerance by ourselves. It seems we can almost say the hardware
> side is also ready.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> [1] https://issues.apache.org/jira/browse/INFRA-18010
>
> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
> wrote:
>
> > Thank you for reaching out to Infra and the ember client.
> > When I first saw the Ember repository, I thought it is the whole thing
> > (frontend and backend), but while testing it, I realized it is "only" the
> > frontend. I'm not sure if it makes sense to adjust the Ember observer
> > client, or just write a simple UI from scratch.
> > I have a very capable and motivated frontend developer who would be
> > willing to implement what I've mocked in my proposal.
> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
> help
> > with this project for the backend:
> > https://github.com/rmetzger/flink-community-tools/issues/4
> >
> > For Infra: I made the same experience when asking for more GitHub
> > permissions for "flinkbot": They didn't respond on their mailing list,
> only
> > on Jira.
> >
> >
> >
> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com> wrote:
> >
> >> Thanks for writing up the specifications.
> >>
> >> Regarding the website source code, Austin found a website[1] whose
> >> frontend code[2] is available publicly. It lacks some support (e.g
> login),
> >> but it is still a good starting point. One thing is that I did not find
> a
> >> License statement for that source code. I'll reach out to the author to
> see
> >> if they have any concern over our usage.
> >>
> >> Apache Infra has not replied to my email regarding some details about
> the
> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
> response.
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> [1] https://emberobserver.com/
> >> [2] https://github.com/emberobserver/client
> >>
> >>
> >>
> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
> >> wrote:
> >>
> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
> >>> website. I guess the likelihood that they give out code from their
> company
> >>> website is fairly low.
> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
> >>> reactivate as part of this PR:
> >>> https://github.com/apache/flink-web/pull/187
> >>>
> >>> Spark-packages.org did not respond to my request.
> >>> I will propose a short specification in Becket's initial document.
> >>>
> >>>
> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> The Beam project has something in this area that is simply a page
> >>>> within their documentation website:
> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
> >>>>
> >>>> Niels Basjes
> >>>>
> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
> >>>> >
> >>>> > Confluent hub for Kafka is another good example of this kind. I
> >>>> personally like it over the spark site. May worth checking it out with
> >>>> Kafka folks
> >>>> >
> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
> >>>> wrote:
> >>>> >>
> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
> >>>> >> ecosystem page and the navigation.
> >>>> >>
> >>>> >> Thanks,
> >>>> >>
> >>>> >> Jiangjie (Becket) Qin
> >>>> >>
> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rmetzger@apache.org
> >
> >>>> wrote:
> >>>> >>
> >>>> >> > Okay. I will reach out to spark-packages.org and see if they are
> >>>> willing
> >>>> >> > to share.
> >>>> >> >
> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
> sync
> >>>> with
> >>>> >> > the "Software Projects" listed here:
> >>>> >> >
> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
> >>>> and
> >>>> >> > link it in the navigation?
> >>>> >> >
> >>>> >> > Best,
> >>>> >> > Robert
> >>>> >> >
> >>>> >> >
> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <becket.qin@gmail.com
> >
> >>>> wrote:
> >>>> >> >
> >>>> >> >> Hi Robert,
> >>>> >> >>
> >>>> >> >> I think it at least worths checking if spark-packages.org
> owners
> >>>> are
> >>>> >> >> willing to share. Thanks for volunteering to write the
> requirement
> >>>> >> >> descriptions! In any case, that will be very helpful.
> >>>> >> >>
> >>>> >> >> Since a static page has almost no cost, and we will need it to
> >>>> redirect
> >>>> >> >> to the dynamic site anyways, how about we first do that while
> >>>> working on
> >>>> >> >> the dynamic website?
> >>>> >> >>
> >>>> >> >> Thanks,
> >>>> >> >>
> >>>> >> >> Jiangjie (Becket) Qin
> >>>> >> >>
> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
> >>>> wrote:
> >>>> >> >>
> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
> >>>> could then
> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
> >>>> have the
> >>>> >> >>> resources in the community to quickly start with a dynamic
> site,
> >>>> I'm
> >>>> >> >>> not apposed.
> >>>> >> >>>
> >>>> >> >>> – Ufuk
> >>>> >> >>>
> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
> >>>> rmetzger@apache.org>
> >>>> >> >>> wrote:
> >>>> >> >>> >
> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
> >>>> hosted by
> >>>> >> >>> Infra
> >>>> >> >>> > look suitable.
> >>>> >> >>> >
> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It used
> to
> >>>> be
> >>>> >> >>> linked,
> >>>> >> >>> > but has been removed from the navigation bar for some reason.
> >>>> This is
> >>>> >> >>> the
> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
> >>>> >> >>> > We could update the page and add it back to the navigation
> bar
> >>>> for the
> >>>> >> >>> > coming weeks. What do you think?
> >>>> >> >>> >
> >>>> >> >>> > I would actually like to push for a dynamic page right away.
> >>>> >> >>> >
> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
> >>>> sending the
> >>>> >> >>> > owners of spark-packages.org a short note, if they are
> >>>> interested in
> >>>> >> >>> > sharing the source? We could maintain the code together in a
> >>>> public
> >>>> >> >>> repo.
> >>>> >> >>> > If they are not interested in sharing, or we decide not to
> ask
> >>>> in the
> >>>> >> >>> first
> >>>> >> >>> > place, I'm happy to write down a short description of the
> >>>> requirements,
> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
> here
> >>>> in the
> >>>> >> >>> > community who's willing to implement it.
> >>>> >> >>> > Given the number of people who are eager to contribute, I
> >>>> believe we
> >>>> >> >>> will
> >>>> >> >>> > be able to find somebody pretty soon.
> >>>> >> >>> >
> >>>> >> >>> >
> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
> >>>> becket.qin@gmail.com>
> >>>> >> >>> wrote:
> >>>> >> >>> >
> >>>> >> >>> > > Forgot to provide the link...
> >>>> >> >>> > >
> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
> >>>> infra
> >>>> >> >>> services)
> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
> >>>> provided
> >>>> >> >>> by
> >>>> >> >>> > > Apache Infra)
> >>>> >> >>> > >
> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
> >>>> becket.qin@gmail.com>
> >>>> >> >>> wrote:
> >>>> >> >>> > >
> >>>> >> >>> > >> Hi Robert,
> >>>> >> >>> > >>
> >>>> >> >>> > >> Thanks for the feedback. These are good points. We should
> >>>> absolutely
> >>>> >> >>> > >> shoot for a dynamic website to support more interactions
> in
> >>>> the
> >>>> >> >>> community.
> >>>> >> >>> > >> There might be a few things to solve:
> >>>> >> >>> > >> 1. The website code itself. An open source solution would
> >>>> be great.
> >>>> >> >>> TBH,
> >>>> >> >>> > >> I do not have much experience on building a website. It'll
> >>>> be great
> >>>> >> >>> if
> >>>> >> >>> > >> someone could help comment on the solution here.
> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides
> >>>> a few
> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did not
> see
> >>>> >> >>> database
> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
> >>>> jail[2].
> >>>> >> >>> > >>
> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >>>> >> >>> > >>
> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me.
> We
> >>>> >> >>> probably need
> >>>> >> >>> > >> a page in the Flink official site anyways, even just
> >>>> provide links
> >>>> >> >>> it to
> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that
> >>>> static
> >>>> >> >>> page seems
> >>>> >> >>> > >> something we could start with while we are working on the
> >>>> dynamic
> >>>> >> >>> pages.
> >>>> >> >>> > >>
> >>>> >> >>> > >> Thanks,
> >>>> >> >>> > >>
> >>>> >> >>> > >> Jiangjie (Becket) Qin
> >>>> >> >>> > >>
> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> >>>> wshaoxuan@gmail.com>
> >>>> >> >>> > >> wrote:
> >>>> >> >>> > >>
> >>>> >> >>> > >>> Hi Becket and Robert,
> >>>> >> >>> > >>>
> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
> >>>> connectors at
> >>>> >> >>> the
> >>>> >> >>> > >>> first beginning. We can start with a static page, and
> >>>> upgrade it
> >>>> >> >>> when we
> >>>> >> >>> > >>> find a better solution for dynamic one with rich
> functions.
> >>>> >> >>> > >>>
> >>>> >> >>> > >>> Regards,
> >>>> >> >>> > >>> Shaoxuan
> >>>> >> >>> > >>>
> >>>> >> >>> > >>>
> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> >>>> rmetzger@apache.org
> >>>> >> >>> >
> >>>> >> >>> > >>> wrote:
> >>>> >> >>> > >>>
> >>>> >> >>> > >>>> Hey Becket,
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> This is a great idea!
> >>>> >> >>> > >>>> For this to be successful, we need to make sure the page
> >>>> is placed
> >>>> >> >>> > >>>> prominently so that the people submitting something will
> >>>> get
> >>>> >> >>> attention for
> >>>> >> >>> > >>>> their contributions.
> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
> >>>> want
> >>>> >> >>> features
> >>>> >> >>> > >>>> such as up and downvoting or comments.
> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
> >>>> endorsed
> >>>> >> >>> by
> >>>> >> >>> > >>>> the community.
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> Does anybody here know any existing software that we
> >>>> could use?
> >>>> >> >>> > >>>> The only think I was able to find is AUR:
> >>>> >> >>> https://aur.archlinux.org/
> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
> >>>> source
> >>>> >> >>> code of this
> >>>> >> >>> > >>>> portal is open source, but the layout and structure is
> >>>> not an
> >>>> >> >>> ideal fit for
> >>>> >> >>> > >>>> our requirements)
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> Best,
> >>>> >> >>> > >>>> Robert
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> >>>> becket.qin@gmail.com>
> >>>> >> >>> > >>>> wrote:
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>>> Hi folks,
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> I would like to start a discussion thread about
> creating
> >>>> a Flink
> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
> contributors
> >>>> who
> >>>> >> >>> have developed
> >>>> >> >>> > >>>>> projects around Flink share their work with the
> >>>> community.
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> Please see the following doc for more details.
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>>
> >>>> >> >>>
> >>>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> Thanks,
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>
> >>>> >> >>>
> >>>> >> >>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Best regards / Met vriendelijke groeten,
> >>>>
> >>>> Niels Basjes
> >>>>
> >>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Nice, really good news on the INFRA front!
I think the hardware specs sound reasonable. And a periodic backup of the
website's database to Infra's backup solution sounds reasonable too.

Can you accept and review my proposal for the website?


On Sat, Mar 16, 2019 at 3:47 PM Becket Qin <be...@gmail.com> wrote:

> >
> > I have a very capable and motivated frontend developer who would be
> > willing to implement what I've mocked in my proposal.
>
>
> That is awesome!
>
> I created a Jira ticket[1] to Apache Infra and got the reply. It looks that
> Apache infra team could provide a decent VM. The last piece is how to
> ensure the data is persisted so we won't lose the project info / user
> feedbacks when the VM is down. If Apache infra does not provide a
> persistent storage for DB backup, we can always ask for multiple VMs and do
> the fault tolerance by ourselves. It seems we can almost say the hardware
> side is also ready.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> [1] https://issues.apache.org/jira/browse/INFRA-18010
>
> On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org>
> wrote:
>
> > Thank you for reaching out to Infra and the ember client.
> > When I first saw the Ember repository, I thought it is the whole thing
> > (frontend and backend), but while testing it, I realized it is "only" the
> > frontend. I'm not sure if it makes sense to adjust the Ember observer
> > client, or just write a simple UI from scratch.
> > I have a very capable and motivated frontend developer who would be
> > willing to implement what I've mocked in my proposal.
> > In addition, I found somebody (Congxian Qiu) who seems to be eager to
> help
> > with this project for the backend:
> > https://github.com/rmetzger/flink-community-tools/issues/4
> >
> > For Infra: I made the same experience when asking for more GitHub
> > permissions for "flinkbot": They didn't respond on their mailing list,
> only
> > on Jira.
> >
> >
> >
> > On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com> wrote:
> >
> >> Thanks for writing up the specifications.
> >>
> >> Regarding the website source code, Austin found a website[1] whose
> >> frontend code[2] is available publicly. It lacks some support (e.g
> login),
> >> but it is still a good starting point. One thing is that I did not find
> a
> >> License statement for that source code. I'll reach out to the author to
> see
> >> if they have any concern over our usage.
> >>
> >> Apache Infra has not replied to my email regarding some details about
> the
> >> VM. I'll open an infra Jira ticket tomorrow if there is still no
> response.
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> [1] https://emberobserver.com/
> >> [2] https://github.com/emberobserver/client
> >>
> >>
> >>
> >> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
> >> wrote:
> >>
> >>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
> >>> website. I guess the likelihood that they give out code from their
> company
> >>> website is fairly low.
> >>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
> >>> reactivate as part of this PR:
> >>> https://github.com/apache/flink-web/pull/187
> >>>
> >>> Spark-packages.org did not respond to my request.
> >>> I will propose a short specification in Becket's initial document.
> >>>
> >>>
> >>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> The Beam project has something in this area that is simply a page
> >>>> within their documentation website:
> >>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
> >>>>
> >>>> Niels Basjes
> >>>>
> >>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
> >>>> >
> >>>> > Confluent hub for Kafka is another good example of this kind. I
> >>>> personally like it over the spark site. May worth checking it out with
> >>>> Kafka folks
> >>>> >
> >>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
> >>>> wrote:
> >>>> >>
> >>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
> >>>> >> ecosystem page and the navigation.
> >>>> >>
> >>>> >> Thanks,
> >>>> >>
> >>>> >> Jiangjie (Becket) Qin
> >>>> >>
> >>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rmetzger@apache.org
> >
> >>>> wrote:
> >>>> >>
> >>>> >> > Okay. I will reach out to spark-packages.org and see if they are
> >>>> willing
> >>>> >> > to share.
> >>>> >> >
> >>>> >> > Do you want to raise a PR to update the ecosystem page (maybe
> sync
> >>>> with
> >>>> >> > the "Software Projects" listed here:
> >>>> >> >
> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
> >>>> and
> >>>> >> > link it in the navigation?
> >>>> >> >
> >>>> >> > Best,
> >>>> >> > Robert
> >>>> >> >
> >>>> >> >
> >>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <becket.qin@gmail.com
> >
> >>>> wrote:
> >>>> >> >
> >>>> >> >> Hi Robert,
> >>>> >> >>
> >>>> >> >> I think it at least worths checking if spark-packages.org
> owners
> >>>> are
> >>>> >> >> willing to share. Thanks for volunteering to write the
> requirement
> >>>> >> >> descriptions! In any case, that will be very helpful.
> >>>> >> >>
> >>>> >> >> Since a static page has almost no cost, and we will need it to
> >>>> redirect
> >>>> >> >> to the dynamic site anyways, how about we first do that while
> >>>> working on
> >>>> >> >> the dynamic website?
> >>>> >> >>
> >>>> >> >> Thanks,
> >>>> >> >>
> >>>> >> >> Jiangjie (Becket) Qin
> >>>> >> >>
> >>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
> >>>> wrote:
> >>>> >> >>
> >>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
> >>>> could then
> >>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
> >>>> have the
> >>>> >> >>> resources in the community to quickly start with a dynamic
> site,
> >>>> I'm
> >>>> >> >>> not apposed.
> >>>> >> >>>
> >>>> >> >>> – Ufuk
> >>>> >> >>>
> >>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
> >>>> rmetzger@apache.org>
> >>>> >> >>> wrote:
> >>>> >> >>> >
> >>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
> >>>> hosted by
> >>>> >> >>> Infra
> >>>> >> >>> > look suitable.
> >>>> >> >>> >
> >>>> >> >>> > @Shaoxuan: There is actually already a static page. It used
> to
> >>>> be
> >>>> >> >>> linked,
> >>>> >> >>> > but has been removed from the navigation bar for some reason.
> >>>> This is
> >>>> >> >>> the
> >>>> >> >>> > page: https://flink.apache.org/ecosystem.html
> >>>> >> >>> > We could update the page and add it back to the navigation
> bar
> >>>> for the
> >>>> >> >>> > coming weeks. What do you think?
> >>>> >> >>> >
> >>>> >> >>> > I would actually like to push for a dynamic page right away.
> >>>> >> >>> >
> >>>> >> >>> > I know it's kind of a bold move, but how do you feel about
> >>>> sending the
> >>>> >> >>> > owners of spark-packages.org a short note, if they are
> >>>> interested in
> >>>> >> >>> > sharing the source? We could maintain the code together in a
> >>>> public
> >>>> >> >>> repo.
> >>>> >> >>> > If they are not interested in sharing, or we decide not to
> ask
> >>>> in the
> >>>> >> >>> first
> >>>> >> >>> > place, I'm happy to write down a short description of the
> >>>> requirements,
> >>>> >> >>> > maybe some mockups. We could then see if we find somebody
> here
> >>>> in the
> >>>> >> >>> > community who's willing to implement it.
> >>>> >> >>> > Given the number of people who are eager to contribute, I
> >>>> believe we
> >>>> >> >>> will
> >>>> >> >>> > be able to find somebody pretty soon.
> >>>> >> >>> >
> >>>> >> >>> >
> >>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
> >>>> becket.qin@gmail.com>
> >>>> >> >>> wrote:
> >>>> >> >>> >
> >>>> >> >>> > > Forgot to provide the link...
> >>>> >> >>> > >
> >>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
> >>>> infra
> >>>> >> >>> services)
> >>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
> >>>> provided
> >>>> >> >>> by
> >>>> >> >>> > > Apache Infra)
> >>>> >> >>> > >
> >>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
> >>>> becket.qin@gmail.com>
> >>>> >> >>> wrote:
> >>>> >> >>> > >
> >>>> >> >>> > >> Hi Robert,
> >>>> >> >>> > >>
> >>>> >> >>> > >> Thanks for the feedback. These are good points. We should
> >>>> absolutely
> >>>> >> >>> > >> shoot for a dynamic website to support more interactions
> in
> >>>> the
> >>>> >> >>> community.
> >>>> >> >>> > >> There might be a few things to solve:
> >>>> >> >>> > >> 1. The website code itself. An open source solution would
> >>>> be great.
> >>>> >> >>> TBH,
> >>>> >> >>> > >> I do not have much experience on building a website. It'll
> >>>> be great
> >>>> >> >>> if
> >>>> >> >>> > >> someone could help comment on the solution here.
> >>>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides
> >>>> a few
> >>>> >> >>> > >> services[1] that Apache projects can leverage. I did not
> see
> >>>> >> >>> database
> >>>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
> >>>> jail[2].
> >>>> >> >>> > >>
> >>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >>>> >> >>> > >>
> >>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me.
> We
> >>>> >> >>> probably need
> >>>> >> >>> > >> a page in the Flink official site anyways, even just
> >>>> provide links
> >>>> >> >>> it to
> >>>> >> >>> > >> the ecosystem website. So listing the connectors in that
> >>>> static
> >>>> >> >>> page seems
> >>>> >> >>> > >> something we could start with while we are working on the
> >>>> dynamic
> >>>> >> >>> pages.
> >>>> >> >>> > >>
> >>>> >> >>> > >> Thanks,
> >>>> >> >>> > >>
> >>>> >> >>> > >> Jiangjie (Becket) Qin
> >>>> >> >>> > >>
> >>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> >>>> wshaoxuan@gmail.com>
> >>>> >> >>> > >> wrote:
> >>>> >> >>> > >>
> >>>> >> >>> > >>> Hi Becket and Robert,
> >>>> >> >>> > >>>
> >>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
> >>>> connectors at
> >>>> >> >>> the
> >>>> >> >>> > >>> first beginning. We can start with a static page, and
> >>>> upgrade it
> >>>> >> >>> when we
> >>>> >> >>> > >>> find a better solution for dynamic one with rich
> functions.
> >>>> >> >>> > >>>
> >>>> >> >>> > >>> Regards,
> >>>> >> >>> > >>> Shaoxuan
> >>>> >> >>> > >>>
> >>>> >> >>> > >>>
> >>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> >>>> rmetzger@apache.org
> >>>> >> >>> >
> >>>> >> >>> > >>> wrote:
> >>>> >> >>> > >>>
> >>>> >> >>> > >>>> Hey Becket,
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> This is a great idea!
> >>>> >> >>> > >>>> For this to be successful, we need to make sure the page
> >>>> is placed
> >>>> >> >>> > >>>> prominently so that the people submitting something will
> >>>> get
> >>>> >> >>> attention for
> >>>> >> >>> > >>>> their contributions.
> >>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
> >>>> want
> >>>> >> >>> features
> >>>> >> >>> > >>>> such as up and downvoting or comments.
> >>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
> >>>> endorsed
> >>>> >> >>> by
> >>>> >> >>> > >>>> the community.
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> Does anybody here know any existing software that we
> >>>> could use?
> >>>> >> >>> > >>>> The only think I was able to find is AUR:
> >>>> >> >>> https://aur.archlinux.org/
> >>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
> >>>> source
> >>>> >> >>> code of this
> >>>> >> >>> > >>>> portal is open source, but the layout and structure is
> >>>> not an
> >>>> >> >>> ideal fit for
> >>>> >> >>> > >>>> our requirements)
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> Best,
> >>>> >> >>> > >>>> Robert
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> >>>> becket.qin@gmail.com>
> >>>> >> >>> > >>>> wrote:
> >>>> >> >>> > >>>>
> >>>> >> >>> > >>>>> Hi folks,
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> I would like to start a discussion thread about
> creating
> >>>> a Flink
> >>>> >> >>> > >>>>> ecosystem website. The website aims to help
> contributors
> >>>> who
> >>>> >> >>> have developed
> >>>> >> >>> > >>>>> projects around Flink share their work with the
> >>>> community.
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> Please see the following doc for more details.
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>>
> >>>> >> >>>
> >>>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> Thanks,
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>> Jiangjie (Becket) Qin
> >>>> >> >>> > >>>>>
> >>>> >> >>> > >>>>
> >>>> >> >>>
> >>>> >> >>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Best regards / Met vriendelijke groeten,
> >>>>
> >>>> Niels Basjes
> >>>>
> >>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

>
> I have a very capable and motivated frontend developer who would be
> willing to implement what I've mocked in my proposal.


That is awesome!

I created a Jira ticket[1] to Apache Infra and got the reply. It looks that
Apache infra team could provide a decent VM. The last piece is how to
ensure the data is persisted so we won't lose the project info / user
feedbacks when the VM is down. If Apache infra does not provide a
persistent storage for DB backup, we can always ask for multiple VMs and do
the fault tolerance by ourselves. It seems we can almost say the hardware
side is also ready.

Thanks,

Jiangjie (Becket) Qin

[1] https://issues.apache.org/jira/browse/INFRA-18010

On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org> wrote:

> Thank you for reaching out to Infra and the ember client.
> When I first saw the Ember repository, I thought it is the whole thing
> (frontend and backend), but while testing it, I realized it is "only" the
> frontend. I'm not sure if it makes sense to adjust the Ember observer
> client, or just write a simple UI from scratch.
> I have a very capable and motivated frontend developer who would be
> willing to implement what I've mocked in my proposal.
> In addition, I found somebody (Congxian Qiu) who seems to be eager to help
> with this project for the backend:
> https://github.com/rmetzger/flink-community-tools/issues/4
>
> For Infra: I made the same experience when asking for more GitHub
> permissions for "flinkbot": They didn't respond on their mailing list, only
> on Jira.
>
>
>
> On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com> wrote:
>
>> Thanks for writing up the specifications.
>>
>> Regarding the website source code, Austin found a website[1] whose
>> frontend code[2] is available publicly. It lacks some support (e.g login),
>> but it is still a good starting point. One thing is that I did not find a
>> License statement for that source code. I'll reach out to the author to see
>> if they have any concern over our usage.
>>
>> Apache Infra has not replied to my email regarding some details about the
>> VM. I'll open an infra Jira ticket tomorrow if there is still no response.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> [1] https://emberobserver.com/
>> [2] https://github.com/emberobserver/client
>>
>>
>>
>> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
>>> website. I guess the likelihood that they give out code from their company
>>> website is fairly low.
>>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>> reactivate as part of this PR:
>>> https://github.com/apache/flink-web/pull/187
>>>
>>> Spark-packages.org did not respond to my request.
>>> I will propose a short specification in Becket's initial document.
>>>
>>>
>>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
>>>
>>>> Hi,
>>>>
>>>> The Beam project has something in this area that is simply a page
>>>> within their documentation website:
>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>
>>>> Niels Basjes
>>>>
>>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>>>> >
>>>> > Confluent hub for Kafka is another good example of this kind. I
>>>> personally like it over the spark site. May worth checking it out with
>>>> Kafka folks
>>>> >
>>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >>
>>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>>>> >> ecosystem page and the navigation.
>>>> >>
>>>> >> Thanks,
>>>> >>
>>>> >> Jiangjie (Becket) Qin
>>>> >>
>>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>> >>
>>>> >> > Okay. I will reach out to spark-packages.org and see if they are
>>>> willing
>>>> >> > to share.
>>>> >> >
>>>> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
>>>> with
>>>> >> > the "Software Projects" listed here:
>>>> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>> and
>>>> >> > link it in the navigation?
>>>> >> >
>>>> >> > Best,
>>>> >> > Robert
>>>> >> >
>>>> >> >
>>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >> >
>>>> >> >> Hi Robert,
>>>> >> >>
>>>> >> >> I think it at least worths checking if spark-packages.org owners
>>>> are
>>>> >> >> willing to share. Thanks for volunteering to write the requirement
>>>> >> >> descriptions! In any case, that will be very helpful.
>>>> >> >>
>>>> >> >> Since a static page has almost no cost, and we will need it to
>>>> redirect
>>>> >> >> to the dynamic site anyways, how about we first do that while
>>>> working on
>>>> >> >> the dynamic website?
>>>> >> >>
>>>> >> >> Thanks,
>>>> >> >>
>>>> >> >> Jiangjie (Becket) Qin
>>>> >> >>
>>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>>> wrote:
>>>> >> >>
>>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>>> could then
>>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>>>> have the
>>>> >> >>> resources in the community to quickly start with a dynamic site,
>>>> I'm
>>>> >> >>> not apposed.
>>>> >> >>>
>>>> >> >>> – Ufuk
>>>> >> >>>
>>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >> >>> wrote:
>>>> >> >>> >
>>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>>>> hosted by
>>>> >> >>> Infra
>>>> >> >>> > look suitable.
>>>> >> >>> >
>>>> >> >>> > @Shaoxuan: There is actually already a static page. It used to
>>>> be
>>>> >> >>> linked,
>>>> >> >>> > but has been removed from the navigation bar for some reason.
>>>> This is
>>>> >> >>> the
>>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>> >> >>> > We could update the page and add it back to the navigation bar
>>>> for the
>>>> >> >>> > coming weeks. What do you think?
>>>> >> >>> >
>>>> >> >>> > I would actually like to push for a dynamic page right away.
>>>> >> >>> >
>>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>>> sending the
>>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>> interested in
>>>> >> >>> > sharing the source? We could maintain the code together in a
>>>> public
>>>> >> >>> repo.
>>>> >> >>> > If they are not interested in sharing, or we decide not to ask
>>>> in the
>>>> >> >>> first
>>>> >> >>> > place, I'm happy to write down a short description of the
>>>> requirements,
>>>> >> >>> > maybe some mockups. We could then see if we find somebody here
>>>> in the
>>>> >> >>> > community who's willing to implement it.
>>>> >> >>> > Given the number of people who are eager to contribute, I
>>>> believe we
>>>> >> >>> will
>>>> >> >>> > be able to find somebody pretty soon.
>>>> >> >>> >
>>>> >> >>> >
>>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >> >>> wrote:
>>>> >> >>> >
>>>> >> >>> > > Forgot to provide the link...
>>>> >> >>> > >
>>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
>>>> infra
>>>> >> >>> services)
>>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
>>>> provided
>>>> >> >>> by
>>>> >> >>> > > Apache Infra)
>>>> >> >>> > >
>>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >> >>> wrote:
>>>> >> >>> > >
>>>> >> >>> > >> Hi Robert,
>>>> >> >>> > >>
>>>> >> >>> > >> Thanks for the feedback. These are good points. We should
>>>> absolutely
>>>> >> >>> > >> shoot for a dynamic website to support more interactions in
>>>> the
>>>> >> >>> community.
>>>> >> >>> > >> There might be a few things to solve:
>>>> >> >>> > >> 1. The website code itself. An open source solution would
>>>> be great.
>>>> >> >>> TBH,
>>>> >> >>> > >> I do not have much experience on building a website. It'll
>>>> be great
>>>> >> >>> if
>>>> >> >>> > >> someone could help comment on the solution here.
>>>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides
>>>> a few
>>>> >> >>> > >> services[1] that Apache projects can leverage. I did not see
>>>> >> >>> database
>>>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
>>>> jail[2].
>>>> >> >>> > >>
>>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>> >> >>> > >>
>>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>>>> >> >>> probably need
>>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>> provide links
>>>> >> >>> it to
>>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>>>> static
>>>> >> >>> page seems
>>>> >> >>> > >> something we could start with while we are working on the
>>>> dynamic
>>>> >> >>> pages.
>>>> >> >>> > >>
>>>> >> >>> > >> Thanks,
>>>> >> >>> > >>
>>>> >> >>> > >> Jiangjie (Becket) Qin
>>>> >> >>> > >>
>>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>> wshaoxuan@gmail.com>
>>>> >> >>> > >> wrote:
>>>> >> >>> > >>
>>>> >> >>> > >>> Hi Becket and Robert,
>>>> >> >>> > >>>
>>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>> connectors at
>>>> >> >>> the
>>>> >> >>> > >>> first beginning. We can start with a static page, and
>>>> upgrade it
>>>> >> >>> when we
>>>> >> >>> > >>> find a better solution for dynamic one with rich functions.
>>>> >> >>> > >>>
>>>> >> >>> > >>> Regards,
>>>> >> >>> > >>> Shaoxuan
>>>> >> >>> > >>>
>>>> >> >>> > >>>
>>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>> rmetzger@apache.org
>>>> >> >>> >
>>>> >> >>> > >>> wrote:
>>>> >> >>> > >>>
>>>> >> >>> > >>>> Hey Becket,
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> This is a great idea!
>>>> >> >>> > >>>> For this to be successful, we need to make sure the page
>>>> is placed
>>>> >> >>> > >>>> prominently so that the people submitting something will
>>>> get
>>>> >> >>> attention for
>>>> >> >>> > >>>> their contributions.
>>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
>>>> want
>>>> >> >>> features
>>>> >> >>> > >>>> such as up and downvoting or comments.
>>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
>>>> endorsed
>>>> >> >>> by
>>>> >> >>> > >>>> the community.
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> Does anybody here know any existing software that we
>>>> could use?
>>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>> >> >>> https://aur.archlinux.org/
>>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>>>> source
>>>> >> >>> code of this
>>>> >> >>> > >>>> portal is open source, but the layout and structure is
>>>> not an
>>>> >> >>> ideal fit for
>>>> >> >>> > >>>> our requirements)
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> Best,
>>>> >> >>> > >>>> Robert
>>>> >> >>> > >>>>
>>>> >> >>> > >>>>
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >> >>> > >>>> wrote:
>>>> >> >>> > >>>>
>>>> >> >>> > >>>>> Hi folks,
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> I would like to start a discussion thread about creating
>>>> a Flink
>>>> >> >>> > >>>>> ecosystem website. The website aims to help contributors
>>>> who
>>>> >> >>> have developed
>>>> >> >>> > >>>>> projects around Flink share their work with the
>>>> community.
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> Please see the following doc for more details.
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>>
>>>> >> >>>
>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> Thanks,
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>
>>>> >> >>>
>>>> >> >>
>>>>
>>>>
>>>>
>>>> --
>>>> Best regards / Met vriendelijke groeten,
>>>>
>>>> Niels Basjes
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

>
> I have a very capable and motivated frontend developer who would be
> willing to implement what I've mocked in my proposal.


That is awesome!

I created a Jira ticket[1] to Apache Infra and got the reply. It looks that
Apache infra team could provide a decent VM. The last piece is how to
ensure the data is persisted so we won't lose the project info / user
feedbacks when the VM is down. If Apache infra does not provide a
persistent storage for DB backup, we can always ask for multiple VMs and do
the fault tolerance by ourselves. It seems we can almost say the hardware
side is also ready.

Thanks,

Jiangjie (Becket) Qin

[1] https://issues.apache.org/jira/browse/INFRA-18010

On Fri, Mar 15, 2019 at 5:39 PM Robert Metzger <rm...@apache.org> wrote:

> Thank you for reaching out to Infra and the ember client.
> When I first saw the Ember repository, I thought it is the whole thing
> (frontend and backend), but while testing it, I realized it is "only" the
> frontend. I'm not sure if it makes sense to adjust the Ember observer
> client, or just write a simple UI from scratch.
> I have a very capable and motivated frontend developer who would be
> willing to implement what I've mocked in my proposal.
> In addition, I found somebody (Congxian Qiu) who seems to be eager to help
> with this project for the backend:
> https://github.com/rmetzger/flink-community-tools/issues/4
>
> For Infra: I made the same experience when asking for more GitHub
> permissions for "flinkbot": They didn't respond on their mailing list, only
> on Jira.
>
>
>
> On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com> wrote:
>
>> Thanks for writing up the specifications.
>>
>> Regarding the website source code, Austin found a website[1] whose
>> frontend code[2] is available publicly. It lacks some support (e.g login),
>> but it is still a good starting point. One thing is that I did not find a
>> License statement for that source code. I'll reach out to the author to see
>> if they have any concern over our usage.
>>
>> Apache Infra has not replied to my email regarding some details about the
>> VM. I'll open an infra Jira ticket tomorrow if there is still no response.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> [1] https://emberobserver.com/
>> [2] https://github.com/emberobserver/client
>>
>>
>>
>> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
>>> website. I guess the likelihood that they give out code from their company
>>> website is fairly low.
>>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>>> reactivate as part of this PR:
>>> https://github.com/apache/flink-web/pull/187
>>>
>>> Spark-packages.org did not respond to my request.
>>> I will propose a short specification in Becket's initial document.
>>>
>>>
>>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
>>>
>>>> Hi,
>>>>
>>>> The Beam project has something in this area that is simply a page
>>>> within their documentation website:
>>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>>
>>>> Niels Basjes
>>>>
>>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>>>> >
>>>> > Confluent hub for Kafka is another good example of this kind. I
>>>> personally like it over the spark site. May worth checking it out with
>>>> Kafka folks
>>>> >
>>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >>
>>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>>>> >> ecosystem page and the navigation.
>>>> >>
>>>> >> Thanks,
>>>> >>
>>>> >> Jiangjie (Becket) Qin
>>>> >>
>>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
>>>> wrote:
>>>> >>
>>>> >> > Okay. I will reach out to spark-packages.org and see if they are
>>>> willing
>>>> >> > to share.
>>>> >> >
>>>> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
>>>> with
>>>> >> > the "Software Projects" listed here:
>>>> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>>> and
>>>> >> > link it in the navigation?
>>>> >> >
>>>> >> > Best,
>>>> >> > Robert
>>>> >> >
>>>> >> >
>>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>> >> >
>>>> >> >> Hi Robert,
>>>> >> >>
>>>> >> >> I think it at least worths checking if spark-packages.org owners
>>>> are
>>>> >> >> willing to share. Thanks for volunteering to write the requirement
>>>> >> >> descriptions! In any case, that will be very helpful.
>>>> >> >>
>>>> >> >> Since a static page has almost no cost, and we will need it to
>>>> redirect
>>>> >> >> to the dynamic site anyways, how about we first do that while
>>>> working on
>>>> >> >> the dynamic website?
>>>> >> >>
>>>> >> >> Thanks,
>>>> >> >>
>>>> >> >> Jiangjie (Becket) Qin
>>>> >> >>
>>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org>
>>>> wrote:
>>>> >> >>
>>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We
>>>> could then
>>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>>>> have the
>>>> >> >>> resources in the community to quickly start with a dynamic site,
>>>> I'm
>>>> >> >>> not apposed.
>>>> >> >>>
>>>> >> >>> – Ufuk
>>>> >> >>>
>>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>>> rmetzger@apache.org>
>>>> >> >>> wrote:
>>>> >> >>> >
>>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>>>> hosted by
>>>> >> >>> Infra
>>>> >> >>> > look suitable.
>>>> >> >>> >
>>>> >> >>> > @Shaoxuan: There is actually already a static page. It used to
>>>> be
>>>> >> >>> linked,
>>>> >> >>> > but has been removed from the navigation bar for some reason.
>>>> This is
>>>> >> >>> the
>>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>>> >> >>> > We could update the page and add it back to the navigation bar
>>>> for the
>>>> >> >>> > coming weeks. What do you think?
>>>> >> >>> >
>>>> >> >>> > I would actually like to push for a dynamic page right away.
>>>> >> >>> >
>>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>>> sending the
>>>> >> >>> > owners of spark-packages.org a short note, if they are
>>>> interested in
>>>> >> >>> > sharing the source? We could maintain the code together in a
>>>> public
>>>> >> >>> repo.
>>>> >> >>> > If they are not interested in sharing, or we decide not to ask
>>>> in the
>>>> >> >>> first
>>>> >> >>> > place, I'm happy to write down a short description of the
>>>> requirements,
>>>> >> >>> > maybe some mockups. We could then see if we find somebody here
>>>> in the
>>>> >> >>> > community who's willing to implement it.
>>>> >> >>> > Given the number of people who are eager to contribute, I
>>>> believe we
>>>> >> >>> will
>>>> >> >>> > be able to find somebody pretty soon.
>>>> >> >>> >
>>>> >> >>> >
>>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >> >>> wrote:
>>>> >> >>> >
>>>> >> >>> > > Forgot to provide the link...
>>>> >> >>> > >
>>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
>>>> infra
>>>> >> >>> services)
>>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
>>>> provided
>>>> >> >>> by
>>>> >> >>> > > Apache Infra)
>>>> >> >>> > >
>>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >> >>> wrote:
>>>> >> >>> > >
>>>> >> >>> > >> Hi Robert,
>>>> >> >>> > >>
>>>> >> >>> > >> Thanks for the feedback. These are good points. We should
>>>> absolutely
>>>> >> >>> > >> shoot for a dynamic website to support more interactions in
>>>> the
>>>> >> >>> community.
>>>> >> >>> > >> There might be a few things to solve:
>>>> >> >>> > >> 1. The website code itself. An open source solution would
>>>> be great.
>>>> >> >>> TBH,
>>>> >> >>> > >> I do not have much experience on building a website. It'll
>>>> be great
>>>> >> >>> if
>>>> >> >>> > >> someone could help comment on the solution here.
>>>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides
>>>> a few
>>>> >> >>> > >> services[1] that Apache projects can leverage. I did not see
>>>> >> >>> database
>>>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
>>>> jail[2].
>>>> >> >>> > >>
>>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>>> >> >>> > >>
>>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>>>> >> >>> probably need
>>>> >> >>> > >> a page in the Flink official site anyways, even just
>>>> provide links
>>>> >> >>> it to
>>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>>>> static
>>>> >> >>> page seems
>>>> >> >>> > >> something we could start with while we are working on the
>>>> dynamic
>>>> >> >>> pages.
>>>> >> >>> > >>
>>>> >> >>> > >> Thanks,
>>>> >> >>> > >>
>>>> >> >>> > >> Jiangjie (Becket) Qin
>>>> >> >>> > >>
>>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>>> wshaoxuan@gmail.com>
>>>> >> >>> > >> wrote:
>>>> >> >>> > >>
>>>> >> >>> > >>> Hi Becket and Robert,
>>>> >> >>> > >>>
>>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>>> connectors at
>>>> >> >>> the
>>>> >> >>> > >>> first beginning. We can start with a static page, and
>>>> upgrade it
>>>> >> >>> when we
>>>> >> >>> > >>> find a better solution for dynamic one with rich functions.
>>>> >> >>> > >>>
>>>> >> >>> > >>> Regards,
>>>> >> >>> > >>> Shaoxuan
>>>> >> >>> > >>>
>>>> >> >>> > >>>
>>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>>> rmetzger@apache.org
>>>> >> >>> >
>>>> >> >>> > >>> wrote:
>>>> >> >>> > >>>
>>>> >> >>> > >>>> Hey Becket,
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> This is a great idea!
>>>> >> >>> > >>>> For this to be successful, we need to make sure the page
>>>> is placed
>>>> >> >>> > >>>> prominently so that the people submitting something will
>>>> get
>>>> >> >>> attention for
>>>> >> >>> > >>>> their contributions.
>>>> >> >>> > >>>> I think a dynamic site would probably be better, if we
>>>> want
>>>> >> >>> features
>>>> >> >>> > >>>> such as up and downvoting or comments.
>>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
>>>> endorsed
>>>> >> >>> by
>>>> >> >>> > >>>> the community.
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> Does anybody here know any existing software that we
>>>> could use?
>>>> >> >>> > >>>> The only think I was able to find is AUR:
>>>> >> >>> https://aur.archlinux.org/
>>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>>>> source
>>>> >> >>> code of this
>>>> >> >>> > >>>> portal is open source, but the layout and structure is
>>>> not an
>>>> >> >>> ideal fit for
>>>> >> >>> > >>>> our requirements)
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> Best,
>>>> >> >>> > >>>> Robert
>>>> >> >>> > >>>>
>>>> >> >>> > >>>>
>>>> >> >>> > >>>>
>>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>>> becket.qin@gmail.com>
>>>> >> >>> > >>>> wrote:
>>>> >> >>> > >>>>
>>>> >> >>> > >>>>> Hi folks,
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> I would like to start a discussion thread about creating
>>>> a Flink
>>>> >> >>> > >>>>> ecosystem website. The website aims to help contributors
>>>> who
>>>> >> >>> have developed
>>>> >> >>> > >>>>> projects around Flink share their work with the
>>>> community.
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> Please see the following doc for more details.
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>>
>>>> >> >>>
>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> Thanks,
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>>> >> >>> > >>>>>
>>>> >> >>> > >>>>
>>>> >> >>>
>>>> >> >>
>>>>
>>>>
>>>>
>>>> --
>>>> Best regards / Met vriendelijke groeten,
>>>>
>>>> Niels Basjes
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Thank you for reaching out to Infra and the ember client.
When I first saw the Ember repository, I thought it is the whole thing
(frontend and backend), but while testing it, I realized it is "only" the
frontend. I'm not sure if it makes sense to adjust the Ember observer
client, or just write a simple UI from scratch.
I have a very capable and motivated frontend developer who would be willing
to implement what I've mocked in my proposal.
In addition, I found somebody (Congxian Qiu) who seems to be eager to help
with this project for the backend:
https://github.com/rmetzger/flink-community-tools/issues/4

For Infra: I made the same experience when asking for more GitHub
permissions for "flinkbot": They didn't respond on their mailing list, only
on Jira.



On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com> wrote:

> Thanks for writing up the specifications.
>
> Regarding the website source code, Austin found a website[1] whose
> frontend code[2] is available publicly. It lacks some support (e.g login),
> but it is still a good starting point. One thing is that I did not find a
> License statement for that source code. I'll reach out to the author to see
> if they have any concern over our usage.
>
> Apache Infra has not replied to my email regarding some details about the
> VM. I'll open an infra Jira ticket tomorrow if there is still no response.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> [1] https://emberobserver.com/
> [2] https://github.com/emberobserver/client
>
>
>
> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
> wrote:
>
>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
>> website. I guess the likelihood that they give out code from their company
>> website is fairly low.
>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>> reactivate as part of this PR:
>> https://github.com/apache/flink-web/pull/187
>>
>> Spark-packages.org did not respond to my request.
>> I will propose a short specification in Becket's initial document.
>>
>>
>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
>>
>>> Hi,
>>>
>>> The Beam project has something in this area that is simply a page
>>> within their documentation website:
>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>
>>> Niels Basjes
>>>
>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>>> >
>>> > Confluent hub for Kafka is another good example of this kind. I
>>> personally like it over the spark site. May worth checking it out with
>>> Kafka folks
>>> >
>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >>
>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>>> >> ecosystem page and the navigation.
>>> >>
>>> >> Thanks,
>>> >>
>>> >> Jiangjie (Becket) Qin
>>> >>
>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>> >>
>>> >> > Okay. I will reach out to spark-packages.org and see if they are
>>> willing
>>> >> > to share.
>>> >> >
>>> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
>>> with
>>> >> > the "Software Projects" listed here:
>>> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>> and
>>> >> > link it in the navigation?
>>> >> >
>>> >> > Best,
>>> >> > Robert
>>> >> >
>>> >> >
>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >> >
>>> >> >> Hi Robert,
>>> >> >>
>>> >> >> I think it at least worths checking if spark-packages.org owners
>>> are
>>> >> >> willing to share. Thanks for volunteering to write the requirement
>>> >> >> descriptions! In any case, that will be very helpful.
>>> >> >>
>>> >> >> Since a static page has almost no cost, and we will need it to
>>> redirect
>>> >> >> to the dynamic site anyways, how about we first do that while
>>> working on
>>> >> >> the dynamic website?
>>> >> >>
>>> >> >> Thanks,
>>> >> >>
>>> >> >> Jiangjie (Becket) Qin
>>> >> >>
>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>>> >> >>
>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We could
>>> then
>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>>> have the
>>> >> >>> resources in the community to quickly start with a dynamic site,
>>> I'm
>>> >> >>> not apposed.
>>> >> >>>
>>> >> >>> – Ufuk
>>> >> >>>
>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>> rmetzger@apache.org>
>>> >> >>> wrote:
>>> >> >>> >
>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>>> hosted by
>>> >> >>> Infra
>>> >> >>> > look suitable.
>>> >> >>> >
>>> >> >>> > @Shaoxuan: There is actually already a static page. It used to
>>> be
>>> >> >>> linked,
>>> >> >>> > but has been removed from the navigation bar for some reason.
>>> This is
>>> >> >>> the
>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>> >> >>> > We could update the page and add it back to the navigation bar
>>> for the
>>> >> >>> > coming weeks. What do you think?
>>> >> >>> >
>>> >> >>> > I would actually like to push for a dynamic page right away.
>>> >> >>> >
>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>> sending the
>>> >> >>> > owners of spark-packages.org a short note, if they are
>>> interested in
>>> >> >>> > sharing the source? We could maintain the code together in a
>>> public
>>> >> >>> repo.
>>> >> >>> > If they are not interested in sharing, or we decide not to ask
>>> in the
>>> >> >>> first
>>> >> >>> > place, I'm happy to write down a short description of the
>>> requirements,
>>> >> >>> > maybe some mockups. We could then see if we find somebody here
>>> in the
>>> >> >>> > community who's willing to implement it.
>>> >> >>> > Given the number of people who are eager to contribute, I
>>> believe we
>>> >> >>> will
>>> >> >>> > be able to find somebody pretty soon.
>>> >> >>> >
>>> >> >>> >
>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <becket.qin@gmail.com
>>> >
>>> >> >>> wrote:
>>> >> >>> >
>>> >> >>> > > Forgot to provide the link...
>>> >> >>> > >
>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
>>> infra
>>> >> >>> services)
>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
>>> provided
>>> >> >>> by
>>> >> >>> > > Apache Infra)
>>> >> >>> > >
>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>> becket.qin@gmail.com>
>>> >> >>> wrote:
>>> >> >>> > >
>>> >> >>> > >> Hi Robert,
>>> >> >>> > >>
>>> >> >>> > >> Thanks for the feedback. These are good points. We should
>>> absolutely
>>> >> >>> > >> shoot for a dynamic website to support more interactions in
>>> the
>>> >> >>> community.
>>> >> >>> > >> There might be a few things to solve:
>>> >> >>> > >> 1. The website code itself. An open source solution would be
>>> great.
>>> >> >>> TBH,
>>> >> >>> > >> I do not have much experience on building a website. It'll
>>> be great
>>> >> >>> if
>>> >> >>> > >> someone could help comment on the solution here.
>>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides a
>>> few
>>> >> >>> > >> services[1] that Apache projects can leverage. I did not see
>>> >> >>> database
>>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
>>> jail[2].
>>> >> >>> > >>
>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>> >> >>> > >>
>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>>> >> >>> probably need
>>> >> >>> > >> a page in the Flink official site anyways, even just provide
>>> links
>>> >> >>> it to
>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>>> static
>>> >> >>> page seems
>>> >> >>> > >> something we could start with while we are working on the
>>> dynamic
>>> >> >>> pages.
>>> >> >>> > >>
>>> >> >>> > >> Thanks,
>>> >> >>> > >>
>>> >> >>> > >> Jiangjie (Becket) Qin
>>> >> >>> > >>
>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>> wshaoxuan@gmail.com>
>>> >> >>> > >> wrote:
>>> >> >>> > >>
>>> >> >>> > >>> Hi Becket and Robert,
>>> >> >>> > >>>
>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>> connectors at
>>> >> >>> the
>>> >> >>> > >>> first beginning. We can start with a static page, and
>>> upgrade it
>>> >> >>> when we
>>> >> >>> > >>> find a better solution for dynamic one with rich functions.
>>> >> >>> > >>>
>>> >> >>> > >>> Regards,
>>> >> >>> > >>> Shaoxuan
>>> >> >>> > >>>
>>> >> >>> > >>>
>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>> rmetzger@apache.org
>>> >> >>> >
>>> >> >>> > >>> wrote:
>>> >> >>> > >>>
>>> >> >>> > >>>> Hey Becket,
>>> >> >>> > >>>>
>>> >> >>> > >>>> This is a great idea!
>>> >> >>> > >>>> For this to be successful, we need to make sure the page
>>> is placed
>>> >> >>> > >>>> prominently so that the people submitting something will
>>> get
>>> >> >>> attention for
>>> >> >>> > >>>> their contributions.
>>> >> >>> > >>>> I think a dynamic site would probably be better, if we want
>>> >> >>> features
>>> >> >>> > >>>> such as up and downvoting or comments.
>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
>>> endorsed
>>> >> >>> by
>>> >> >>> > >>>> the community.
>>> >> >>> > >>>>
>>> >> >>> > >>>> Does anybody here know any existing software that we could
>>> use?
>>> >> >>> > >>>> The only think I was able to find is AUR:
>>> >> >>> https://aur.archlinux.org/
>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>>> source
>>> >> >>> code of this
>>> >> >>> > >>>> portal is open source, but the layout and structure is not
>>> an
>>> >> >>> ideal fit for
>>> >> >>> > >>>> our requirements)
>>> >> >>> > >>>>
>>> >> >>> > >>>> Best,
>>> >> >>> > >>>> Robert
>>> >> >>> > >>>>
>>> >> >>> > >>>>
>>> >> >>> > >>>>
>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>> becket.qin@gmail.com>
>>> >> >>> > >>>> wrote:
>>> >> >>> > >>>>
>>> >> >>> > >>>>> Hi folks,
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> I would like to start a discussion thread about creating
>>> a Flink
>>> >> >>> > >>>>> ecosystem website. The website aims to help contributors
>>> who
>>> >> >>> have developed
>>> >> >>> > >>>>> projects around Flink share their work with the community.
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> Please see the following doc for more details.
>>> >> >>> > >>>>>
>>> >> >>> > >>>>>
>>> >> >>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> Thanks,
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>> >> >>> > >>>>>
>>> >> >>> > >>>>
>>> >> >>>
>>> >> >>
>>>
>>>
>>>
>>> --
>>> Best regards / Met vriendelijke groeten,
>>>
>>> Niels Basjes
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Thank you for reaching out to Infra and the ember client.
When I first saw the Ember repository, I thought it is the whole thing
(frontend and backend), but while testing it, I realized it is "only" the
frontend. I'm not sure if it makes sense to adjust the Ember observer
client, or just write a simple UI from scratch.
I have a very capable and motivated frontend developer who would be willing
to implement what I've mocked in my proposal.
In addition, I found somebody (Congxian Qiu) who seems to be eager to help
with this project for the backend:
https://github.com/rmetzger/flink-community-tools/issues/4

For Infra: I made the same experience when asking for more GitHub
permissions for "flinkbot": They didn't respond on their mailing list, only
on Jira.



On Thu, Mar 14, 2019 at 2:45 PM Becket Qin <be...@gmail.com> wrote:

> Thanks for writing up the specifications.
>
> Regarding the website source code, Austin found a website[1] whose
> frontend code[2] is available publicly. It lacks some support (e.g login),
> but it is still a good starting point. One thing is that I did not find a
> License statement for that source code. I'll reach out to the author to see
> if they have any concern over our usage.
>
> Apache Infra has not replied to my email regarding some details about the
> VM. I'll open an infra Jira ticket tomorrow if there is still no response.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> [1] https://emberobserver.com/
> [2] https://github.com/emberobserver/client
>
>
>
> On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org>
> wrote:
>
>> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
>> website. I guess the likelihood that they give out code from their company
>> website is fairly low.
>> @Nils: Beam's page is similar to our Ecosystem page, which we'll
>> reactivate as part of this PR:
>> https://github.com/apache/flink-web/pull/187
>>
>> Spark-packages.org did not respond to my request.
>> I will propose a short specification in Becket's initial document.
>>
>>
>> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
>>
>>> Hi,
>>>
>>> The Beam project has something in this area that is simply a page
>>> within their documentation website:
>>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>>
>>> Niels Basjes
>>>
>>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>>> >
>>> > Confluent hub for Kafka is another good example of this kind. I
>>> personally like it over the spark site. May worth checking it out with
>>> Kafka folks
>>> >
>>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >>
>>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>>> >> ecosystem page and the navigation.
>>> >>
>>> >> Thanks,
>>> >>
>>> >> Jiangjie (Becket) Qin
>>> >>
>>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>> >>
>>> >> > Okay. I will reach out to spark-packages.org and see if they are
>>> willing
>>> >> > to share.
>>> >> >
>>> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
>>> with
>>> >> > the "Software Projects" listed here:
>>> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>>> and
>>> >> > link it in the navigation?
>>> >> >
>>> >> > Best,
>>> >> > Robert
>>> >> >
>>> >> >
>>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >> >
>>> >> >> Hi Robert,
>>> >> >>
>>> >> >> I think it at least worths checking if spark-packages.org owners
>>> are
>>> >> >> willing to share. Thanks for volunteering to write the requirement
>>> >> >> descriptions! In any case, that will be very helpful.
>>> >> >>
>>> >> >> Since a static page has almost no cost, and we will need it to
>>> redirect
>>> >> >> to the dynamic site anyways, how about we first do that while
>>> working on
>>> >> >> the dynamic website?
>>> >> >>
>>> >> >> Thanks,
>>> >> >>
>>> >> >> Jiangjie (Becket) Qin
>>> >> >>
>>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>>> >> >>
>>> >> >>> I like Shaoxuan's idea to keep this a static site first. We could
>>> then
>>> >> >>> iterate on this and make it a dynamic thing. Of course, if we
>>> have the
>>> >> >>> resources in the community to quickly start with a dynamic site,
>>> I'm
>>> >> >>> not apposed.
>>> >> >>>
>>> >> >>> – Ufuk
>>> >> >>>
>>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <
>>> rmetzger@apache.org>
>>> >> >>> wrote:
>>> >> >>> >
>>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>>> hosted by
>>> >> >>> Infra
>>> >> >>> > look suitable.
>>> >> >>> >
>>> >> >>> > @Shaoxuan: There is actually already a static page. It used to
>>> be
>>> >> >>> linked,
>>> >> >>> > but has been removed from the navigation bar for some reason.
>>> This is
>>> >> >>> the
>>> >> >>> > page: https://flink.apache.org/ecosystem.html
>>> >> >>> > We could update the page and add it back to the navigation bar
>>> for the
>>> >> >>> > coming weeks. What do you think?
>>> >> >>> >
>>> >> >>> > I would actually like to push for a dynamic page right away.
>>> >> >>> >
>>> >> >>> > I know it's kind of a bold move, but how do you feel about
>>> sending the
>>> >> >>> > owners of spark-packages.org a short note, if they are
>>> interested in
>>> >> >>> > sharing the source? We could maintain the code together in a
>>> public
>>> >> >>> repo.
>>> >> >>> > If they are not interested in sharing, or we decide not to ask
>>> in the
>>> >> >>> first
>>> >> >>> > place, I'm happy to write down a short description of the
>>> requirements,
>>> >> >>> > maybe some mockups. We could then see if we find somebody here
>>> in the
>>> >> >>> > community who's willing to implement it.
>>> >> >>> > Given the number of people who are eager to contribute, I
>>> believe we
>>> >> >>> will
>>> >> >>> > be able to find somebody pretty soon.
>>> >> >>> >
>>> >> >>> >
>>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <becket.qin@gmail.com
>>> >
>>> >> >>> wrote:
>>> >> >>> >
>>> >> >>> > > Forgot to provide the link...
>>> >> >>> > >
>>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
>>> infra
>>> >> >>> services)
>>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
>>> provided
>>> >> >>> by
>>> >> >>> > > Apache Infra)
>>> >> >>> > >
>>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>>> becket.qin@gmail.com>
>>> >> >>> wrote:
>>> >> >>> > >
>>> >> >>> > >> Hi Robert,
>>> >> >>> > >>
>>> >> >>> > >> Thanks for the feedback. These are good points. We should
>>> absolutely
>>> >> >>> > >> shoot for a dynamic website to support more interactions in
>>> the
>>> >> >>> community.
>>> >> >>> > >> There might be a few things to solve:
>>> >> >>> > >> 1. The website code itself. An open source solution would be
>>> great.
>>> >> >>> TBH,
>>> >> >>> > >> I do not have much experience on building a website. It'll
>>> be great
>>> >> >>> if
>>> >> >>> > >> someone could help comment on the solution here.
>>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides a
>>> few
>>> >> >>> > >> services[1] that Apache projects can leverage. I did not see
>>> >> >>> database
>>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
>>> jail[2].
>>> >> >>> > >>
>>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>>> >> >>> > >>
>>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>>> >> >>> probably need
>>> >> >>> > >> a page in the Flink official site anyways, even just provide
>>> links
>>> >> >>> it to
>>> >> >>> > >> the ecosystem website. So listing the connectors in that
>>> static
>>> >> >>> page seems
>>> >> >>> > >> something we could start with while we are working on the
>>> dynamic
>>> >> >>> pages.
>>> >> >>> > >>
>>> >> >>> > >> Thanks,
>>> >> >>> > >>
>>> >> >>> > >> Jiangjie (Becket) Qin
>>> >> >>> > >>
>>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>>> wshaoxuan@gmail.com>
>>> >> >>> > >> wrote:
>>> >> >>> > >>
>>> >> >>> > >>> Hi Becket and Robert,
>>> >> >>> > >>>
>>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>>> connectors at
>>> >> >>> the
>>> >> >>> > >>> first beginning. We can start with a static page, and
>>> upgrade it
>>> >> >>> when we
>>> >> >>> > >>> find a better solution for dynamic one with rich functions.
>>> >> >>> > >>>
>>> >> >>> > >>> Regards,
>>> >> >>> > >>> Shaoxuan
>>> >> >>> > >>>
>>> >> >>> > >>>
>>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>>> rmetzger@apache.org
>>> >> >>> >
>>> >> >>> > >>> wrote:
>>> >> >>> > >>>
>>> >> >>> > >>>> Hey Becket,
>>> >> >>> > >>>>
>>> >> >>> > >>>> This is a great idea!
>>> >> >>> > >>>> For this to be successful, we need to make sure the page
>>> is placed
>>> >> >>> > >>>> prominently so that the people submitting something will
>>> get
>>> >> >>> attention for
>>> >> >>> > >>>> their contributions.
>>> >> >>> > >>>> I think a dynamic site would probably be better, if we want
>>> >> >>> features
>>> >> >>> > >>>> such as up and downvoting or comments.
>>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
>>> endorsed
>>> >> >>> by
>>> >> >>> > >>>> the community.
>>> >> >>> > >>>>
>>> >> >>> > >>>> Does anybody here know any existing software that we could
>>> use?
>>> >> >>> > >>>> The only think I was able to find is AUR:
>>> >> >>> https://aur.archlinux.org/
>>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>>> source
>>> >> >>> code of this
>>> >> >>> > >>>> portal is open source, but the layout and structure is not
>>> an
>>> >> >>> ideal fit for
>>> >> >>> > >>>> our requirements)
>>> >> >>> > >>>>
>>> >> >>> > >>>> Best,
>>> >> >>> > >>>> Robert
>>> >> >>> > >>>>
>>> >> >>> > >>>>
>>> >> >>> > >>>>
>>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>>> becket.qin@gmail.com>
>>> >> >>> > >>>> wrote:
>>> >> >>> > >>>>
>>> >> >>> > >>>>> Hi folks,
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> I would like to start a discussion thread about creating
>>> a Flink
>>> >> >>> > >>>>> ecosystem website. The website aims to help contributors
>>> who
>>> >> >>> have developed
>>> >> >>> > >>>>> projects around Flink share their work with the community.
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> Please see the following doc for more details.
>>> >> >>> > >>>>>
>>> >> >>> > >>>>>
>>> >> >>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> Thanks,
>>> >> >>> > >>>>>
>>> >> >>> > >>>>> Jiangjie (Becket) Qin
>>> >> >>> > >>>>>
>>> >> >>> > >>>>
>>> >> >>>
>>> >> >>
>>>
>>>
>>>
>>> --
>>> Best regards / Met vriendelijke groeten,
>>>
>>> Niels Basjes
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Thanks for writing up the specifications.

Regarding the website source code, Austin found a website[1] whose frontend
code[2] is available publicly. It lacks some support (e.g login), but it is
still a good starting point. One thing is that I did not find a License
statement for that source code. I'll reach out to the author to see if they
have any concern over our usage.

Apache Infra has not replied to my email regarding some details about the
VM. I'll open an infra Jira ticket tomorrow if there is still no response.

Thanks,

Jiangjie (Becket) Qin

[1] https://emberobserver.com/
[2] https://github.com/emberobserver/client



On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org> wrote:

> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
> website. I guess the likelihood that they give out code from their company
> website is fairly low.
> @Nils: Beam's page is similar to our Ecosystem page, which we'll
> reactivate as part of this PR:
> https://github.com/apache/flink-web/pull/187
>
> Spark-packages.org did not respond to my request.
> I will propose a short specification in Becket's initial document.
>
>
> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
>
>> Hi,
>>
>> The Beam project has something in this area that is simply a page
>> within their documentation website:
>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>
>> Niels Basjes
>>
>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>> >
>> > Confluent hub for Kafka is another good example of this kind. I
>> personally like it over the spark site. May worth checking it out with
>> Kafka folks
>> >
>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:
>> >>
>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>> >> ecosystem page and the navigation.
>> >>
>> >> Thanks,
>> >>
>> >> Jiangjie (Becket) Qin
>> >>
>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
>> wrote:
>> >>
>> >> > Okay. I will reach out to spark-packages.org and see if they are
>> willing
>> >> > to share.
>> >> >
>> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
>> with
>> >> > the "Software Projects" listed here:
>> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>> and
>> >> > link it in the navigation?
>> >> >
>> >> > Best,
>> >> > Robert
>> >> >
>> >> >
>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
>> wrote:
>> >> >
>> >> >> Hi Robert,
>> >> >>
>> >> >> I think it at least worths checking if spark-packages.org owners
>> are
>> >> >> willing to share. Thanks for volunteering to write the requirement
>> >> >> descriptions! In any case, that will be very helpful.
>> >> >>
>> >> >> Since a static page has almost no cost, and we will need it to
>> redirect
>> >> >> to the dynamic site anyways, how about we first do that while
>> working on
>> >> >> the dynamic website?
>> >> >>
>> >> >> Thanks,
>> >> >>
>> >> >> Jiangjie (Becket) Qin
>> >> >>
>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>> >> >>
>> >> >>> I like Shaoxuan's idea to keep this a static site first. We could
>> then
>> >> >>> iterate on this and make it a dynamic thing. Of course, if we have
>> the
>> >> >>> resources in the community to quickly start with a dynamic site,
>> I'm
>> >> >>> not apposed.
>> >> >>>
>> >> >>> – Ufuk
>> >> >>>
>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rmetzger@apache.org
>> >
>> >> >>> wrote:
>> >> >>> >
>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>> hosted by
>> >> >>> Infra
>> >> >>> > look suitable.
>> >> >>> >
>> >> >>> > @Shaoxuan: There is actually already a static page. It used to be
>> >> >>> linked,
>> >> >>> > but has been removed from the navigation bar for some reason.
>> This is
>> >> >>> the
>> >> >>> > page: https://flink.apache.org/ecosystem.html
>> >> >>> > We could update the page and add it back to the navigation bar
>> for the
>> >> >>> > coming weeks. What do you think?
>> >> >>> >
>> >> >>> > I would actually like to push for a dynamic page right away.
>> >> >>> >
>> >> >>> > I know it's kind of a bold move, but how do you feel about
>> sending the
>> >> >>> > owners of spark-packages.org a short note, if they are
>> interested in
>> >> >>> > sharing the source? We could maintain the code together in a
>> public
>> >> >>> repo.
>> >> >>> > If they are not interested in sharing, or we decide not to ask
>> in the
>> >> >>> first
>> >> >>> > place, I'm happy to write down a short description of the
>> requirements,
>> >> >>> > maybe some mockups. We could then see if we find somebody here
>> in the
>> >> >>> > community who's willing to implement it.
>> >> >>> > Given the number of people who are eager to contribute, I
>> believe we
>> >> >>> will
>> >> >>> > be able to find somebody pretty soon.
>> >> >>> >
>> >> >>> >
>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
>> >> >>> wrote:
>> >> >>> >
>> >> >>> > > Forgot to provide the link...
>> >> >>> > >
>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
>> infra
>> >> >>> services)
>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
>> provided
>> >> >>> by
>> >> >>> > > Apache Infra)
>> >> >>> > >
>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>> becket.qin@gmail.com>
>> >> >>> wrote:
>> >> >>> > >
>> >> >>> > >> Hi Robert,
>> >> >>> > >>
>> >> >>> > >> Thanks for the feedback. These are good points. We should
>> absolutely
>> >> >>> > >> shoot for a dynamic website to support more interactions in
>> the
>> >> >>> community.
>> >> >>> > >> There might be a few things to solve:
>> >> >>> > >> 1. The website code itself. An open source solution would be
>> great.
>> >> >>> TBH,
>> >> >>> > >> I do not have much experience on building a website. It'll be
>> great
>> >> >>> if
>> >> >>> > >> someone could help comment on the solution here.
>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides a
>> few
>> >> >>> > >> services[1] that Apache projects can leverage. I did not see
>> >> >>> database
>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
>> jail[2].
>> >> >>> > >>
>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>> >> >>> > >>
>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>> >> >>> probably need
>> >> >>> > >> a page in the Flink official site anyways, even just provide
>> links
>> >> >>> it to
>> >> >>> > >> the ecosystem website. So listing the connectors in that
>> static
>> >> >>> page seems
>> >> >>> > >> something we could start with while we are working on the
>> dynamic
>> >> >>> pages.
>> >> >>> > >>
>> >> >>> > >> Thanks,
>> >> >>> > >>
>> >> >>> > >> Jiangjie (Becket) Qin
>> >> >>> > >>
>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>> wshaoxuan@gmail.com>
>> >> >>> > >> wrote:
>> >> >>> > >>
>> >> >>> > >>> Hi Becket and Robert,
>> >> >>> > >>>
>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>> connectors at
>> >> >>> the
>> >> >>> > >>> first beginning. We can start with a static page, and
>> upgrade it
>> >> >>> when we
>> >> >>> > >>> find a better solution for dynamic one with rich functions.
>> >> >>> > >>>
>> >> >>> > >>> Regards,
>> >> >>> > >>> Shaoxuan
>> >> >>> > >>>
>> >> >>> > >>>
>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>> rmetzger@apache.org
>> >> >>> >
>> >> >>> > >>> wrote:
>> >> >>> > >>>
>> >> >>> > >>>> Hey Becket,
>> >> >>> > >>>>
>> >> >>> > >>>> This is a great idea!
>> >> >>> > >>>> For this to be successful, we need to make sure the page is
>> placed
>> >> >>> > >>>> prominently so that the people submitting something will get
>> >> >>> attention for
>> >> >>> > >>>> their contributions.
>> >> >>> > >>>> I think a dynamic site would probably be better, if we want
>> >> >>> features
>> >> >>> > >>>> such as up and downvoting or comments.
>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
>> endorsed
>> >> >>> by
>> >> >>> > >>>> the community.
>> >> >>> > >>>>
>> >> >>> > >>>> Does anybody here know any existing software that we could
>> use?
>> >> >>> > >>>> The only think I was able to find is AUR:
>> >> >>> https://aur.archlinux.org/
>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>> source
>> >> >>> code of this
>> >> >>> > >>>> portal is open source, but the layout and structure is not
>> an
>> >> >>> ideal fit for
>> >> >>> > >>>> our requirements)
>> >> >>> > >>>>
>> >> >>> > >>>> Best,
>> >> >>> > >>>> Robert
>> >> >>> > >>>>
>> >> >>> > >>>>
>> >> >>> > >>>>
>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>> becket.qin@gmail.com>
>> >> >>> > >>>> wrote:
>> >> >>> > >>>>
>> >> >>> > >>>>> Hi folks,
>> >> >>> > >>>>>
>> >> >>> > >>>>> I would like to start a discussion thread about creating a
>> Flink
>> >> >>> > >>>>> ecosystem website. The website aims to help contributors
>> who
>> >> >>> have developed
>> >> >>> > >>>>> projects around Flink share their work with the community.
>> >> >>> > >>>>>
>> >> >>> > >>>>> Please see the following doc for more details.
>> >> >>> > >>>>>
>> >> >>> > >>>>>
>> >> >>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> >> >>> > >>>>>
>> >> >>> > >>>>> Thanks,
>> >> >>> > >>>>>
>> >> >>> > >>>>> Jiangjie (Becket) Qin
>> >> >>> > >>>>>
>> >> >>> > >>>>
>> >> >>>
>> >> >>
>>
>>
>>
>> --
>> Best regards / Met vriendelijke groeten,
>>
>> Niels Basjes
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Thanks for writing up the specifications.

Regarding the website source code, Austin found a website[1] whose frontend
code[2] is available publicly. It lacks some support (e.g login), but it is
still a good starting point. One thing is that I did not find a License
statement for that source code. I'll reach out to the author to see if they
have any concern over our usage.

Apache Infra has not replied to my email regarding some details about the
VM. I'll open an infra Jira ticket tomorrow if there is still no response.

Thanks,

Jiangjie (Becket) Qin

[1] https://emberobserver.com/
[2] https://github.com/emberobserver/client



On Thu, Mar 14, 2019 at 1:35 AM Robert Metzger <rm...@apache.org> wrote:

> @Bowen: I agree. Confluent Hub looks nicer, but it is on their company
> website. I guess the likelihood that they give out code from their company
> website is fairly low.
> @Nils: Beam's page is similar to our Ecosystem page, which we'll
> reactivate as part of this PR:
> https://github.com/apache/flink-web/pull/187
>
> Spark-packages.org did not respond to my request.
> I will propose a short specification in Becket's initial document.
>
>
> On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:
>
>> Hi,
>>
>> The Beam project has something in this area that is simply a page
>> within their documentation website:
>> https://beam.apache.org/documentation/sdks/java-thirdparty/
>>
>> Niels Basjes
>>
>> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>> >
>> > Confluent hub for Kafka is another good example of this kind. I
>> personally like it over the spark site. May worth checking it out with
>> Kafka folks
>> >
>> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:
>> >>
>> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>> >> ecosystem page and the navigation.
>> >>
>> >> Thanks,
>> >>
>> >> Jiangjie (Becket) Qin
>> >>
>> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
>> wrote:
>> >>
>> >> > Okay. I will reach out to spark-packages.org and see if they are
>> willing
>> >> > to share.
>> >> >
>> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
>> with
>> >> > the "Software Projects" listed here:
>> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
>> and
>> >> > link it in the navigation?
>> >> >
>> >> > Best,
>> >> > Robert
>> >> >
>> >> >
>> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
>> wrote:
>> >> >
>> >> >> Hi Robert,
>> >> >>
>> >> >> I think it at least worths checking if spark-packages.org owners
>> are
>> >> >> willing to share. Thanks for volunteering to write the requirement
>> >> >> descriptions! In any case, that will be very helpful.
>> >> >>
>> >> >> Since a static page has almost no cost, and we will need it to
>> redirect
>> >> >> to the dynamic site anyways, how about we first do that while
>> working on
>> >> >> the dynamic website?
>> >> >>
>> >> >> Thanks,
>> >> >>
>> >> >> Jiangjie (Becket) Qin
>> >> >>
>> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>> >> >>
>> >> >>> I like Shaoxuan's idea to keep this a static site first. We could
>> then
>> >> >>> iterate on this and make it a dynamic thing. Of course, if we have
>> the
>> >> >>> resources in the community to quickly start with a dynamic site,
>> I'm
>> >> >>> not apposed.
>> >> >>>
>> >> >>> – Ufuk
>> >> >>>
>> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rmetzger@apache.org
>> >
>> >> >>> wrote:
>> >> >>> >
>> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
>> hosted by
>> >> >>> Infra
>> >> >>> > look suitable.
>> >> >>> >
>> >> >>> > @Shaoxuan: There is actually already a static page. It used to be
>> >> >>> linked,
>> >> >>> > but has been removed from the navigation bar for some reason.
>> This is
>> >> >>> the
>> >> >>> > page: https://flink.apache.org/ecosystem.html
>> >> >>> > We could update the page and add it back to the navigation bar
>> for the
>> >> >>> > coming weeks. What do you think?
>> >> >>> >
>> >> >>> > I would actually like to push for a dynamic page right away.
>> >> >>> >
>> >> >>> > I know it's kind of a bold move, but how do you feel about
>> sending the
>> >> >>> > owners of spark-packages.org a short note, if they are
>> interested in
>> >> >>> > sharing the source? We could maintain the code together in a
>> public
>> >> >>> repo.
>> >> >>> > If they are not interested in sharing, or we decide not to ask
>> in the
>> >> >>> first
>> >> >>> > place, I'm happy to write down a short description of the
>> requirements,
>> >> >>> > maybe some mockups. We could then see if we find somebody here
>> in the
>> >> >>> > community who's willing to implement it.
>> >> >>> > Given the number of people who are eager to contribute, I
>> believe we
>> >> >>> will
>> >> >>> > be able to find somebody pretty soon.
>> >> >>> >
>> >> >>> >
>> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
>> >> >>> wrote:
>> >> >>> >
>> >> >>> > > Forgot to provide the link...
>> >> >>> > >
>> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
>> infra
>> >> >>> services)
>> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
>> provided
>> >> >>> by
>> >> >>> > > Apache Infra)
>> >> >>> > >
>> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
>> becket.qin@gmail.com>
>> >> >>> wrote:
>> >> >>> > >
>> >> >>> > >> Hi Robert,
>> >> >>> > >>
>> >> >>> > >> Thanks for the feedback. These are good points. We should
>> absolutely
>> >> >>> > >> shoot for a dynamic website to support more interactions in
>> the
>> >> >>> community.
>> >> >>> > >> There might be a few things to solve:
>> >> >>> > >> 1. The website code itself. An open source solution would be
>> great.
>> >> >>> TBH,
>> >> >>> > >> I do not have much experience on building a website. It'll be
>> great
>> >> >>> if
>> >> >>> > >> someone could help comment on the solution here.
>> >> >>> > >> 2. The hardware to host the website. Apache Infra provides a
>> few
>> >> >>> > >> services[1] that Apache projects can leverage. I did not see
>> >> >>> database
>> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
>> jail[2].
>> >> >>> > >>
>> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
>> >> >>> > >>
>> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>> >> >>> probably need
>> >> >>> > >> a page in the Flink official site anyways, even just provide
>> links
>> >> >>> it to
>> >> >>> > >> the ecosystem website. So listing the connectors in that
>> static
>> >> >>> page seems
>> >> >>> > >> something we could start with while we are working on the
>> dynamic
>> >> >>> pages.
>> >> >>> > >>
>> >> >>> > >> Thanks,
>> >> >>> > >>
>> >> >>> > >> Jiangjie (Becket) Qin
>> >> >>> > >>
>> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
>> wshaoxuan@gmail.com>
>> >> >>> > >> wrote:
>> >> >>> > >>
>> >> >>> > >>> Hi Becket and Robert,
>> >> >>> > >>>
>> >> >>> > >>> I like this idea!  Let us roll this out with Flink
>> connectors at
>> >> >>> the
>> >> >>> > >>> first beginning. We can start with a static page, and
>> upgrade it
>> >> >>> when we
>> >> >>> > >>> find a better solution for dynamic one with rich functions.
>> >> >>> > >>>
>> >> >>> > >>> Regards,
>> >> >>> > >>> Shaoxuan
>> >> >>> > >>>
>> >> >>> > >>>
>> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
>> rmetzger@apache.org
>> >> >>> >
>> >> >>> > >>> wrote:
>> >> >>> > >>>
>> >> >>> > >>>> Hey Becket,
>> >> >>> > >>>>
>> >> >>> > >>>> This is a great idea!
>> >> >>> > >>>> For this to be successful, we need to make sure the page is
>> placed
>> >> >>> > >>>> prominently so that the people submitting something will get
>> >> >>> attention for
>> >> >>> > >>>> their contributions.
>> >> >>> > >>>> I think a dynamic site would probably be better, if we want
>> >> >>> features
>> >> >>> > >>>> such as up and downvoting or comments.
>> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
>> endorsed
>> >> >>> by
>> >> >>> > >>>> the community.
>> >> >>> > >>>>
>> >> >>> > >>>> Does anybody here know any existing software that we could
>> use?
>> >> >>> > >>>> The only think I was able to find is AUR:
>> >> >>> https://aur.archlinux.org/
>> >> >>> > >>>> (which is a community packages site for Arch Linux. The
>> source
>> >> >>> code of this
>> >> >>> > >>>> portal is open source, but the layout and structure is not
>> an
>> >> >>> ideal fit for
>> >> >>> > >>>> our requirements)
>> >> >>> > >>>>
>> >> >>> > >>>> Best,
>> >> >>> > >>>> Robert
>> >> >>> > >>>>
>> >> >>> > >>>>
>> >> >>> > >>>>
>> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
>> becket.qin@gmail.com>
>> >> >>> > >>>> wrote:
>> >> >>> > >>>>
>> >> >>> > >>>>> Hi folks,
>> >> >>> > >>>>>
>> >> >>> > >>>>> I would like to start a discussion thread about creating a
>> Flink
>> >> >>> > >>>>> ecosystem website. The website aims to help contributors
>> who
>> >> >>> have developed
>> >> >>> > >>>>> projects around Flink share their work with the community.
>> >> >>> > >>>>>
>> >> >>> > >>>>> Please see the following doc for more details.
>> >> >>> > >>>>>
>> >> >>> > >>>>>
>> >> >>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> >> >>> > >>>>>
>> >> >>> > >>>>> Thanks,
>> >> >>> > >>>>>
>> >> >>> > >>>>> Jiangjie (Becket) Qin
>> >> >>> > >>>>>
>> >> >>> > >>>>
>> >> >>>
>> >> >>
>>
>>
>>
>> --
>> Best regards / Met vriendelijke groeten,
>>
>> Niels Basjes
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

@Bowen: I agree. Confluent Hub looks nicer, but it is on their company
website. I guess the likelihood that they give out code from their company
website is fairly low.
@Nils: Beam's page is similar to our Ecosystem page, which we'll reactivate
as part of this PR: https://github.com/apache/flink-web/pull/187

Spark-packages.org did not respond to my request.
I will propose a short specification in Becket's initial document.


On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:

> Hi,
>
> The Beam project has something in this area that is simply a page
> within their documentation website:
> https://beam.apache.org/documentation/sdks/java-thirdparty/
>
> Niels Basjes
>
> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
> >
> > Confluent hub for Kafka is another good example of this kind. I
> personally like it over the spark site. May worth checking it out with
> Kafka folks
> >
> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:
> >>
> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
> >> ecosystem page and the navigation.
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
> wrote:
> >>
> >> > Okay. I will reach out to spark-packages.org and see if they are
> willing
> >> > to share.
> >> >
> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
> with
> >> > the "Software Projects" listed here:
> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
> and
> >> > link it in the navigation?
> >> >
> >> > Best,
> >> > Robert
> >> >
> >> >
> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
> wrote:
> >> >
> >> >> Hi Robert,
> >> >>
> >> >> I think it at least worths checking if spark-packages.org owners are
> >> >> willing to share. Thanks for volunteering to write the requirement
> >> >> descriptions! In any case, that will be very helpful.
> >> >>
> >> >> Since a static page has almost no cost, and we will need it to
> redirect
> >> >> to the dynamic site anyways, how about we first do that while
> working on
> >> >> the dynamic website?
> >> >>
> >> >> Thanks,
> >> >>
> >> >> Jiangjie (Becket) Qin
> >> >>
> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
> >> >>
> >> >>> I like Shaoxuan's idea to keep this a static site first. We could
> then
> >> >>> iterate on this and make it a dynamic thing. Of course, if we have
> the
> >> >>> resources in the community to quickly start with a dynamic site, I'm
> >> >>> not apposed.
> >> >>>
> >> >>> – Ufuk
> >> >>>
> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
> >> >>> wrote:
> >> >>> >
> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
> hosted by
> >> >>> Infra
> >> >>> > look suitable.
> >> >>> >
> >> >>> > @Shaoxuan: There is actually already a static page. It used to be
> >> >>> linked,
> >> >>> > but has been removed from the navigation bar for some reason.
> This is
> >> >>> the
> >> >>> > page: https://flink.apache.org/ecosystem.html
> >> >>> > We could update the page and add it back to the navigation bar
> for the
> >> >>> > coming weeks. What do you think?
> >> >>> >
> >> >>> > I would actually like to push for a dynamic page right away.
> >> >>> >
> >> >>> > I know it's kind of a bold move, but how do you feel about
> sending the
> >> >>> > owners of spark-packages.org a short note, if they are
> interested in
> >> >>> > sharing the source? We could maintain the code together in a
> public
> >> >>> repo.
> >> >>> > If they are not interested in sharing, or we decide not to ask in
> the
> >> >>> first
> >> >>> > place, I'm happy to write down a short description of the
> requirements,
> >> >>> > maybe some mockups. We could then see if we find somebody here in
> the
> >> >>> > community who's willing to implement it.
> >> >>> > Given the number of people who are eager to contribute, I believe
> we
> >> >>> will
> >> >>> > be able to find somebody pretty soon.
> >> >>> >
> >> >>> >
> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
> >> >>> wrote:
> >> >>> >
> >> >>> > > Forgot to provide the link...
> >> >>> > >
> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
> infra
> >> >>> services)
> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
> provided
> >> >>> by
> >> >>> > > Apache Infra)
> >> >>> > >
> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
> becket.qin@gmail.com>
> >> >>> wrote:
> >> >>> > >
> >> >>> > >> Hi Robert,
> >> >>> > >>
> >> >>> > >> Thanks for the feedback. These are good points. We should
> absolutely
> >> >>> > >> shoot for a dynamic website to support more interactions in the
> >> >>> community.
> >> >>> > >> There might be a few things to solve:
> >> >>> > >> 1. The website code itself. An open source solution would be
> great.
> >> >>> TBH,
> >> >>> > >> I do not have much experience on building a website. It'll be
> great
> >> >>> if
> >> >>> > >> someone could help comment on the solution here.
> >> >>> > >> 2. The hardware to host the website. Apache Infra provides a
> few
> >> >>> > >> services[1] that Apache projects can leverage. I did not see
> >> >>> database
> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
> jail[2].
> >> >>> > >>
> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >> >>> > >>
> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
> >> >>> probably need
> >> >>> > >> a page in the Flink official site anyways, even just provide
> links
> >> >>> it to
> >> >>> > >> the ecosystem website. So listing the connectors in that static
> >> >>> page seems
> >> >>> > >> something we could start with while we are working on the
> dynamic
> >> >>> pages.
> >> >>> > >>
> >> >>> > >> Thanks,
> >> >>> > >>
> >> >>> > >> Jiangjie (Becket) Qin
> >> >>> > >>
> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> wshaoxuan@gmail.com>
> >> >>> > >> wrote:
> >> >>> > >>
> >> >>> > >>> Hi Becket and Robert,
> >> >>> > >>>
> >> >>> > >>> I like this idea!  Let us roll this out with Flink connectors
> at
> >> >>> the
> >> >>> > >>> first beginning. We can start with a static page, and upgrade
> it
> >> >>> when we
> >> >>> > >>> find a better solution for dynamic one with rich functions.
> >> >>> > >>>
> >> >>> > >>> Regards,
> >> >>> > >>> Shaoxuan
> >> >>> > >>>
> >> >>> > >>>
> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> rmetzger@apache.org
> >> >>> >
> >> >>> > >>> wrote:
> >> >>> > >>>
> >> >>> > >>>> Hey Becket,
> >> >>> > >>>>
> >> >>> > >>>> This is a great idea!
> >> >>> > >>>> For this to be successful, we need to make sure the page is
> placed
> >> >>> > >>>> prominently so that the people submitting something will get
> >> >>> attention for
> >> >>> > >>>> their contributions.
> >> >>> > >>>> I think a dynamic site would probably be better, if we want
> >> >>> features
> >> >>> > >>>> such as up and downvoting or comments.
> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
> endorsed
> >> >>> by
> >> >>> > >>>> the community.
> >> >>> > >>>>
> >> >>> > >>>> Does anybody here know any existing software that we could
> use?
> >> >>> > >>>> The only think I was able to find is AUR:
> >> >>> https://aur.archlinux.org/
> >> >>> > >>>> (which is a community packages site for Arch Linux. The
> source
> >> >>> code of this
> >> >>> > >>>> portal is open source, but the layout and structure is not an
> >> >>> ideal fit for
> >> >>> > >>>> our requirements)
> >> >>> > >>>>
> >> >>> > >>>> Best,
> >> >>> > >>>> Robert
> >> >>> > >>>>
> >> >>> > >>>>
> >> >>> > >>>>
> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> becket.qin@gmail.com>
> >> >>> > >>>> wrote:
> >> >>> > >>>>
> >> >>> > >>>>> Hi folks,
> >> >>> > >>>>>
> >> >>> > >>>>> I would like to start a discussion thread about creating a
> Flink
> >> >>> > >>>>> ecosystem website. The website aims to help contributors who
> >> >>> have developed
> >> >>> > >>>>> projects around Flink share their work with the community.
> >> >>> > >>>>>
> >> >>> > >>>>> Please see the following doc for more details.
> >> >>> > >>>>>
> >> >>> > >>>>>
> >> >>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >> >>> > >>>>>
> >> >>> > >>>>> Thanks,
> >> >>> > >>>>>
> >> >>> > >>>>> Jiangjie (Becket) Qin
> >> >>> > >>>>>
> >> >>> > >>>>
> >> >>>
> >> >>
>
>
>
> --
> Best regards / Met vriendelijke groeten,
>
> Niels Basjes
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

@Bowen: I agree. Confluent Hub looks nicer, but it is on their company
website. I guess the likelihood that they give out code from their company
website is fairly low.
@Nils: Beam's page is similar to our Ecosystem page, which we'll reactivate
as part of this PR: https://github.com/apache/flink-web/pull/187

Spark-packages.org did not respond to my request.
I will propose a short specification in Becket's initial document.


On Mon, Mar 11, 2019 at 11:38 AM Niels Basjes <Ni...@basjes.nl> wrote:

> Hi,
>
> The Beam project has something in this area that is simply a page
> within their documentation website:
> https://beam.apache.org/documentation/sdks/java-thirdparty/
>
> Niels Basjes
>
> On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
> >
> > Confluent hub for Kafka is another good example of this kind. I
> personally like it over the spark site. May worth checking it out with
> Kafka folks
> >
> > On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:
> >>
> >> Absolutely! Thanks for the pointer. I'll submit a PR to update the
> >> ecosystem page and the navigation.
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org>
> wrote:
> >>
> >> > Okay. I will reach out to spark-packages.org and see if they are
> willing
> >> > to share.
> >> >
> >> > Do you want to raise a PR to update the ecosystem page (maybe sync
> with
> >> > the "Software Projects" listed here:
> >> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink)
> and
> >> > link it in the navigation?
> >> >
> >> > Best,
> >> > Robert
> >> >
> >> >
> >> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com>
> wrote:
> >> >
> >> >> Hi Robert,
> >> >>
> >> >> I think it at least worths checking if spark-packages.org owners are
> >> >> willing to share. Thanks for volunteering to write the requirement
> >> >> descriptions! In any case, that will be very helpful.
> >> >>
> >> >> Since a static page has almost no cost, and we will need it to
> redirect
> >> >> to the dynamic site anyways, how about we first do that while
> working on
> >> >> the dynamic website?
> >> >>
> >> >> Thanks,
> >> >>
> >> >> Jiangjie (Becket) Qin
> >> >>
> >> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
> >> >>
> >> >>> I like Shaoxuan's idea to keep this a static site first. We could
> then
> >> >>> iterate on this and make it a dynamic thing. Of course, if we have
> the
> >> >>> resources in the community to quickly start with a dynamic site, I'm
> >> >>> not apposed.
> >> >>>
> >> >>> – Ufuk
> >> >>>
> >> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
> >> >>> wrote:
> >> >>> >
> >> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs
> hosted by
> >> >>> Infra
> >> >>> > look suitable.
> >> >>> >
> >> >>> > @Shaoxuan: There is actually already a static page. It used to be
> >> >>> linked,
> >> >>> > but has been removed from the navigation bar for some reason.
> This is
> >> >>> the
> >> >>> > page: https://flink.apache.org/ecosystem.html
> >> >>> > We could update the page and add it back to the navigation bar
> for the
> >> >>> > coming weeks. What do you think?
> >> >>> >
> >> >>> > I would actually like to push for a dynamic page right away.
> >> >>> >
> >> >>> > I know it's kind of a bold move, but how do you feel about
> sending the
> >> >>> > owners of spark-packages.org a short note, if they are
> interested in
> >> >>> > sharing the source? We could maintain the code together in a
> public
> >> >>> repo.
> >> >>> > If they are not interested in sharing, or we decide not to ask in
> the
> >> >>> first
> >> >>> > place, I'm happy to write down a short description of the
> requirements,
> >> >>> > maybe some mockups. We could then see if we find somebody here in
> the
> >> >>> > community who's willing to implement it.
> >> >>> > Given the number of people who are eager to contribute, I believe
> we
> >> >>> will
> >> >>> > be able to find somebody pretty soon.
> >> >>> >
> >> >>> >
> >> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
> >> >>> wrote:
> >> >>> >
> >> >>> > > Forgot to provide the link...
> >> >>> > >
> >> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache
> infra
> >> >>> services)
> >> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
> provided
> >> >>> by
> >> >>> > > Apache Infra)
> >> >>> > >
> >> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <
> becket.qin@gmail.com>
> >> >>> wrote:
> >> >>> > >
> >> >>> > >> Hi Robert,
> >> >>> > >>
> >> >>> > >> Thanks for the feedback. These are good points. We should
> absolutely
> >> >>> > >> shoot for a dynamic website to support more interactions in the
> >> >>> community.
> >> >>> > >> There might be a few things to solve:
> >> >>> > >> 1. The website code itself. An open source solution would be
> great.
> >> >>> TBH,
> >> >>> > >> I do not have much experience on building a website. It'll be
> great
> >> >>> if
> >> >>> > >> someone could help comment on the solution here.
> >> >>> > >> 2. The hardware to host the website. Apache Infra provides a
> few
> >> >>> > >> services[1] that Apache projects can leverage. I did not see
> >> >>> database
> >> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
> jail[2].
> >> >>> > >>
> >> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >> >>> > >>
> >> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
> >> >>> probably need
> >> >>> > >> a page in the Flink official site anyways, even just provide
> links
> >> >>> it to
> >> >>> > >> the ecosystem website. So listing the connectors in that static
> >> >>> page seems
> >> >>> > >> something we could start with while we are working on the
> dynamic
> >> >>> pages.
> >> >>> > >>
> >> >>> > >> Thanks,
> >> >>> > >>
> >> >>> > >> Jiangjie (Becket) Qin
> >> >>> > >>
> >> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> wshaoxuan@gmail.com>
> >> >>> > >> wrote:
> >> >>> > >>
> >> >>> > >>> Hi Becket and Robert,
> >> >>> > >>>
> >> >>> > >>> I like this idea!  Let us roll this out with Flink connectors
> at
> >> >>> the
> >> >>> > >>> first beginning. We can start with a static page, and upgrade
> it
> >> >>> when we
> >> >>> > >>> find a better solution for dynamic one with rich functions.
> >> >>> > >>>
> >> >>> > >>> Regards,
> >> >>> > >>> Shaoxuan
> >> >>> > >>>
> >> >>> > >>>
> >> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> rmetzger@apache.org
> >> >>> >
> >> >>> > >>> wrote:
> >> >>> > >>>
> >> >>> > >>>> Hey Becket,
> >> >>> > >>>>
> >> >>> > >>>> This is a great idea!
> >> >>> > >>>> For this to be successful, we need to make sure the page is
> placed
> >> >>> > >>>> prominently so that the people submitting something will get
> >> >>> attention for
> >> >>> > >>>> their contributions.
> >> >>> > >>>> I think a dynamic site would probably be better, if we want
> >> >>> features
> >> >>> > >>>> such as up and downvoting or comments.
> >> >>> > >>>> I would also like this to be hosted on Apache infra, and
> endorsed
> >> >>> by
> >> >>> > >>>> the community.
> >> >>> > >>>>
> >> >>> > >>>> Does anybody here know any existing software that we could
> use?
> >> >>> > >>>> The only think I was able to find is AUR:
> >> >>> https://aur.archlinux.org/
> >> >>> > >>>> (which is a community packages site for Arch Linux. The
> source
> >> >>> code of this
> >> >>> > >>>> portal is open source, but the layout and structure is not an
> >> >>> ideal fit for
> >> >>> > >>>> our requirements)
> >> >>> > >>>>
> >> >>> > >>>> Best,
> >> >>> > >>>> Robert
> >> >>> > >>>>
> >> >>> > >>>>
> >> >>> > >>>>
> >> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> becket.qin@gmail.com>
> >> >>> > >>>> wrote:
> >> >>> > >>>>
> >> >>> > >>>>> Hi folks,
> >> >>> > >>>>>
> >> >>> > >>>>> I would like to start a discussion thread about creating a
> Flink
> >> >>> > >>>>> ecosystem website. The website aims to help contributors who
> >> >>> have developed
> >> >>> > >>>>> projects around Flink share their work with the community.
> >> >>> > >>>>>
> >> >>> > >>>>> Please see the following doc for more details.
> >> >>> > >>>>>
> >> >>> > >>>>>
> >> >>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >> >>> > >>>>>
> >> >>> > >>>>> Thanks,
> >> >>> > >>>>>
> >> >>> > >>>>> Jiangjie (Becket) Qin
> >> >>> > >>>>>
> >> >>> > >>>>
> >> >>>
> >> >>
>
>
>
> --
> Best regards / Met vriendelijke groeten,
>
> Niels Basjes
>

Re: [DISCUSS] Create a Flink ecosystem website

[Niels Basjes <Ni...@basjes.nl>]

Hi,

The Beam project has something in this area that is simply a page
within their documentation website:
https://beam.apache.org/documentation/sdks/java-thirdparty/

Niels Basjes

On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>
> Confluent hub for Kafka is another good example of this kind. I personally like it over the spark site. May worth checking it out with Kafka folks
>
> On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:
>>
>> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>> ecosystem page and the navigation.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org> wrote:
>>
>> > Okay. I will reach out to spark-packages.org and see if they are willing
>> > to share.
>> >
>> > Do you want to raise a PR to update the ecosystem page (maybe sync with
>> > the "Software Projects" listed here:
>> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
>> > link it in the navigation?
>> >
>> > Best,
>> > Robert
>> >
>> >
>> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:
>> >
>> >> Hi Robert,
>> >>
>> >> I think it at least worths checking if spark-packages.org owners are
>> >> willing to share. Thanks for volunteering to write the requirement
>> >> descriptions! In any case, that will be very helpful.
>> >>
>> >> Since a static page has almost no cost, and we will need it to redirect
>> >> to the dynamic site anyways, how about we first do that while working on
>> >> the dynamic website?
>> >>
>> >> Thanks,
>> >>
>> >> Jiangjie (Becket) Qin
>> >>
>> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>> >>
>> >>> I like Shaoxuan's idea to keep this a static site first. We could then
>> >>> iterate on this and make it a dynamic thing. Of course, if we have the
>> >>> resources in the community to quickly start with a dynamic site, I'm
>> >>> not apposed.
>> >>>
>> >>> – Ufuk
>> >>>
>> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
>> >>> wrote:
>> >>> >
>> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
>> >>> Infra
>> >>> > look suitable.
>> >>> >
>> >>> > @Shaoxuan: There is actually already a static page. It used to be
>> >>> linked,
>> >>> > but has been removed from the navigation bar for some reason. This is
>> >>> the
>> >>> > page: https://flink.apache.org/ecosystem.html
>> >>> > We could update the page and add it back to the navigation bar for the
>> >>> > coming weeks. What do you think?
>> >>> >
>> >>> > I would actually like to push for a dynamic page right away.
>> >>> >
>> >>> > I know it's kind of a bold move, but how do you feel about sending the
>> >>> > owners of spark-packages.org a short note, if they are interested in
>> >>> > sharing the source? We could maintain the code together in a public
>> >>> repo.
>> >>> > If they are not interested in sharing, or we decide not to ask in the
>> >>> first
>> >>> > place, I'm happy to write down a short description of the requirements,
>> >>> > maybe some mockups. We could then see if we find somebody here in the
>> >>> > community who's willing to implement it.
>> >>> > Given the number of people who are eager to contribute, I believe we
>> >>> will
>> >>> > be able to find somebody pretty soon.
>> >>> >
>> >>> >
>> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
>> >>> wrote:
>> >>> >
>> >>> > > Forgot to provide the link...
>> >>> > >
>> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
>> >>> services)
>> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided
>> >>> by
>> >>> > > Apache Infra)
>> >>> > >
>> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
>> >>> wrote:
>> >>> > >
>> >>> > >> Hi Robert,
>> >>> > >>
>> >>> > >> Thanks for the feedback. These are good points. We should absolutely
>> >>> > >> shoot for a dynamic website to support more interactions in the
>> >>> community.
>> >>> > >> There might be a few things to solve:
>> >>> > >> 1. The website code itself. An open source solution would be great.
>> >>> TBH,
>> >>> > >> I do not have much experience on building a website. It'll be great
>> >>> if
>> >>> > >> someone could help comment on the solution here.
>> >>> > >> 2. The hardware to host the website. Apache Infra provides a few
>> >>> > >> services[1] that Apache projects can leverage. I did not see
>> >>> database
>> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>> >>> > >>
>> >>> > >> @Bowen & vino, thanks for the positive feedback!
>> >>> > >>
>> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>> >>> probably need
>> >>> > >> a page in the Flink official site anyways, even just provide links
>> >>> it to
>> >>> > >> the ecosystem website. So listing the connectors in that static
>> >>> page seems
>> >>> > >> something we could start with while we are working on the dynamic
>> >>> pages.
>> >>> > >>
>> >>> > >> Thanks,
>> >>> > >>
>> >>> > >> Jiangjie (Becket) Qin
>> >>> > >>
>> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>> >>> > >> wrote:
>> >>> > >>
>> >>> > >>> Hi Becket and Robert,
>> >>> > >>>
>> >>> > >>> I like this idea!  Let us roll this out with Flink connectors at
>> >>> the
>> >>> > >>> first beginning. We can start with a static page, and upgrade it
>> >>> when we
>> >>> > >>> find a better solution for dynamic one with rich functions.
>> >>> > >>>
>> >>> > >>> Regards,
>> >>> > >>> Shaoxuan
>> >>> > >>>
>> >>> > >>>
>> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rmetzger@apache.org
>> >>> >
>> >>> > >>> wrote:
>> >>> > >>>
>> >>> > >>>> Hey Becket,
>> >>> > >>>>
>> >>> > >>>> This is a great idea!
>> >>> > >>>> For this to be successful, we need to make sure the page is placed
>> >>> > >>>> prominently so that the people submitting something will get
>> >>> attention for
>> >>> > >>>> their contributions.
>> >>> > >>>> I think a dynamic site would probably be better, if we want
>> >>> features
>> >>> > >>>> such as up and downvoting or comments.
>> >>> > >>>> I would also like this to be hosted on Apache infra, and endorsed
>> >>> by
>> >>> > >>>> the community.
>> >>> > >>>>
>> >>> > >>>> Does anybody here know any existing software that we could use?
>> >>> > >>>> The only think I was able to find is AUR:
>> >>> https://aur.archlinux.org/
>> >>> > >>>> (which is a community packages site for Arch Linux. The source
>> >>> code of this
>> >>> > >>>> portal is open source, but the layout and structure is not an
>> >>> ideal fit for
>> >>> > >>>> our requirements)
>> >>> > >>>>
>> >>> > >>>> Best,
>> >>> > >>>> Robert
>> >>> > >>>>
>> >>> > >>>>
>> >>> > >>>>
>> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>> >>> > >>>> wrote:
>> >>> > >>>>
>> >>> > >>>>> Hi folks,
>> >>> > >>>>>
>> >>> > >>>>> I would like to start a discussion thread about creating a Flink
>> >>> > >>>>> ecosystem website. The website aims to help contributors who
>> >>> have developed
>> >>> > >>>>> projects around Flink share their work with the community.
>> >>> > >>>>>
>> >>> > >>>>> Please see the following doc for more details.
>> >>> > >>>>>
>> >>> > >>>>>
>> >>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> >>> > >>>>>
>> >>> > >>>>> Thanks,
>> >>> > >>>>>
>> >>> > >>>>> Jiangjie (Becket) Qin
>> >>> > >>>>>
>> >>> > >>>>
>> >>>
>> >>



-- 
Best regards / Met vriendelijke groeten,

Niels Basjes

Re: [DISCUSS] Create a Flink ecosystem website

[Niels Basjes <Ni...@basjes.nl>]

Hi,

The Beam project has something in this area that is simply a page
within their documentation website:
https://beam.apache.org/documentation/sdks/java-thirdparty/

Niels Basjes

On Fri, Mar 8, 2019 at 11:39 PM Bowen Li <bo...@gmail.com> wrote:
>
> Confluent hub for Kafka is another good example of this kind. I personally like it over the spark site. May worth checking it out with Kafka folks
>
> On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:
>>
>> Absolutely! Thanks for the pointer. I'll submit a PR to update the
>> ecosystem page and the navigation.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org> wrote:
>>
>> > Okay. I will reach out to spark-packages.org and see if they are willing
>> > to share.
>> >
>> > Do you want to raise a PR to update the ecosystem page (maybe sync with
>> > the "Software Projects" listed here:
>> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
>> > link it in the navigation?
>> >
>> > Best,
>> > Robert
>> >
>> >
>> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:
>> >
>> >> Hi Robert,
>> >>
>> >> I think it at least worths checking if spark-packages.org owners are
>> >> willing to share. Thanks for volunteering to write the requirement
>> >> descriptions! In any case, that will be very helpful.
>> >>
>> >> Since a static page has almost no cost, and we will need it to redirect
>> >> to the dynamic site anyways, how about we first do that while working on
>> >> the dynamic website?
>> >>
>> >> Thanks,
>> >>
>> >> Jiangjie (Becket) Qin
>> >>
>> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>> >>
>> >>> I like Shaoxuan's idea to keep this a static site first. We could then
>> >>> iterate on this and make it a dynamic thing. Of course, if we have the
>> >>> resources in the community to quickly start with a dynamic site, I'm
>> >>> not apposed.
>> >>>
>> >>> – Ufuk
>> >>>
>> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
>> >>> wrote:
>> >>> >
>> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
>> >>> Infra
>> >>> > look suitable.
>> >>> >
>> >>> > @Shaoxuan: There is actually already a static page. It used to be
>> >>> linked,
>> >>> > but has been removed from the navigation bar for some reason. This is
>> >>> the
>> >>> > page: https://flink.apache.org/ecosystem.html
>> >>> > We could update the page and add it back to the navigation bar for the
>> >>> > coming weeks. What do you think?
>> >>> >
>> >>> > I would actually like to push for a dynamic page right away.
>> >>> >
>> >>> > I know it's kind of a bold move, but how do you feel about sending the
>> >>> > owners of spark-packages.org a short note, if they are interested in
>> >>> > sharing the source? We could maintain the code together in a public
>> >>> repo.
>> >>> > If they are not interested in sharing, or we decide not to ask in the
>> >>> first
>> >>> > place, I'm happy to write down a short description of the requirements,
>> >>> > maybe some mockups. We could then see if we find somebody here in the
>> >>> > community who's willing to implement it.
>> >>> > Given the number of people who are eager to contribute, I believe we
>> >>> will
>> >>> > be able to find somebody pretty soon.
>> >>> >
>> >>> >
>> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
>> >>> wrote:
>> >>> >
>> >>> > > Forgot to provide the link...
>> >>> > >
>> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
>> >>> services)
>> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided
>> >>> by
>> >>> > > Apache Infra)
>> >>> > >
>> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
>> >>> wrote:
>> >>> > >
>> >>> > >> Hi Robert,
>> >>> > >>
>> >>> > >> Thanks for the feedback. These are good points. We should absolutely
>> >>> > >> shoot for a dynamic website to support more interactions in the
>> >>> community.
>> >>> > >> There might be a few things to solve:
>> >>> > >> 1. The website code itself. An open source solution would be great.
>> >>> TBH,
>> >>> > >> I do not have much experience on building a website. It'll be great
>> >>> if
>> >>> > >> someone could help comment on the solution here.
>> >>> > >> 2. The hardware to host the website. Apache Infra provides a few
>> >>> > >> services[1] that Apache projects can leverage. I did not see
>> >>> database
>> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>> >>> > >>
>> >>> > >> @Bowen & vino, thanks for the positive feedback!
>> >>> > >>
>> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>> >>> probably need
>> >>> > >> a page in the Flink official site anyways, even just provide links
>> >>> it to
>> >>> > >> the ecosystem website. So listing the connectors in that static
>> >>> page seems
>> >>> > >> something we could start with while we are working on the dynamic
>> >>> pages.
>> >>> > >>
>> >>> > >> Thanks,
>> >>> > >>
>> >>> > >> Jiangjie (Becket) Qin
>> >>> > >>
>> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>> >>> > >> wrote:
>> >>> > >>
>> >>> > >>> Hi Becket and Robert,
>> >>> > >>>
>> >>> > >>> I like this idea!  Let us roll this out with Flink connectors at
>> >>> the
>> >>> > >>> first beginning. We can start with a static page, and upgrade it
>> >>> when we
>> >>> > >>> find a better solution for dynamic one with rich functions.
>> >>> > >>>
>> >>> > >>> Regards,
>> >>> > >>> Shaoxuan
>> >>> > >>>
>> >>> > >>>
>> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rmetzger@apache.org
>> >>> >
>> >>> > >>> wrote:
>> >>> > >>>
>> >>> > >>>> Hey Becket,
>> >>> > >>>>
>> >>> > >>>> This is a great idea!
>> >>> > >>>> For this to be successful, we need to make sure the page is placed
>> >>> > >>>> prominently so that the people submitting something will get
>> >>> attention for
>> >>> > >>>> their contributions.
>> >>> > >>>> I think a dynamic site would probably be better, if we want
>> >>> features
>> >>> > >>>> such as up and downvoting or comments.
>> >>> > >>>> I would also like this to be hosted on Apache infra, and endorsed
>> >>> by
>> >>> > >>>> the community.
>> >>> > >>>>
>> >>> > >>>> Does anybody here know any existing software that we could use?
>> >>> > >>>> The only think I was able to find is AUR:
>> >>> https://aur.archlinux.org/
>> >>> > >>>> (which is a community packages site for Arch Linux. The source
>> >>> code of this
>> >>> > >>>> portal is open source, but the layout and structure is not an
>> >>> ideal fit for
>> >>> > >>>> our requirements)
>> >>> > >>>>
>> >>> > >>>> Best,
>> >>> > >>>> Robert
>> >>> > >>>>
>> >>> > >>>>
>> >>> > >>>>
>> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>> >>> > >>>> wrote:
>> >>> > >>>>
>> >>> > >>>>> Hi folks,
>> >>> > >>>>>
>> >>> > >>>>> I would like to start a discussion thread about creating a Flink
>> >>> > >>>>> ecosystem website. The website aims to help contributors who
>> >>> have developed
>> >>> > >>>>> projects around Flink share their work with the community.
>> >>> > >>>>>
>> >>> > >>>>> Please see the following doc for more details.
>> >>> > >>>>>
>> >>> > >>>>>
>> >>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> >>> > >>>>>
>> >>> > >>>>> Thanks,
>> >>> > >>>>>
>> >>> > >>>>> Jiangjie (Becket) Qin
>> >>> > >>>>>
>> >>> > >>>>
>> >>>
>> >>



-- 
Best regards / Met vriendelijke groeten,

Niels Basjes

Re: [DISCUSS] Create a Flink ecosystem website

[Bowen Li <bo...@gmail.com>]

Confluent hub <https://www.confluent.io/hub/> for Kafka is another good
example of this kind. I personally like it over the spark site. May worth
checking it out with Kafka folks

On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:

> Absolutely! Thanks for the pointer. I'll submit a PR to update the
> ecosystem page and the navigation.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org> wrote:
>
> > Okay. I will reach out to spark-packages.org and see if they are willing
> > to share.
> >
> > Do you want to raise a PR to update the ecosystem page (maybe sync with
> > the "Software Projects" listed here:
> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
> > link it in the navigation?
> >
> > Best,
> > Robert
> >
> >
> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:
> >
> >> Hi Robert,
> >>
> >> I think it at least worths checking if spark-packages.org owners are
> >> willing to share. Thanks for volunteering to write the requirement
> >> descriptions! In any case, that will be very helpful.
> >>
> >> Since a static page has almost no cost, and we will need it to redirect
> >> to the dynamic site anyways, how about we first do that while working on
> >> the dynamic website?
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
> >>
> >>> I like Shaoxuan's idea to keep this a static site first. We could then
> >>> iterate on this and make it a dynamic thing. Of course, if we have the
> >>> resources in the community to quickly start with a dynamic site, I'm
> >>> not apposed.
> >>>
> >>> – Ufuk
> >>>
> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
> >>> wrote:
> >>> >
> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
> >>> Infra
> >>> > look suitable.
> >>> >
> >>> > @Shaoxuan: There is actually already a static page. It used to be
> >>> linked,
> >>> > but has been removed from the navigation bar for some reason. This is
> >>> the
> >>> > page: https://flink.apache.org/ecosystem.html
> >>> > We could update the page and add it back to the navigation bar for
> the
> >>> > coming weeks. What do you think?
> >>> >
> >>> > I would actually like to push for a dynamic page right away.
> >>> >
> >>> > I know it's kind of a bold move, but how do you feel about sending
> the
> >>> > owners of spark-packages.org a short note, if they are interested in
> >>> > sharing the source? We could maintain the code together in a public
> >>> repo.
> >>> > If they are not interested in sharing, or we decide not to ask in the
> >>> first
> >>> > place, I'm happy to write down a short description of the
> requirements,
> >>> > maybe some mockups. We could then see if we find somebody here in the
> >>> > community who's willing to implement it.
> >>> > Given the number of people who are eager to contribute, I believe we
> >>> will
> >>> > be able to find somebody pretty soon.
> >>> >
> >>> >
> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
> >>> wrote:
> >>> >
> >>> > > Forgot to provide the link...
> >>> > >
> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
> >>> services)
> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
> provided
> >>> by
> >>> > > Apache Infra)
> >>> > >
> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
> >>> wrote:
> >>> > >
> >>> > >> Hi Robert,
> >>> > >>
> >>> > >> Thanks for the feedback. These are good points. We should
> absolutely
> >>> > >> shoot for a dynamic website to support more interactions in the
> >>> community.
> >>> > >> There might be a few things to solve:
> >>> > >> 1. The website code itself. An open source solution would be
> great.
> >>> TBH,
> >>> > >> I do not have much experience on building a website. It'll be
> great
> >>> if
> >>> > >> someone could help comment on the solution here.
> >>> > >> 2. The hardware to host the website. Apache Infra provides a few
> >>> > >> services[1] that Apache projects can leverage. I did not see
> >>> database
> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
> jail[2].
> >>> > >>
> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >>> > >>
> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
> >>> probably need
> >>> > >> a page in the Flink official site anyways, even just provide links
> >>> it to
> >>> > >> the ecosystem website. So listing the connectors in that static
> >>> page seems
> >>> > >> something we could start with while we are working on the dynamic
> >>> pages.
> >>> > >>
> >>> > >> Thanks,
> >>> > >>
> >>> > >> Jiangjie (Becket) Qin
> >>> > >>
> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> wshaoxuan@gmail.com>
> >>> > >> wrote:
> >>> > >>
> >>> > >>> Hi Becket and Robert,
> >>> > >>>
> >>> > >>> I like this idea!  Let us roll this out with Flink connectors at
> >>> the
> >>> > >>> first beginning. We can start with a static page, and upgrade it
> >>> when we
> >>> > >>> find a better solution for dynamic one with rich functions.
> >>> > >>>
> >>> > >>> Regards,
> >>> > >>> Shaoxuan
> >>> > >>>
> >>> > >>>
> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> rmetzger@apache.org
> >>> >
> >>> > >>> wrote:
> >>> > >>>
> >>> > >>>> Hey Becket,
> >>> > >>>>
> >>> > >>>> This is a great idea!
> >>> > >>>> For this to be successful, we need to make sure the page is
> placed
> >>> > >>>> prominently so that the people submitting something will get
> >>> attention for
> >>> > >>>> their contributions.
> >>> > >>>> I think a dynamic site would probably be better, if we want
> >>> features
> >>> > >>>> such as up and downvoting or comments.
> >>> > >>>> I would also like this to be hosted on Apache infra, and
> endorsed
> >>> by
> >>> > >>>> the community.
> >>> > >>>>
> >>> > >>>> Does anybody here know any existing software that we could use?
> >>> > >>>> The only think I was able to find is AUR:
> >>> https://aur.archlinux.org/
> >>> > >>>> (which is a community packages site for Arch Linux. The source
> >>> code of this
> >>> > >>>> portal is open source, but the layout and structure is not an
> >>> ideal fit for
> >>> > >>>> our requirements)
> >>> > >>>>
> >>> > >>>> Best,
> >>> > >>>> Robert
> >>> > >>>>
> >>> > >>>>
> >>> > >>>>
> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> becket.qin@gmail.com>
> >>> > >>>> wrote:
> >>> > >>>>
> >>> > >>>>> Hi folks,
> >>> > >>>>>
> >>> > >>>>> I would like to start a discussion thread about creating a
> Flink
> >>> > >>>>> ecosystem website. The website aims to help contributors who
> >>> have developed
> >>> > >>>>> projects around Flink share their work with the community.
> >>> > >>>>>
> >>> > >>>>> Please see the following doc for more details.
> >>> > >>>>>
> >>> > >>>>>
> >>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>> > >>>>>
> >>> > >>>>> Thanks,
> >>> > >>>>>
> >>> > >>>>> Jiangjie (Becket) Qin
> >>> > >>>>>
> >>> > >>>>
> >>>
> >>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Bowen Li <bo...@gmail.com>]

Confluent hub <https://www.confluent.io/hub/> for Kafka is another good
example of this kind. I personally like it over the spark site. May worth
checking it out with Kafka folks

On Thu, Mar 7, 2019 at 6:06 AM Becket Qin <be...@gmail.com> wrote:

> Absolutely! Thanks for the pointer. I'll submit a PR to update the
> ecosystem page and the navigation.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org> wrote:
>
> > Okay. I will reach out to spark-packages.org and see if they are willing
> > to share.
> >
> > Do you want to raise a PR to update the ecosystem page (maybe sync with
> > the "Software Projects" listed here:
> > https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
> > link it in the navigation?
> >
> > Best,
> > Robert
> >
> >
> > On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:
> >
> >> Hi Robert,
> >>
> >> I think it at least worths checking if spark-packages.org owners are
> >> willing to share. Thanks for volunteering to write the requirement
> >> descriptions! In any case, that will be very helpful.
> >>
> >> Since a static page has almost no cost, and we will need it to redirect
> >> to the dynamic site anyways, how about we first do that while working on
> >> the dynamic website?
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
> >>
> >>> I like Shaoxuan's idea to keep this a static site first. We could then
> >>> iterate on this and make it a dynamic thing. Of course, if we have the
> >>> resources in the community to quickly start with a dynamic site, I'm
> >>> not apposed.
> >>>
> >>> – Ufuk
> >>>
> >>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
> >>> wrote:
> >>> >
> >>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
> >>> Infra
> >>> > look suitable.
> >>> >
> >>> > @Shaoxuan: There is actually already a static page. It used to be
> >>> linked,
> >>> > but has been removed from the navigation bar for some reason. This is
> >>> the
> >>> > page: https://flink.apache.org/ecosystem.html
> >>> > We could update the page and add it back to the navigation bar for
> the
> >>> > coming weeks. What do you think?
> >>> >
> >>> > I would actually like to push for a dynamic page right away.
> >>> >
> >>> > I know it's kind of a bold move, but how do you feel about sending
> the
> >>> > owners of spark-packages.org a short note, if they are interested in
> >>> > sharing the source? We could maintain the code together in a public
> >>> repo.
> >>> > If they are not interested in sharing, or we decide not to ask in the
> >>> first
> >>> > place, I'm happy to write down a short description of the
> requirements,
> >>> > maybe some mockups. We could then see if we find somebody here in the
> >>> > community who's willing to implement it.
> >>> > Given the number of people who are eager to contribute, I believe we
> >>> will
> >>> > be able to find somebody pretty soon.
> >>> >
> >>> >
> >>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
> >>> wrote:
> >>> >
> >>> > > Forgot to provide the link...
> >>> > >
> >>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
> >>> services)
> >>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail
> provided
> >>> by
> >>> > > Apache Infra)
> >>> > >
> >>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
> >>> wrote:
> >>> > >
> >>> > >> Hi Robert,
> >>> > >>
> >>> > >> Thanks for the feedback. These are good points. We should
> absolutely
> >>> > >> shoot for a dynamic website to support more interactions in the
> >>> community.
> >>> > >> There might be a few things to solve:
> >>> > >> 1. The website code itself. An open source solution would be
> great.
> >>> TBH,
> >>> > >> I do not have much experience on building a website. It'll be
> great
> >>> if
> >>> > >> someone could help comment on the solution here.
> >>> > >> 2. The hardware to host the website. Apache Infra provides a few
> >>> > >> services[1] that Apache projects can leverage. I did not see
> >>> database
> >>> > >> service, but maybe we can run a simple MySQL db in FreeBSD
> jail[2].
> >>> > >>
> >>> > >> @Bowen & vino, thanks for the positive feedback!
> >>> > >>
> >>> > >> @Shaoxuan Wang <ws...@gmail.com>
> >>> > >> Thanks for the suggestion. That sounds reasonable to me. We
> >>> probably need
> >>> > >> a page in the Flink official site anyways, even just provide links
> >>> it to
> >>> > >> the ecosystem website. So listing the connectors in that static
> >>> page seems
> >>> > >> something we could start with while we are working on the dynamic
> >>> pages.
> >>> > >>
> >>> > >> Thanks,
> >>> > >>
> >>> > >> Jiangjie (Becket) Qin
> >>> > >>
> >>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <
> wshaoxuan@gmail.com>
> >>> > >> wrote:
> >>> > >>
> >>> > >>> Hi Becket and Robert,
> >>> > >>>
> >>> > >>> I like this idea!  Let us roll this out with Flink connectors at
> >>> the
> >>> > >>> first beginning. We can start with a static page, and upgrade it
> >>> when we
> >>> > >>> find a better solution for dynamic one with rich functions.
> >>> > >>>
> >>> > >>> Regards,
> >>> > >>> Shaoxuan
> >>> > >>>
> >>> > >>>
> >>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <
> rmetzger@apache.org
> >>> >
> >>> > >>> wrote:
> >>> > >>>
> >>> > >>>> Hey Becket,
> >>> > >>>>
> >>> > >>>> This is a great idea!
> >>> > >>>> For this to be successful, we need to make sure the page is
> placed
> >>> > >>>> prominently so that the people submitting something will get
> >>> attention for
> >>> > >>>> their contributions.
> >>> > >>>> I think a dynamic site would probably be better, if we want
> >>> features
> >>> > >>>> such as up and downvoting or comments.
> >>> > >>>> I would also like this to be hosted on Apache infra, and
> endorsed
> >>> by
> >>> > >>>> the community.
> >>> > >>>>
> >>> > >>>> Does anybody here know any existing software that we could use?
> >>> > >>>> The only think I was able to find is AUR:
> >>> https://aur.archlinux.org/
> >>> > >>>> (which is a community packages site for Arch Linux. The source
> >>> code of this
> >>> > >>>> portal is open source, but the layout and structure is not an
> >>> ideal fit for
> >>> > >>>> our requirements)
> >>> > >>>>
> >>> > >>>> Best,
> >>> > >>>> Robert
> >>> > >>>>
> >>> > >>>>
> >>> > >>>>
> >>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <
> becket.qin@gmail.com>
> >>> > >>>> wrote:
> >>> > >>>>
> >>> > >>>>> Hi folks,
> >>> > >>>>>
> >>> > >>>>> I would like to start a discussion thread about creating a
> Flink
> >>> > >>>>> ecosystem website. The website aims to help contributors who
> >>> have developed
> >>> > >>>>> projects around Flink share their work with the community.
> >>> > >>>>>
> >>> > >>>>> Please see the following doc for more details.
> >>> > >>>>>
> >>> > >>>>>
> >>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>> > >>>>>
> >>> > >>>>> Thanks,
> >>> > >>>>>
> >>> > >>>>> Jiangjie (Becket) Qin
> >>> > >>>>>
> >>> > >>>>
> >>>
> >>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Absolutely! Thanks for the pointer. I'll submit a PR to update the
ecosystem page and the navigation.

Thanks,

Jiangjie (Becket) Qin

On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org> wrote:

> Okay. I will reach out to spark-packages.org and see if they are willing
> to share.
>
> Do you want to raise a PR to update the ecosystem page (maybe sync with
> the "Software Projects" listed here:
> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
> link it in the navigation?
>
> Best,
> Robert
>
>
> On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:
>
>> Hi Robert,
>>
>> I think it at least worths checking if spark-packages.org owners are
>> willing to share. Thanks for volunteering to write the requirement
>> descriptions! In any case, that will be very helpful.
>>
>> Since a static page has almost no cost, and we will need it to redirect
>> to the dynamic site anyways, how about we first do that while working on
>> the dynamic website?
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>>
>>> I like Shaoxuan's idea to keep this a static site first. We could then
>>> iterate on this and make it a dynamic thing. Of course, if we have the
>>> resources in the community to quickly start with a dynamic site, I'm
>>> not apposed.
>>>
>>> – Ufuk
>>>
>>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>> >
>>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
>>> Infra
>>> > look suitable.
>>> >
>>> > @Shaoxuan: There is actually already a static page. It used to be
>>> linked,
>>> > but has been removed from the navigation bar for some reason. This is
>>> the
>>> > page: https://flink.apache.org/ecosystem.html
>>> > We could update the page and add it back to the navigation bar for the
>>> > coming weeks. What do you think?
>>> >
>>> > I would actually like to push for a dynamic page right away.
>>> >
>>> > I know it's kind of a bold move, but how do you feel about sending the
>>> > owners of spark-packages.org a short note, if they are interested in
>>> > sharing the source? We could maintain the code together in a public
>>> repo.
>>> > If they are not interested in sharing, or we decide not to ask in the
>>> first
>>> > place, I'm happy to write down a short description of the requirements,
>>> > maybe some mockups. We could then see if we find somebody here in the
>>> > community who's willing to implement it.
>>> > Given the number of people who are eager to contribute, I believe we
>>> will
>>> > be able to find somebody pretty soon.
>>> >
>>> >
>>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >
>>> > > Forgot to provide the link...
>>> > >
>>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
>>> services)
>>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided
>>> by
>>> > > Apache Infra)
>>> > >
>>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> > >
>>> > >> Hi Robert,
>>> > >>
>>> > >> Thanks for the feedback. These are good points. We should absolutely
>>> > >> shoot for a dynamic website to support more interactions in the
>>> community.
>>> > >> There might be a few things to solve:
>>> > >> 1. The website code itself. An open source solution would be great.
>>> TBH,
>>> > >> I do not have much experience on building a website. It'll be great
>>> if
>>> > >> someone could help comment on the solution here.
>>> > >> 2. The hardware to host the website. Apache Infra provides a few
>>> > >> services[1] that Apache projects can leverage. I did not see
>>> database
>>> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>>> > >>
>>> > >> @Bowen & vino, thanks for the positive feedback!
>>> > >>
>>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>>> probably need
>>> > >> a page in the Flink official site anyways, even just provide links
>>> it to
>>> > >> the ecosystem website. So listing the connectors in that static
>>> page seems
>>> > >> something we could start with while we are working on the dynamic
>>> pages.
>>> > >>
>>> > >> Thanks,
>>> > >>
>>> > >> Jiangjie (Becket) Qin
>>> > >>
>>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>>> > >> wrote:
>>> > >>
>>> > >>> Hi Becket and Robert,
>>> > >>>
>>> > >>> I like this idea!  Let us roll this out with Flink connectors at
>>> the
>>> > >>> first beginning. We can start with a static page, and upgrade it
>>> when we
>>> > >>> find a better solution for dynamic one with rich functions.
>>> > >>>
>>> > >>> Regards,
>>> > >>> Shaoxuan
>>> > >>>
>>> > >>>
>>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rmetzger@apache.org
>>> >
>>> > >>> wrote:
>>> > >>>
>>> > >>>> Hey Becket,
>>> > >>>>
>>> > >>>> This is a great idea!
>>> > >>>> For this to be successful, we need to make sure the page is placed
>>> > >>>> prominently so that the people submitting something will get
>>> attention for
>>> > >>>> their contributions.
>>> > >>>> I think a dynamic site would probably be better, if we want
>>> features
>>> > >>>> such as up and downvoting or comments.
>>> > >>>> I would also like this to be hosted on Apache infra, and endorsed
>>> by
>>> > >>>> the community.
>>> > >>>>
>>> > >>>> Does anybody here know any existing software that we could use?
>>> > >>>> The only think I was able to find is AUR:
>>> https://aur.archlinux.org/
>>> > >>>> (which is a community packages site for Arch Linux. The source
>>> code of this
>>> > >>>> portal is open source, but the layout and structure is not an
>>> ideal fit for
>>> > >>>> our requirements)
>>> > >>>>
>>> > >>>> Best,
>>> > >>>> Robert
>>> > >>>>
>>> > >>>>
>>> > >>>>
>>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>>> > >>>> wrote:
>>> > >>>>
>>> > >>>>> Hi folks,
>>> > >>>>>
>>> > >>>>> I would like to start a discussion thread about creating a Flink
>>> > >>>>> ecosystem website. The website aims to help contributors who
>>> have developed
>>> > >>>>> projects around Flink share their work with the community.
>>> > >>>>>
>>> > >>>>> Please see the following doc for more details.
>>> > >>>>>
>>> > >>>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> > >>>>>
>>> > >>>>> Thanks,
>>> > >>>>>
>>> > >>>>> Jiangjie (Becket) Qin
>>> > >>>>>
>>> > >>>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Absolutely! Thanks for the pointer. I'll submit a PR to update the
ecosystem page and the navigation.

Thanks,

Jiangjie (Becket) Qin

On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger <rm...@apache.org> wrote:

> Okay. I will reach out to spark-packages.org and see if they are willing
> to share.
>
> Do you want to raise a PR to update the ecosystem page (maybe sync with
> the "Software Projects" listed here:
> https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
> link it in the navigation?
>
> Best,
> Robert
>
>
> On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:
>
>> Hi Robert,
>>
>> I think it at least worths checking if spark-packages.org owners are
>> willing to share. Thanks for volunteering to write the requirement
>> descriptions! In any case, that will be very helpful.
>>
>> Since a static page has almost no cost, and we will need it to redirect
>> to the dynamic site anyways, how about we first do that while working on
>> the dynamic website?
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>>
>>> I like Shaoxuan's idea to keep this a static site first. We could then
>>> iterate on this and make it a dynamic thing. Of course, if we have the
>>> resources in the community to quickly start with a dynamic site, I'm
>>> not apposed.
>>>
>>> – Ufuk
>>>
>>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
>>> wrote:
>>> >
>>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
>>> Infra
>>> > look suitable.
>>> >
>>> > @Shaoxuan: There is actually already a static page. It used to be
>>> linked,
>>> > but has been removed from the navigation bar for some reason. This is
>>> the
>>> > page: https://flink.apache.org/ecosystem.html
>>> > We could update the page and add it back to the navigation bar for the
>>> > coming weeks. What do you think?
>>> >
>>> > I would actually like to push for a dynamic page right away.
>>> >
>>> > I know it's kind of a bold move, but how do you feel about sending the
>>> > owners of spark-packages.org a short note, if they are interested in
>>> > sharing the source? We could maintain the code together in a public
>>> repo.
>>> > If they are not interested in sharing, or we decide not to ask in the
>>> first
>>> > place, I'm happy to write down a short description of the requirements,
>>> > maybe some mockups. We could then see if we find somebody here in the
>>> > community who's willing to implement it.
>>> > Given the number of people who are eager to contribute, I believe we
>>> will
>>> > be able to find somebody pretty soon.
>>> >
>>> >
>>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> >
>>> > > Forgot to provide the link...
>>> > >
>>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
>>> services)
>>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided
>>> by
>>> > > Apache Infra)
>>> > >
>>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
>>> wrote:
>>> > >
>>> > >> Hi Robert,
>>> > >>
>>> > >> Thanks for the feedback. These are good points. We should absolutely
>>> > >> shoot for a dynamic website to support more interactions in the
>>> community.
>>> > >> There might be a few things to solve:
>>> > >> 1. The website code itself. An open source solution would be great.
>>> TBH,
>>> > >> I do not have much experience on building a website. It'll be great
>>> if
>>> > >> someone could help comment on the solution here.
>>> > >> 2. The hardware to host the website. Apache Infra provides a few
>>> > >> services[1] that Apache projects can leverage. I did not see
>>> database
>>> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>>> > >>
>>> > >> @Bowen & vino, thanks for the positive feedback!
>>> > >>
>>> > >> @Shaoxuan Wang <ws...@gmail.com>
>>> > >> Thanks for the suggestion. That sounds reasonable to me. We
>>> probably need
>>> > >> a page in the Flink official site anyways, even just provide links
>>> it to
>>> > >> the ecosystem website. So listing the connectors in that static
>>> page seems
>>> > >> something we could start with while we are working on the dynamic
>>> pages.
>>> > >>
>>> > >> Thanks,
>>> > >>
>>> > >> Jiangjie (Becket) Qin
>>> > >>
>>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>>> > >> wrote:
>>> > >>
>>> > >>> Hi Becket and Robert,
>>> > >>>
>>> > >>> I like this idea!  Let us roll this out with Flink connectors at
>>> the
>>> > >>> first beginning. We can start with a static page, and upgrade it
>>> when we
>>> > >>> find a better solution for dynamic one with rich functions.
>>> > >>>
>>> > >>> Regards,
>>> > >>> Shaoxuan
>>> > >>>
>>> > >>>
>>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rmetzger@apache.org
>>> >
>>> > >>> wrote:
>>> > >>>
>>> > >>>> Hey Becket,
>>> > >>>>
>>> > >>>> This is a great idea!
>>> > >>>> For this to be successful, we need to make sure the page is placed
>>> > >>>> prominently so that the people submitting something will get
>>> attention for
>>> > >>>> their contributions.
>>> > >>>> I think a dynamic site would probably be better, if we want
>>> features
>>> > >>>> such as up and downvoting or comments.
>>> > >>>> I would also like this to be hosted on Apache infra, and endorsed
>>> by
>>> > >>>> the community.
>>> > >>>>
>>> > >>>> Does anybody here know any existing software that we could use?
>>> > >>>> The only think I was able to find is AUR:
>>> https://aur.archlinux.org/
>>> > >>>> (which is a community packages site for Arch Linux. The source
>>> code of this
>>> > >>>> portal is open source, but the layout and structure is not an
>>> ideal fit for
>>> > >>>> our requirements)
>>> > >>>>
>>> > >>>> Best,
>>> > >>>> Robert
>>> > >>>>
>>> > >>>>
>>> > >>>>
>>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>>> > >>>> wrote:
>>> > >>>>
>>> > >>>>> Hi folks,
>>> > >>>>>
>>> > >>>>> I would like to start a discussion thread about creating a Flink
>>> > >>>>> ecosystem website. The website aims to help contributors who
>>> have developed
>>> > >>>>> projects around Flink share their work with the community.
>>> > >>>>>
>>> > >>>>> Please see the following doc for more details.
>>> > >>>>>
>>> > >>>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>> > >>>>>
>>> > >>>>> Thanks,
>>> > >>>>>
>>> > >>>>> Jiangjie (Becket) Qin
>>> > >>>>>
>>> > >>>>
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Okay. I will reach out to spark-packages.org and see if they are willing to
share.

Do you want to raise a PR to update the ecosystem page (maybe sync with the
"Software Projects" listed here:
https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
link it in the navigation?

Best,
Robert


On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:

> Hi Robert,
>
> I think it at least worths checking if spark-packages.org owners are
> willing to share. Thanks for volunteering to write the requirement
> descriptions! In any case, that will be very helpful.
>
> Since a static page has almost no cost, and we will need it to redirect to
> the dynamic site anyways, how about we first do that while working on the
> dynamic website?
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>
>> I like Shaoxuan's idea to keep this a static site first. We could then
>> iterate on this and make it a dynamic thing. Of course, if we have the
>> resources in the community to quickly start with a dynamic site, I'm
>> not apposed.
>>
>> – Ufuk
>>
>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
>> wrote:
>> >
>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
>> Infra
>> > look suitable.
>> >
>> > @Shaoxuan: There is actually already a static page. It used to be
>> linked,
>> > but has been removed from the navigation bar for some reason. This is
>> the
>> > page: https://flink.apache.org/ecosystem.html
>> > We could update the page and add it back to the navigation bar for the
>> > coming weeks. What do you think?
>> >
>> > I would actually like to push for a dynamic page right away.
>> >
>> > I know it's kind of a bold move, but how do you feel about sending the
>> > owners of spark-packages.org a short note, if they are interested in
>> > sharing the source? We could maintain the code together in a public
>> repo.
>> > If they are not interested in sharing, or we decide not to ask in the
>> first
>> > place, I'm happy to write down a short description of the requirements,
>> > maybe some mockups. We could then see if we find somebody here in the
>> > community who's willing to implement it.
>> > Given the number of people who are eager to contribute, I believe we
>> will
>> > be able to find somebody pretty soon.
>> >
>> >
>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:
>> >
>> > > Forgot to provide the link...
>> > >
>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
>> services)
>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided
>> by
>> > > Apache Infra)
>> > >
>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
>> wrote:
>> > >
>> > >> Hi Robert,
>> > >>
>> > >> Thanks for the feedback. These are good points. We should absolutely
>> > >> shoot for a dynamic website to support more interactions in the
>> community.
>> > >> There might be a few things to solve:
>> > >> 1. The website code itself. An open source solution would be great.
>> TBH,
>> > >> I do not have much experience on building a website. It'll be great
>> if
>> > >> someone could help comment on the solution here.
>> > >> 2. The hardware to host the website. Apache Infra provides a few
>> > >> services[1] that Apache projects can leverage. I did not see database
>> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>> > >>
>> > >> @Bowen & vino, thanks for the positive feedback!
>> > >>
>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> > >> Thanks for the suggestion. That sounds reasonable to me. We probably
>> need
>> > >> a page in the Flink official site anyways, even just provide links
>> it to
>> > >> the ecosystem website. So listing the connectors in that static page
>> seems
>> > >> something we could start with while we are working on the dynamic
>> pages.
>> > >>
>> > >> Thanks,
>> > >>
>> > >> Jiangjie (Becket) Qin
>> > >>
>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>> > >> wrote:
>> > >>
>> > >>> Hi Becket and Robert,
>> > >>>
>> > >>> I like this idea!  Let us roll this out with Flink connectors at the
>> > >>> first beginning. We can start with a static page, and upgrade it
>> when we
>> > >>> find a better solution for dynamic one with rich functions.
>> > >>>
>> > >>> Regards,
>> > >>> Shaoxuan
>> > >>>
>> > >>>
>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
>> > >>> wrote:
>> > >>>
>> > >>>> Hey Becket,
>> > >>>>
>> > >>>> This is a great idea!
>> > >>>> For this to be successful, we need to make sure the page is placed
>> > >>>> prominently so that the people submitting something will get
>> attention for
>> > >>>> their contributions.
>> > >>>> I think a dynamic site would probably be better, if we want
>> features
>> > >>>> such as up and downvoting or comments.
>> > >>>> I would also like this to be hosted on Apache infra, and endorsed
>> by
>> > >>>> the community.
>> > >>>>
>> > >>>> Does anybody here know any existing software that we could use?
>> > >>>> The only think I was able to find is AUR:
>> https://aur.archlinux.org/
>> > >>>> (which is a community packages site for Arch Linux. The source
>> code of this
>> > >>>> portal is open source, but the layout and structure is not an
>> ideal fit for
>> > >>>> our requirements)
>> > >>>>
>> > >>>> Best,
>> > >>>> Robert
>> > >>>>
>> > >>>>
>> > >>>>
>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>> > >>>> wrote:
>> > >>>>
>> > >>>>> Hi folks,
>> > >>>>>
>> > >>>>> I would like to start a discussion thread about creating a Flink
>> > >>>>> ecosystem website. The website aims to help contributors who have
>> developed
>> > >>>>> projects around Flink share their work with the community.
>> > >>>>>
>> > >>>>> Please see the following doc for more details.
>> > >>>>>
>> > >>>>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> > >>>>>
>> > >>>>> Thanks,
>> > >>>>>
>> > >>>>> Jiangjie (Becket) Qin
>> > >>>>>
>> > >>>>
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Okay. I will reach out to spark-packages.org and see if they are willing to
share.

Do you want to raise a PR to update the ecosystem page (maybe sync with the
"Software Projects" listed here:
https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and
link it in the navigation?

Best,
Robert


On Thu, Mar 7, 2019 at 10:13 AM Becket Qin <be...@gmail.com> wrote:

> Hi Robert,
>
> I think it at least worths checking if spark-packages.org owners are
> willing to share. Thanks for volunteering to write the requirement
> descriptions! In any case, that will be very helpful.
>
> Since a static page has almost no cost, and we will need it to redirect to
> the dynamic site anyways, how about we first do that while working on the
> dynamic website?
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:
>
>> I like Shaoxuan's idea to keep this a static site first. We could then
>> iterate on this and make it a dynamic thing. Of course, if we have the
>> resources in the community to quickly start with a dynamic site, I'm
>> not apposed.
>>
>> – Ufuk
>>
>> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org>
>> wrote:
>> >
>> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
>> Infra
>> > look suitable.
>> >
>> > @Shaoxuan: There is actually already a static page. It used to be
>> linked,
>> > but has been removed from the navigation bar for some reason. This is
>> the
>> > page: https://flink.apache.org/ecosystem.html
>> > We could update the page and add it back to the navigation bar for the
>> > coming weeks. What do you think?
>> >
>> > I would actually like to push for a dynamic page right away.
>> >
>> > I know it's kind of a bold move, but how do you feel about sending the
>> > owners of spark-packages.org a short note, if they are interested in
>> > sharing the source? We could maintain the code together in a public
>> repo.
>> > If they are not interested in sharing, or we decide not to ask in the
>> first
>> > place, I'm happy to write down a short description of the requirements,
>> > maybe some mockups. We could then see if we find somebody here in the
>> > community who's willing to implement it.
>> > Given the number of people who are eager to contribute, I believe we
>> will
>> > be able to find somebody pretty soon.
>> >
>> >
>> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:
>> >
>> > > Forgot to provide the link...
>> > >
>> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
>> services)
>> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided
>> by
>> > > Apache Infra)
>> > >
>> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
>> wrote:
>> > >
>> > >> Hi Robert,
>> > >>
>> > >> Thanks for the feedback. These are good points. We should absolutely
>> > >> shoot for a dynamic website to support more interactions in the
>> community.
>> > >> There might be a few things to solve:
>> > >> 1. The website code itself. An open source solution would be great.
>> TBH,
>> > >> I do not have much experience on building a website. It'll be great
>> if
>> > >> someone could help comment on the solution here.
>> > >> 2. The hardware to host the website. Apache Infra provides a few
>> > >> services[1] that Apache projects can leverage. I did not see database
>> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>> > >>
>> > >> @Bowen & vino, thanks for the positive feedback!
>> > >>
>> > >> @Shaoxuan Wang <ws...@gmail.com>
>> > >> Thanks for the suggestion. That sounds reasonable to me. We probably
>> need
>> > >> a page in the Flink official site anyways, even just provide links
>> it to
>> > >> the ecosystem website. So listing the connectors in that static page
>> seems
>> > >> something we could start with while we are working on the dynamic
>> pages.
>> > >>
>> > >> Thanks,
>> > >>
>> > >> Jiangjie (Becket) Qin
>> > >>
>> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>> > >> wrote:
>> > >>
>> > >>> Hi Becket and Robert,
>> > >>>
>> > >>> I like this idea!  Let us roll this out with Flink connectors at the
>> > >>> first beginning. We can start with a static page, and upgrade it
>> when we
>> > >>> find a better solution for dynamic one with rich functions.
>> > >>>
>> > >>> Regards,
>> > >>> Shaoxuan
>> > >>>
>> > >>>
>> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
>> > >>> wrote:
>> > >>>
>> > >>>> Hey Becket,
>> > >>>>
>> > >>>> This is a great idea!
>> > >>>> For this to be successful, we need to make sure the page is placed
>> > >>>> prominently so that the people submitting something will get
>> attention for
>> > >>>> their contributions.
>> > >>>> I think a dynamic site would probably be better, if we want
>> features
>> > >>>> such as up and downvoting or comments.
>> > >>>> I would also like this to be hosted on Apache infra, and endorsed
>> by
>> > >>>> the community.
>> > >>>>
>> > >>>> Does anybody here know any existing software that we could use?
>> > >>>> The only think I was able to find is AUR:
>> https://aur.archlinux.org/
>> > >>>> (which is a community packages site for Arch Linux. The source
>> code of this
>> > >>>> portal is open source, but the layout and structure is not an
>> ideal fit for
>> > >>>> our requirements)
>> > >>>>
>> > >>>> Best,
>> > >>>> Robert
>> > >>>>
>> > >>>>
>> > >>>>
>> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>> > >>>> wrote:
>> > >>>>
>> > >>>>> Hi folks,
>> > >>>>>
>> > >>>>> I would like to start a discussion thread about creating a Flink
>> > >>>>> ecosystem website. The website aims to help contributors who have
>> developed
>> > >>>>> projects around Flink share their work with the community.
>> > >>>>>
>> > >>>>> Please see the following doc for more details.
>> > >>>>>
>> > >>>>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>> > >>>>>
>> > >>>>> Thanks,
>> > >>>>>
>> > >>>>> Jiangjie (Becket) Qin
>> > >>>>>
>> > >>>>
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Hi Robert,

I think it at least worths checking if spark-packages.org owners are
willing to share. Thanks for volunteering to write the requirement
descriptions! In any case, that will be very helpful.

Since a static page has almost no cost, and we will need it to redirect to
the dynamic site anyways, how about we first do that while working on the
dynamic website?

Thanks,

Jiangjie (Becket) Qin

On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:

> I like Shaoxuan's idea to keep this a static site first. We could then
> iterate on this and make it a dynamic thing. Of course, if we have the
> resources in the community to quickly start with a dynamic site, I'm
> not apposed.
>
> – Ufuk
>
> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org> wrote:
> >
> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
> Infra
> > look suitable.
> >
> > @Shaoxuan: There is actually already a static page. It used to be linked,
> > but has been removed from the navigation bar for some reason. This is the
> > page: https://flink.apache.org/ecosystem.html
> > We could update the page and add it back to the navigation bar for the
> > coming weeks. What do you think?
> >
> > I would actually like to push for a dynamic page right away.
> >
> > I know it's kind of a bold move, but how do you feel about sending the
> > owners of spark-packages.org a short note, if they are interested in
> > sharing the source? We could maintain the code together in a public repo.
> > If they are not interested in sharing, or we decide not to ask in the
> first
> > place, I'm happy to write down a short description of the requirements,
> > maybe some mockups. We could then see if we find somebody here in the
> > community who's willing to implement it.
> > Given the number of people who are eager to contribute, I believe we will
> > be able to find somebody pretty soon.
> >
> >
> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:
> >
> > > Forgot to provide the link...
> > >
> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
> services)
> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
> > > Apache Infra)
> > >
> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
> wrote:
> > >
> > >> Hi Robert,
> > >>
> > >> Thanks for the feedback. These are good points. We should absolutely
> > >> shoot for a dynamic website to support more interactions in the
> community.
> > >> There might be a few things to solve:
> > >> 1. The website code itself. An open source solution would be great.
> TBH,
> > >> I do not have much experience on building a website. It'll be great if
> > >> someone could help comment on the solution here.
> > >> 2. The hardware to host the website. Apache Infra provides a few
> > >> services[1] that Apache projects can leverage. I did not see database
> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
> > >>
> > >> @Bowen & vino, thanks for the positive feedback!
> > >>
> > >> @Shaoxuan Wang <ws...@gmail.com>
> > >> Thanks for the suggestion. That sounds reasonable to me. We probably
> need
> > >> a page in the Flink official site anyways, even just provide links it
> to
> > >> the ecosystem website. So listing the connectors in that static page
> seems
> > >> something we could start with while we are working on the dynamic
> pages.
> > >>
> > >> Thanks,
> > >>
> > >> Jiangjie (Becket) Qin
> > >>
> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
> > >> wrote:
> > >>
> > >>> Hi Becket and Robert,
> > >>>
> > >>> I like this idea!  Let us roll this out with Flink connectors at the
> > >>> first beginning. We can start with a static page, and upgrade it
> when we
> > >>> find a better solution for dynamic one with rich functions.
> > >>>
> > >>> Regards,
> > >>> Shaoxuan
> > >>>
> > >>>
> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
> > >>> wrote:
> > >>>
> > >>>> Hey Becket,
> > >>>>
> > >>>> This is a great idea!
> > >>>> For this to be successful, we need to make sure the page is placed
> > >>>> prominently so that the people submitting something will get
> attention for
> > >>>> their contributions.
> > >>>> I think a dynamic site would probably be better, if we want features
> > >>>> such as up and downvoting or comments.
> > >>>> I would also like this to be hosted on Apache infra, and endorsed by
> > >>>> the community.
> > >>>>
> > >>>> Does anybody here know any existing software that we could use?
> > >>>> The only think I was able to find is AUR:
> https://aur.archlinux.org/
> > >>>> (which is a community packages site for Arch Linux. The source code
> of this
> > >>>> portal is open source, but the layout and structure is not an ideal
> fit for
> > >>>> our requirements)
> > >>>>
> > >>>> Best,
> > >>>> Robert
> > >>>>
> > >>>>
> > >>>>
> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi folks,
> > >>>>>
> > >>>>> I would like to start a discussion thread about creating a Flink
> > >>>>> ecosystem website. The website aims to help contributors who have
> developed
> > >>>>> projects around Flink share their work with the community.
> > >>>>>
> > >>>>> Please see the following doc for more details.
> > >>>>>
> > >>>>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> > >>>>>
> > >>>>> Thanks,
> > >>>>>
> > >>>>> Jiangjie (Becket) Qin
> > >>>>>
> > >>>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Hi Robert,

I think it at least worths checking if spark-packages.org owners are
willing to share. Thanks for volunteering to write the requirement
descriptions! In any case, that will be very helpful.

Since a static page has almost no cost, and we will need it to redirect to
the dynamic site anyways, how about we first do that while working on the
dynamic website?

Thanks,

Jiangjie (Becket) Qin

On Thu, Mar 7, 2019 at 4:59 AM Ufuk Celebi <uc...@apache.org> wrote:

> I like Shaoxuan's idea to keep this a static site first. We could then
> iterate on this and make it a dynamic thing. Of course, if we have the
> resources in the community to quickly start with a dynamic site, I'm
> not apposed.
>
> – Ufuk
>
> On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org> wrote:
> >
> > Awesome! Thanks a lot for looking into this Becket! The VMs hosted by
> Infra
> > look suitable.
> >
> > @Shaoxuan: There is actually already a static page. It used to be linked,
> > but has been removed from the navigation bar for some reason. This is the
> > page: https://flink.apache.org/ecosystem.html
> > We could update the page and add it back to the navigation bar for the
> > coming weeks. What do you think?
> >
> > I would actually like to push for a dynamic page right away.
> >
> > I know it's kind of a bold move, but how do you feel about sending the
> > owners of spark-packages.org a short note, if they are interested in
> > sharing the source? We could maintain the code together in a public repo.
> > If they are not interested in sharing, or we decide not to ask in the
> first
> > place, I'm happy to write down a short description of the requirements,
> > maybe some mockups. We could then see if we find somebody here in the
> > community who's willing to implement it.
> > Given the number of people who are eager to contribute, I believe we will
> > be able to find somebody pretty soon.
> >
> >
> > On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:
> >
> > > Forgot to provide the link...
> > >
> > > [1] https://www.apache.org/dev/services.html#blogs (Apache infra
> services)
> > > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
> > > Apache Infra)
> > >
> > > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com>
> wrote:
> > >
> > >> Hi Robert,
> > >>
> > >> Thanks for the feedback. These are good points. We should absolutely
> > >> shoot for a dynamic website to support more interactions in the
> community.
> > >> There might be a few things to solve:
> > >> 1. The website code itself. An open source solution would be great.
> TBH,
> > >> I do not have much experience on building a website. It'll be great if
> > >> someone could help comment on the solution here.
> > >> 2. The hardware to host the website. Apache Infra provides a few
> > >> services[1] that Apache projects can leverage. I did not see database
> > >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
> > >>
> > >> @Bowen & vino, thanks for the positive feedback!
> > >>
> > >> @Shaoxuan Wang <ws...@gmail.com>
> > >> Thanks for the suggestion. That sounds reasonable to me. We probably
> need
> > >> a page in the Flink official site anyways, even just provide links it
> to
> > >> the ecosystem website. So listing the connectors in that static page
> seems
> > >> something we could start with while we are working on the dynamic
> pages.
> > >>
> > >> Thanks,
> > >>
> > >> Jiangjie (Becket) Qin
> > >>
> > >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
> > >> wrote:
> > >>
> > >>> Hi Becket and Robert,
> > >>>
> > >>> I like this idea!  Let us roll this out with Flink connectors at the
> > >>> first beginning. We can start with a static page, and upgrade it
> when we
> > >>> find a better solution for dynamic one with rich functions.
> > >>>
> > >>> Regards,
> > >>> Shaoxuan
> > >>>
> > >>>
> > >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
> > >>> wrote:
> > >>>
> > >>>> Hey Becket,
> > >>>>
> > >>>> This is a great idea!
> > >>>> For this to be successful, we need to make sure the page is placed
> > >>>> prominently so that the people submitting something will get
> attention for
> > >>>> their contributions.
> > >>>> I think a dynamic site would probably be better, if we want features
> > >>>> such as up and downvoting or comments.
> > >>>> I would also like this to be hosted on Apache infra, and endorsed by
> > >>>> the community.
> > >>>>
> > >>>> Does anybody here know any existing software that we could use?
> > >>>> The only think I was able to find is AUR:
> https://aur.archlinux.org/
> > >>>> (which is a community packages site for Arch Linux. The source code
> of this
> > >>>> portal is open source, but the layout and structure is not an ideal
> fit for
> > >>>> our requirements)
> > >>>>
> > >>>> Best,
> > >>>> Robert
> > >>>>
> > >>>>
> > >>>>
> > >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi folks,
> > >>>>>
> > >>>>> I would like to start a discussion thread about creating a Flink
> > >>>>> ecosystem website. The website aims to help contributors who have
> developed
> > >>>>> projects around Flink share their work with the community.
> > >>>>>
> > >>>>> Please see the following doc for more details.
> > >>>>>
> > >>>>>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> > >>>>>
> > >>>>> Thanks,
> > >>>>>
> > >>>>> Jiangjie (Becket) Qin
> > >>>>>
> > >>>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Ufuk Celebi <uc...@apache.org>]

I like Shaoxuan's idea to keep this a static site first. We could then
iterate on this and make it a dynamic thing. Of course, if we have the
resources in the community to quickly start with a dynamic site, I'm
not apposed.

– Ufuk

On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org> wrote:
>
> Awesome! Thanks a lot for looking into this Becket! The VMs hosted by Infra
> look suitable.
>
> @Shaoxuan: There is actually already a static page. It used to be linked,
> but has been removed from the navigation bar for some reason. This is the
> page: https://flink.apache.org/ecosystem.html
> We could update the page and add it back to the navigation bar for the
> coming weeks. What do you think?
>
> I would actually like to push for a dynamic page right away.
>
> I know it's kind of a bold move, but how do you feel about sending the
> owners of spark-packages.org a short note, if they are interested in
> sharing the source? We could maintain the code together in a public repo.
> If they are not interested in sharing, or we decide not to ask in the first
> place, I'm happy to write down a short description of the requirements,
> maybe some mockups. We could then see if we find somebody here in the
> community who's willing to implement it.
> Given the number of people who are eager to contribute, I believe we will
> be able to find somebody pretty soon.
>
>
> On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:
>
> > Forgot to provide the link...
> >
> > [1] https://www.apache.org/dev/services.html#blogs (Apache infra services)
> > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
> > Apache Infra)
> >
> > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com> wrote:
> >
> >> Hi Robert,
> >>
> >> Thanks for the feedback. These are good points. We should absolutely
> >> shoot for a dynamic website to support more interactions in the community.
> >> There might be a few things to solve:
> >> 1. The website code itself. An open source solution would be great. TBH,
> >> I do not have much experience on building a website. It'll be great if
> >> someone could help comment on the solution here.
> >> 2. The hardware to host the website. Apache Infra provides a few
> >> services[1] that Apache projects can leverage. I did not see database
> >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
> >>
> >> @Bowen & vino, thanks for the positive feedback!
> >>
> >> @Shaoxuan Wang <ws...@gmail.com>
> >> Thanks for the suggestion. That sounds reasonable to me. We probably need
> >> a page in the Flink official site anyways, even just provide links it to
> >> the ecosystem website. So listing the connectors in that static page seems
> >> something we could start with while we are working on the dynamic pages.
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
> >> wrote:
> >>
> >>> Hi Becket and Robert,
> >>>
> >>> I like this idea!  Let us roll this out with Flink connectors at the
> >>> first beginning. We can start with a static page, and upgrade it when we
> >>> find a better solution for dynamic one with rich functions.
> >>>
> >>> Regards,
> >>> Shaoxuan
> >>>
> >>>
> >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
> >>> wrote:
> >>>
> >>>> Hey Becket,
> >>>>
> >>>> This is a great idea!
> >>>> For this to be successful, we need to make sure the page is placed
> >>>> prominently so that the people submitting something will get attention for
> >>>> their contributions.
> >>>> I think a dynamic site would probably be better, if we want features
> >>>> such as up and downvoting or comments.
> >>>> I would also like this to be hosted on Apache infra, and endorsed by
> >>>> the community.
> >>>>
> >>>> Does anybody here know any existing software that we could use?
> >>>> The only think I was able to find is AUR: https://aur.archlinux.org/
> >>>> (which is a community packages site for Arch Linux. The source code of this
> >>>> portal is open source, but the layout and structure is not an ideal fit for
> >>>> our requirements)
> >>>>
> >>>> Best,
> >>>> Robert
> >>>>
> >>>>
> >>>>
> >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
> >>>> wrote:
> >>>>
> >>>>> Hi folks,
> >>>>>
> >>>>> I would like to start a discussion thread about creating a Flink
> >>>>> ecosystem website. The website aims to help contributors who have developed
> >>>>> projects around Flink share their work with the community.
> >>>>>
> >>>>> Please see the following doc for more details.
> >>>>>
> >>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> Jiangjie (Becket) Qin
> >>>>>
> >>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Ufuk Celebi <uc...@apache.org>]

I like Shaoxuan's idea to keep this a static site first. We could then
iterate on this and make it a dynamic thing. Of course, if we have the
resources in the community to quickly start with a dynamic site, I'm
not apposed.

– Ufuk

On Wed, Mar 6, 2019 at 2:31 PM Robert Metzger <rm...@apache.org> wrote:
>
> Awesome! Thanks a lot for looking into this Becket! The VMs hosted by Infra
> look suitable.
>
> @Shaoxuan: There is actually already a static page. It used to be linked,
> but has been removed from the navigation bar for some reason. This is the
> page: https://flink.apache.org/ecosystem.html
> We could update the page and add it back to the navigation bar for the
> coming weeks. What do you think?
>
> I would actually like to push for a dynamic page right away.
>
> I know it's kind of a bold move, but how do you feel about sending the
> owners of spark-packages.org a short note, if they are interested in
> sharing the source? We could maintain the code together in a public repo.
> If they are not interested in sharing, or we decide not to ask in the first
> place, I'm happy to write down a short description of the requirements,
> maybe some mockups. We could then see if we find somebody here in the
> community who's willing to implement it.
> Given the number of people who are eager to contribute, I believe we will
> be able to find somebody pretty soon.
>
>
> On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:
>
> > Forgot to provide the link...
> >
> > [1] https://www.apache.org/dev/services.html#blogs (Apache infra services)
> > [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
> > Apache Infra)
> >
> > On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com> wrote:
> >
> >> Hi Robert,
> >>
> >> Thanks for the feedback. These are good points. We should absolutely
> >> shoot for a dynamic website to support more interactions in the community.
> >> There might be a few things to solve:
> >> 1. The website code itself. An open source solution would be great. TBH,
> >> I do not have much experience on building a website. It'll be great if
> >> someone could help comment on the solution here.
> >> 2. The hardware to host the website. Apache Infra provides a few
> >> services[1] that Apache projects can leverage. I did not see database
> >> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
> >>
> >> @Bowen & vino, thanks for the positive feedback!
> >>
> >> @Shaoxuan Wang <ws...@gmail.com>
> >> Thanks for the suggestion. That sounds reasonable to me. We probably need
> >> a page in the Flink official site anyways, even just provide links it to
> >> the ecosystem website. So listing the connectors in that static page seems
> >> something we could start with while we are working on the dynamic pages.
> >>
> >> Thanks,
> >>
> >> Jiangjie (Becket) Qin
> >>
> >> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
> >> wrote:
> >>
> >>> Hi Becket and Robert,
> >>>
> >>> I like this idea!  Let us roll this out with Flink connectors at the
> >>> first beginning. We can start with a static page, and upgrade it when we
> >>> find a better solution for dynamic one with rich functions.
> >>>
> >>> Regards,
> >>> Shaoxuan
> >>>
> >>>
> >>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
> >>> wrote:
> >>>
> >>>> Hey Becket,
> >>>>
> >>>> This is a great idea!
> >>>> For this to be successful, we need to make sure the page is placed
> >>>> prominently so that the people submitting something will get attention for
> >>>> their contributions.
> >>>> I think a dynamic site would probably be better, if we want features
> >>>> such as up and downvoting or comments.
> >>>> I would also like this to be hosted on Apache infra, and endorsed by
> >>>> the community.
> >>>>
> >>>> Does anybody here know any existing software that we could use?
> >>>> The only think I was able to find is AUR: https://aur.archlinux.org/
> >>>> (which is a community packages site for Arch Linux. The source code of this
> >>>> portal is open source, but the layout and structure is not an ideal fit for
> >>>> our requirements)
> >>>>
> >>>> Best,
> >>>> Robert
> >>>>
> >>>>
> >>>>
> >>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
> >>>> wrote:
> >>>>
> >>>>> Hi folks,
> >>>>>
> >>>>> I would like to start a discussion thread about creating a Flink
> >>>>> ecosystem website. The website aims to help contributors who have developed
> >>>>> projects around Flink share their work with the community.
> >>>>>
> >>>>> Please see the following doc for more details.
> >>>>>
> >>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> Jiangjie (Becket) Qin
> >>>>>
> >>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Awesome! Thanks a lot for looking into this Becket! The VMs hosted by Infra
look suitable.

@Shaoxuan: There is actually already a static page. It used to be linked,
but has been removed from the navigation bar for some reason. This is the
page: https://flink.apache.org/ecosystem.html
We could update the page and add it back to the navigation bar for the
coming weeks. What do you think?

I would actually like to push for a dynamic page right away.

I know it's kind of a bold move, but how do you feel about sending the
owners of spark-packages.org a short note, if they are interested in
sharing the source? We could maintain the code together in a public repo.
If they are not interested in sharing, or we decide not to ask in the first
place, I'm happy to write down a short description of the requirements,
maybe some mockups. We could then see if we find somebody here in the
community who's willing to implement it.
Given the number of people who are eager to contribute, I believe we will
be able to find somebody pretty soon.


On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:

> Forgot to provide the link...
>
> [1] https://www.apache.org/dev/services.html#blogs (Apache infra services)
> [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
> Apache Infra)
>
> On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com> wrote:
>
>> Hi Robert,
>>
>> Thanks for the feedback. These are good points. We should absolutely
>> shoot for a dynamic website to support more interactions in the community.
>> There might be a few things to solve:
>> 1. The website code itself. An open source solution would be great. TBH,
>> I do not have much experience on building a website. It'll be great if
>> someone could help comment on the solution here.
>> 2. The hardware to host the website. Apache Infra provides a few
>> services[1] that Apache projects can leverage. I did not see database
>> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>>
>> @Bowen & vino, thanks for the positive feedback!
>>
>> @Shaoxuan Wang <ws...@gmail.com>
>> Thanks for the suggestion. That sounds reasonable to me. We probably need
>> a page in the Flink official site anyways, even just provide links it to
>> the ecosystem website. So listing the connectors in that static page seems
>> something we could start with while we are working on the dynamic pages.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>> wrote:
>>
>>> Hi Becket and Robert,
>>>
>>> I like this idea!  Let us roll this out with Flink connectors at the
>>> first beginning. We can start with a static page, and upgrade it when we
>>> find a better solution for dynamic one with rich functions.
>>>
>>> Regards,
>>> Shaoxuan
>>>
>>>
>>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Hey Becket,
>>>>
>>>> This is a great idea!
>>>> For this to be successful, we need to make sure the page is placed
>>>> prominently so that the people submitting something will get attention for
>>>> their contributions.
>>>> I think a dynamic site would probably be better, if we want features
>>>> such as up and downvoting or comments.
>>>> I would also like this to be hosted on Apache infra, and endorsed by
>>>> the community.
>>>>
>>>> Does anybody here know any existing software that we could use?
>>>> The only think I was able to find is AUR: https://aur.archlinux.org/
>>>> (which is a community packages site for Arch Linux. The source code of this
>>>> portal is open source, but the layout and structure is not an ideal fit for
>>>> our requirements)
>>>>
>>>> Best,
>>>> Robert
>>>>
>>>>
>>>>
>>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi folks,
>>>>>
>>>>> I would like to start a discussion thread about creating a Flink
>>>>> ecosystem website. The website aims to help contributors who have developed
>>>>> projects around Flink share their work with the community.
>>>>>
>>>>> Please see the following doc for more details.
>>>>>
>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Jiangjie (Becket) Qin
>>>>>
>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Awesome! Thanks a lot for looking into this Becket! The VMs hosted by Infra
look suitable.

@Shaoxuan: There is actually already a static page. It used to be linked,
but has been removed from the navigation bar for some reason. This is the
page: https://flink.apache.org/ecosystem.html
We could update the page and add it back to the navigation bar for the
coming weeks. What do you think?

I would actually like to push for a dynamic page right away.

I know it's kind of a bold move, but how do you feel about sending the
owners of spark-packages.org a short note, if they are interested in
sharing the source? We could maintain the code together in a public repo.
If they are not interested in sharing, or we decide not to ask in the first
place, I'm happy to write down a short description of the requirements,
maybe some mockups. We could then see if we find somebody here in the
community who's willing to implement it.
Given the number of people who are eager to contribute, I believe we will
be able to find somebody pretty soon.


On Wed, Mar 6, 2019 at 3:49 AM Becket Qin <be...@gmail.com> wrote:

> Forgot to provide the link...
>
> [1] https://www.apache.org/dev/services.html#blogs (Apache infra services)
> [2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
> Apache Infra)
>
> On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com> wrote:
>
>> Hi Robert,
>>
>> Thanks for the feedback. These are good points. We should absolutely
>> shoot for a dynamic website to support more interactions in the community.
>> There might be a few things to solve:
>> 1. The website code itself. An open source solution would be great. TBH,
>> I do not have much experience on building a website. It'll be great if
>> someone could help comment on the solution here.
>> 2. The hardware to host the website. Apache Infra provides a few
>> services[1] that Apache projects can leverage. I did not see database
>> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>>
>> @Bowen & vino, thanks for the positive feedback!
>>
>> @Shaoxuan Wang <ws...@gmail.com>
>> Thanks for the suggestion. That sounds reasonable to me. We probably need
>> a page in the Flink official site anyways, even just provide links it to
>> the ecosystem website. So listing the connectors in that static page seems
>> something we could start with while we are working on the dynamic pages.
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com>
>> wrote:
>>
>>> Hi Becket and Robert,
>>>
>>> I like this idea!  Let us roll this out with Flink connectors at the
>>> first beginning. We can start with a static page, and upgrade it when we
>>> find a better solution for dynamic one with rich functions.
>>>
>>> Regards,
>>> Shaoxuan
>>>
>>>
>>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
>>> wrote:
>>>
>>>> Hey Becket,
>>>>
>>>> This is a great idea!
>>>> For this to be successful, we need to make sure the page is placed
>>>> prominently so that the people submitting something will get attention for
>>>> their contributions.
>>>> I think a dynamic site would probably be better, if we want features
>>>> such as up and downvoting or comments.
>>>> I would also like this to be hosted on Apache infra, and endorsed by
>>>> the community.
>>>>
>>>> Does anybody here know any existing software that we could use?
>>>> The only think I was able to find is AUR: https://aur.archlinux.org/
>>>> (which is a community packages site for Arch Linux. The source code of this
>>>> portal is open source, but the layout and structure is not an ideal fit for
>>>> our requirements)
>>>>
>>>> Best,
>>>> Robert
>>>>
>>>>
>>>>
>>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi folks,
>>>>>
>>>>> I would like to start a discussion thread about creating a Flink
>>>>> ecosystem website. The website aims to help contributors who have developed
>>>>> projects around Flink share their work with the community.
>>>>>
>>>>> Please see the following doc for more details.
>>>>>
>>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Jiangjie (Becket) Qin
>>>>>
>>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Forgot to provide the link...

[1] https://www.apache.org/dev/services.html#blogs (Apache infra services)
[2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
Apache Infra)

On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com> wrote:

> Hi Robert,
>
> Thanks for the feedback. These are good points. We should absolutely shoot
> for a dynamic website to support more interactions in the community. There
> might be a few things to solve:
> 1. The website code itself. An open source solution would be great. TBH, I
> do not have much experience on building a website. It'll be great if
> someone could help comment on the solution here.
> 2. The hardware to host the website. Apache Infra provides a few
> services[1] that Apache projects can leverage. I did not see database
> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>
> @Bowen & vino, thanks for the positive feedback!
>
> @Shaoxuan Wang <ws...@gmail.com>
> Thanks for the suggestion. That sounds reasonable to me. We probably need
> a page in the Flink official site anyways, even just provide links it to
> the ecosystem website. So listing the connectors in that static page seems
> something we could start with while we are working on the dynamic pages.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com> wrote:
>
>> Hi Becket and Robert,
>>
>> I like this idea!  Let us roll this out with Flink connectors at the
>> first beginning. We can start with a static page, and upgrade it when we
>> find a better solution for dynamic one with rich functions.
>>
>> Regards,
>> Shaoxuan
>>
>>
>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Hey Becket,
>>>
>>> This is a great idea!
>>> For this to be successful, we need to make sure the page is placed
>>> prominently so that the people submitting something will get attention for
>>> their contributions.
>>> I think a dynamic site would probably be better, if we want features
>>> such as up and downvoting or comments.
>>> I would also like this to be hosted on Apache infra, and endorsed by the
>>> community.
>>>
>>> Does anybody here know any existing software that we could use?
>>> The only think I was able to find is AUR: https://aur.archlinux.org/
>>> (which is a community packages site for Arch Linux. The source code of this
>>> portal is open source, but the layout and structure is not an ideal fit for
>>> our requirements)
>>>
>>> Best,
>>> Robert
>>>
>>>
>>>
>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> Hi folks,
>>>>
>>>> I would like to start a discussion thread about creating a Flink
>>>> ecosystem website. The website aims to help contributors who have developed
>>>> projects around Flink share their work with the community.
>>>>
>>>> Please see the following doc for more details.
>>>>
>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>
>>>> Thanks,
>>>>
>>>> Jiangjie (Becket) Qin
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Forgot to provide the link...

[1] https://www.apache.org/dev/services.html#blogs (Apache infra services)
[2] https://www.apache.org/dev/freebsd-jails (FreeBSD Jail provided by
Apache Infra)

On Wed, Mar 6, 2019 at 10:46 AM Becket Qin <be...@gmail.com> wrote:

> Hi Robert,
>
> Thanks for the feedback. These are good points. We should absolutely shoot
> for a dynamic website to support more interactions in the community. There
> might be a few things to solve:
> 1. The website code itself. An open source solution would be great. TBH, I
> do not have much experience on building a website. It'll be great if
> someone could help comment on the solution here.
> 2. The hardware to host the website. Apache Infra provides a few
> services[1] that Apache projects can leverage. I did not see database
> service, but maybe we can run a simple MySQL db in FreeBSD jail[2].
>
> @Bowen & vino, thanks for the positive feedback!
>
> @Shaoxuan Wang <ws...@gmail.com>
> Thanks for the suggestion. That sounds reasonable to me. We probably need
> a page in the Flink official site anyways, even just provide links it to
> the ecosystem website. So listing the connectors in that static page seems
> something we could start with while we are working on the dynamic pages.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>
> On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com> wrote:
>
>> Hi Becket and Robert,
>>
>> I like this idea!  Let us roll this out with Flink connectors at the
>> first beginning. We can start with a static page, and upgrade it when we
>> find a better solution for dynamic one with rich functions.
>>
>> Regards,
>> Shaoxuan
>>
>>
>> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org>
>> wrote:
>>
>>> Hey Becket,
>>>
>>> This is a great idea!
>>> For this to be successful, we need to make sure the page is placed
>>> prominently so that the people submitting something will get attention for
>>> their contributions.
>>> I think a dynamic site would probably be better, if we want features
>>> such as up and downvoting or comments.
>>> I would also like this to be hosted on Apache infra, and endorsed by the
>>> community.
>>>
>>> Does anybody here know any existing software that we could use?
>>> The only think I was able to find is AUR: https://aur.archlinux.org/
>>> (which is a community packages site for Arch Linux. The source code of this
>>> portal is open source, but the layout and structure is not an ideal fit for
>>> our requirements)
>>>
>>> Best,
>>> Robert
>>>
>>>
>>>
>>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>>>
>>>> Hi folks,
>>>>
>>>> I would like to start a discussion thread about creating a Flink
>>>> ecosystem website. The website aims to help contributors who have developed
>>>> projects around Flink share their work with the community.
>>>>
>>>> Please see the following doc for more details.
>>>>
>>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>>
>>>> Thanks,
>>>>
>>>> Jiangjie (Becket) Qin
>>>>
>>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Hi Robert,

Thanks for the feedback. These are good points. We should absolutely shoot
for a dynamic website to support more interactions in the community. There
might be a few things to solve:
1. The website code itself. An open source solution would be great. TBH, I
do not have much experience on building a website. It'll be great if
someone could help comment on the solution here.
2. The hardware to host the website. Apache Infra provides a few
services[1] that Apache projects can leverage. I did not see database
service, but maybe we can run a simple MySQL db in FreeBSD jail[2].

@Bowen & vino, thanks for the positive feedback!

@Shaoxuan Wang <ws...@gmail.com>
Thanks for the suggestion. That sounds reasonable to me. We probably need a
page in the Flink official site anyways, even just provide links it to the
ecosystem website. So listing the connectors in that static page seems
something we could start with while we are working on the dynamic pages.

Thanks,

Jiangjie (Becket) Qin

On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com> wrote:

> Hi Becket and Robert,
>
> I like this idea!  Let us roll this out with Flink connectors at the first
> beginning. We can start with a static page, and upgrade it when we find a
> better solution for dynamic one with rich functions.
>
> Regards,
> Shaoxuan
>
>
> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org> wrote:
>
>> Hey Becket,
>>
>> This is a great idea!
>> For this to be successful, we need to make sure the page is placed
>> prominently so that the people submitting something will get attention for
>> their contributions.
>> I think a dynamic site would probably be better, if we want features such
>> as up and downvoting or comments.
>> I would also like this to be hosted on Apache infra, and endorsed by the
>> community.
>>
>> Does anybody here know any existing software that we could use?
>> The only think I was able to find is AUR: https://aur.archlinux.org/
>> (which is a community packages site for Arch Linux. The source code of this
>> portal is open source, but the layout and structure is not an ideal fit for
>> our requirements)
>>
>> Best,
>> Robert
>>
>>
>>
>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>>
>>> Hi folks,
>>>
>>> I would like to start a discussion thread about creating a Flink
>>> ecosystem website. The website aims to help contributors who have developed
>>> projects around Flink share their work with the community.
>>>
>>> Please see the following doc for more details.
>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Becket Qin <be...@gmail.com>]

Hi Robert,

Thanks for the feedback. These are good points. We should absolutely shoot
for a dynamic website to support more interactions in the community. There
might be a few things to solve:
1. The website code itself. An open source solution would be great. TBH, I
do not have much experience on building a website. It'll be great if
someone could help comment on the solution here.
2. The hardware to host the website. Apache Infra provides a few
services[1] that Apache projects can leverage. I did not see database
service, but maybe we can run a simple MySQL db in FreeBSD jail[2].

@Bowen & vino, thanks for the positive feedback!

@Shaoxuan Wang <ws...@gmail.com>
Thanks for the suggestion. That sounds reasonable to me. We probably need a
page in the Flink official site anyways, even just provide links it to the
ecosystem website. So listing the connectors in that static page seems
something we could start with while we are working on the dynamic pages.

Thanks,

Jiangjie (Becket) Qin

On Wed, Mar 6, 2019 at 10:40 AM Shaoxuan Wang <ws...@gmail.com> wrote:

> Hi Becket and Robert,
>
> I like this idea!  Let us roll this out with Flink connectors at the first
> beginning. We can start with a static page, and upgrade it when we find a
> better solution for dynamic one with rich functions.
>
> Regards,
> Shaoxuan
>
>
> On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org> wrote:
>
>> Hey Becket,
>>
>> This is a great idea!
>> For this to be successful, we need to make sure the page is placed
>> prominently so that the people submitting something will get attention for
>> their contributions.
>> I think a dynamic site would probably be better, if we want features such
>> as up and downvoting or comments.
>> I would also like this to be hosted on Apache infra, and endorsed by the
>> community.
>>
>> Does anybody here know any existing software that we could use?
>> The only think I was able to find is AUR: https://aur.archlinux.org/
>> (which is a community packages site for Arch Linux. The source code of this
>> portal is open source, but the layout and structure is not an ideal fit for
>> our requirements)
>>
>> Best,
>> Robert
>>
>>
>>
>> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>>
>>> Hi folks,
>>>
>>> I would like to start a discussion thread about creating a Flink
>>> ecosystem website. The website aims to help contributors who have developed
>>> projects around Flink share their work with the community.
>>>
>>> Please see the following doc for more details.
>>>
>>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>>
>>> Thanks,
>>>
>>> Jiangjie (Becket) Qin
>>>
>>

Re: [DISCUSS] Create a Flink ecosystem website

[Shaoxuan Wang <ws...@gmail.com>]

Hi Becket and Robert,

I like this idea!  Let us roll this out with Flink connectors at the first
beginning. We can start with a static page, and upgrade it when we find a
better solution for dynamic one with rich functions.

Regards,
Shaoxuan


On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org> wrote:

> Hey Becket,
>
> This is a great idea!
> For this to be successful, we need to make sure the page is placed
> prominently so that the people submitting something will get attention for
> their contributions.
> I think a dynamic site would probably be better, if we want features such
> as up and downvoting or comments.
> I would also like this to be hosted on Apache infra, and endorsed by the
> community.
>
> Does anybody here know any existing software that we could use?
> The only think I was able to find is AUR: https://aur.archlinux.org/
> (which is a community packages site for Arch Linux. The source code of this
> portal is open source, but the layout and structure is not an ideal fit for
> our requirements)
>
> Best,
> Robert
>
>
>
> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>
>> Hi folks,
>>
>> I would like to start a discussion thread about creating a Flink
>> ecosystem website. The website aims to help contributors who have developed
>> projects around Flink share their work with the community.
>>
>> Please see the following doc for more details.
>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Shaoxuan Wang <ws...@gmail.com>]

Hi Becket and Robert,

I like this idea!  Let us roll this out with Flink connectors at the first
beginning. We can start with a static page, and upgrade it when we find a
better solution for dynamic one with rich functions.

Regards,
Shaoxuan


On Wed, Mar 6, 2019 at 1:36 AM Robert Metzger <rm...@apache.org> wrote:

> Hey Becket,
>
> This is a great idea!
> For this to be successful, we need to make sure the page is placed
> prominently so that the people submitting something will get attention for
> their contributions.
> I think a dynamic site would probably be better, if we want features such
> as up and downvoting or comments.
> I would also like this to be hosted on Apache infra, and endorsed by the
> community.
>
> Does anybody here know any existing software that we could use?
> The only think I was able to find is AUR: https://aur.archlinux.org/
> (which is a community packages site for Arch Linux. The source code of this
> portal is open source, but the layout and structure is not an ideal fit for
> our requirements)
>
> Best,
> Robert
>
>
>
> On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:
>
>> Hi folks,
>>
>> I would like to start a discussion thread about creating a Flink
>> ecosystem website. The website aims to help contributors who have developed
>> projects around Flink share their work with the community.
>>
>> Please see the following doc for more details.
>>
>> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>>
>> Thanks,
>>
>> Jiangjie (Becket) Qin
>>
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey Becket,

This is a great idea!
For this to be successful, we need to make sure the page is placed
prominently so that the people submitting something will get attention for
their contributions.
I think a dynamic site would probably be better, if we want features such
as up and downvoting or comments.
I would also like this to be hosted on Apache infra, and endorsed by the
community.

Does anybody here know any existing software that we could use?
The only think I was able to find is AUR: https://aur.archlinux.org/ (which
is a community packages site for Arch Linux. The source code of this portal
is open source, but the layout and structure is not an ideal fit for our
requirements)

Best,
Robert



On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:

> Hi folks,
>
> I would like to start a discussion thread about creating a Flink ecosystem
> website. The website aims to help contributors who have developed projects
> around Flink share their work with the community.
>
> Please see the following doc for more details.
>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>
> Thanks,
>
> Jiangjie (Becket) Qin
>

Re: [DISCUSS] Create a Flink ecosystem website

[Robert Metzger <rm...@apache.org>]

Hey Becket,

This is a great idea!
For this to be successful, we need to make sure the page is placed
prominently so that the people submitting something will get attention for
their contributions.
I think a dynamic site would probably be better, if we want features such
as up and downvoting or comments.
I would also like this to be hosted on Apache infra, and endorsed by the
community.

Does anybody here know any existing software that we could use?
The only think I was able to find is AUR: https://aur.archlinux.org/ (which
is a community packages site for Arch Linux. The source code of this portal
is open source, but the layout and structure is not an ideal fit for our
requirements)

Best,
Robert



On Tue, Mar 5, 2019 at 12:03 PM Becket Qin <be...@gmail.com> wrote:

> Hi folks,
>
> I would like to start a discussion thread about creating a Flink ecosystem
> website. The website aims to help contributors who have developed projects
> around Flink share their work with the community.
>
> Please see the following doc for more details.
>
> https://docs.google.com/document/d/12oCItoLbKrLGuwEUFcCfigezIR2hW3925j1hh3kGp4A/edit#
>
> Thanks,
>
> Jiangjie (Becket) Qin
>