You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@incubator.apache.org by Willem Jiang <wi...@gmail.com> on 2022/04/07 08:20:51 UTC

[DISCUSS] Incubating Proposal of DevLake

We want to propose  DevLake[1]  as a new Apache Incubator project.

DevLake helps developer teams integrate and analyze software
development data throughout the software development life cycle
(SDLC).
Specifically, DevLake provides:

* High-quality connectors that integrate data from various DevOps tools;
* A comprehensive and unified data model and metrics that enable
developers to easily query data and answer questions regarding their
development process;
* A plugin system that allows customizable data connectors and enrichers;
* An unified ETL management module that orchestrates data collection
and analysis.

I'd be happy to be the Champion of this project and many thanks to
Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
project and helping us to polish the incubating proposal[2].

Looking forward to your feedback and thank you very much.

[1]https://github.com/merico-dev/lake
[2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal

Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Re: [DISCUSS] Incubating Proposal of DevLake

Posted by "zhangliang@apache.org" <zh...@apache.org>.
I am happy to see DevLake summit the proposal.
The initial committers are keep open for learning OSS Culture and  Apache
Way.
I am confident to help them become a qualified Apache project.

------------------

Sincerely,
Liang Zhang (John)
Apache ShardingSphere


Lidong Dai <li...@apache.org> 于2022年4月16日周六 12:11写道:

> I'm interested in the concept of DevOps toolchain as code. I'd be happy to
> be the mentor of this DevLake project, I think it can enrich the apache
> ecosystem.
>
>
> Best Regards
>
>
>
> ---------------
> Apache DolphinScheduler PMC Chair & Apache SeaTunnel PPMC
> Lidong Dai
> lidongdai@apache.org
> Linkedin: https://www.linkedin.com/in/dailidong
> Twitter: @WorkflowEasy <https://twitter.com/WorkflowEasy>
>
> ---------------
>
>
> On Mon, Apr 11, 2022 at 4:49 AM Felix Cheung <fe...@apache.org>
> wrote:
>
> > Thanks.
> >
> > Can the community comment on
> >
> > - the project relationship with devstream/dtm
> >
> > - repo here looks related:
> > https://github.com/philipjung164/devlake/graphs/contributors
> >
> >
> > On Fri, Apr 8, 2022 at 6:33 AM Willem Jiang <wi...@gmail.com>
> > wrote:
> >
> > > Hi Felix,
> > >
> > > Thanks for the kindly offering, I just added you into the mentor list
> > > of the proposal.
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > On Fri, Apr 8, 2022 at 2:45 AM Felix Cheung <fe...@apache.org>
> > > wrote:
> > > >
> > > > Interesting and unique project for incubator.
> > > >
> > > > Would love to help as mentor.
> > > >
> > > >
> > > > On Thu, Apr 7, 2022 at 1:22 AM Willem Jiang <wi...@gmail.com>
> > > wrote:
> > > >
> > > > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > > > >
> > > > > DevLake helps developer teams integrate and analyze software
> > > > > development data throughout the software development life cycle
> > > > > (SDLC).
> > > > > Specifically, DevLake provides:
> > > > >
> > > > > * High-quality connectors that integrate data from various DevOps
> > > tools;
> > > > > * A comprehensive and unified data model and metrics that enable
> > > > > developers to easily query data and answer questions regarding
> their
> > > > > development process;
> > > > > * A plugin system that allows customizable data connectors and
> > > enrichers;
> > > > > * An unified ETL management module that orchestrates data
> collection
> > > > > and analysis.
> > > > >
> > > > > I'd be happy to be the Champion of this project and many thanks to
> > > > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at
> > > apache
> > > > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor
> of
> > > > > DevLake
> > > > > project and helping us to polish the incubating proposal[2].
> > > > >
> > > > > Looking forward to your feedback and thank you very much.
> > > > >
> > > > > [1]https://github.com/merico-dev/lake
> > > > > [2]
> > > https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > > > >
> > > > > Willem Jiang
> > > > >
> > > > > Twitter: willemjiang
> > > > > Weibo: 姜宁willem
> > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > > >
> > > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> > >
> >
>

Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Lidong Dai <li...@apache.org>.
I'm interested in the concept of DevOps toolchain as code. I'd be happy to
be the mentor of this DevLake project, I think it can enrich the apache
ecosystem.


Best Regards



---------------
Apache DolphinScheduler PMC Chair & Apache SeaTunnel PPMC
Lidong Dai
lidongdai@apache.org
Linkedin: https://www.linkedin.com/in/dailidong
Twitter: @WorkflowEasy <https://twitter.com/WorkflowEasy>

---------------


On Mon, Apr 11, 2022 at 4:49 AM Felix Cheung <fe...@apache.org> wrote:

> Thanks.
>
> Can the community comment on
>
> - the project relationship with devstream/dtm
>
> - repo here looks related:
> https://github.com/philipjung164/devlake/graphs/contributors
>
>
> On Fri, Apr 8, 2022 at 6:33 AM Willem Jiang <wi...@gmail.com>
> wrote:
>
> > Hi Felix,
> >
> > Thanks for the kindly offering, I just added you into the mentor list
> > of the proposal.
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > On Fri, Apr 8, 2022 at 2:45 AM Felix Cheung <fe...@apache.org>
> > wrote:
> > >
> > > Interesting and unique project for incubator.
> > >
> > > Would love to help as mentor.
> > >
> > >
> > > On Thu, Apr 7, 2022 at 1:22 AM Willem Jiang <wi...@gmail.com>
> > wrote:
> > >
> > > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > > >
> > > > DevLake helps developer teams integrate and analyze software
> > > > development data throughout the software development life cycle
> > > > (SDLC).
> > > > Specifically, DevLake provides:
> > > >
> > > > * High-quality connectors that integrate data from various DevOps
> > tools;
> > > > * A comprehensive and unified data model and metrics that enable
> > > > developers to easily query data and answer questions regarding their
> > > > development process;
> > > > * A plugin system that allows customizable data connectors and
> > enrichers;
> > > > * An unified ETL management module that orchestrates data collection
> > > > and analysis.
> > > >
> > > > I'd be happy to be the Champion of this project and many thanks to
> > > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at
> > apache
> > > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of
> > > > DevLake
> > > > project and helping us to polish the incubating proposal[2].
> > > >
> > > > Looking forward to your feedback and thank you very much.
> > > >
> > > > [1]https://github.com/merico-dev/lake
> > > > [2]
> > https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > > >
> > > > Willem Jiang
> > > >
> > > > Twitter: willemjiang
> > > > Weibo: 姜宁willem
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>

Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Felix Cheung <fe...@apache.org>.
Thanks.

Can the community comment on

- the project relationship with devstream/dtm

- repo here looks related:
https://github.com/philipjung164/devlake/graphs/contributors


On Fri, Apr 8, 2022 at 6:33 AM Willem Jiang <wi...@gmail.com> wrote:

> Hi Felix,
>
> Thanks for the kindly offering, I just added you into the mentor list
> of the proposal.
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> On Fri, Apr 8, 2022 at 2:45 AM Felix Cheung <fe...@apache.org>
> wrote:
> >
> > Interesting and unique project for incubator.
> >
> > Would love to help as mentor.
> >
> >
> > On Thu, Apr 7, 2022 at 1:22 AM Willem Jiang <wi...@gmail.com>
> wrote:
> >
> > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > >
> > > DevLake helps developer teams integrate and analyze software
> > > development data throughout the software development life cycle
> > > (SDLC).
> > > Specifically, DevLake provides:
> > >
> > > * High-quality connectors that integrate data from various DevOps
> tools;
> > > * A comprehensive and unified data model and metrics that enable
> > > developers to easily query data and answer questions regarding their
> > > development process;
> > > * A plugin system that allows customizable data connectors and
> enrichers;
> > > * An unified ETL management module that orchestrates data collection
> > > and analysis.
> > >
> > > I'd be happy to be the Champion of this project and many thanks to
> > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at
> apache
> > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of
> > > DevLake
> > > project and helping us to polish the incubating proposal[2].
> > >
> > > Looking forward to your feedback and thank you very much.
> > >
> > > [1]https://github.com/merico-dev/lake
> > > [2]
> https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> > >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>

Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Willem Jiang <wi...@gmail.com>.
Hi Felix,

Thanks for the kindly offering, I just added you into the mentor list
of the proposal.

Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Fri, Apr 8, 2022 at 2:45 AM Felix Cheung <fe...@apache.org> wrote:
>
> Interesting and unique project for incubator.
>
> Would love to help as mentor.
>
>
> On Thu, Apr 7, 2022 at 1:22 AM Willem Jiang <wi...@gmail.com> wrote:
>
> > We want to propose  DevLake[1]  as a new Apache Incubator project.
> >
> > DevLake helps developer teams integrate and analyze software
> > development data throughout the software development life cycle
> > (SDLC).
> > Specifically, DevLake provides:
> >
> > * High-quality connectors that integrate data from various DevOps tools;
> > * A comprehensive and unified data model and metrics that enable
> > developers to easily query data and answer questions regarding their
> > development process;
> > * A plugin system that allows customizable data connectors and enrichers;
> > * An unified ETL management module that orchestrates data collection
> > and analysis.
> >
> > I'd be happy to be the Champion of this project and many thanks to
> > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of
> > DevLake
> > project and helping us to polish the incubating proposal[2].
> >
> > Looking forward to your feedback and thank you very much.
> >
> > [1]https://github.com/merico-dev/lake
> > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Felix Cheung <fe...@apache.org>.
Interesting and unique project for incubator.

Would love to help as mentor.


On Thu, Apr 7, 2022 at 1:22 AM Willem Jiang <wi...@gmail.com> wrote:

> We want to propose  DevLake[1]  as a new Apache Incubator project.
>
> DevLake helps developer teams integrate and analyze software
> development data throughout the software development life cycle
> (SDLC).
> Specifically, DevLake provides:
>
> * High-quality connectors that integrate data from various DevOps tools;
> * A comprehensive and unified data model and metrics that enable
> developers to easily query data and answer questions regarding their
> development process;
> * A plugin system that allows customizable data connectors and enrichers;
> * An unified ETL management module that orchestrates data collection
> and analysis.
>
> I'd be happy to be the Champion of this project and many thanks to
> Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> dot org),Sijie Guo (sijie at apache dot org) for being the mentor of
> DevLake
> project and helping us to polish the incubating proposal[2].
>
> Looking forward to your feedback and thank you very much.
>
> [1]https://github.com/merico-dev/lake
> [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>

Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Hezheng Yin <he...@merico.dev.INVALID>.
Hi JB,

Thank you for offering to be our mentor. We really appreciate it!

Also thanks Willem for adding JB to the mentor list.

Best,
Hezheng

From: Willem Jiang <wi...@gmail.com>
Date: Friday, April 22, 2022 at 6:09 AM
To: Incubator General <ge...@incubator.apache.org>
Subject: Re: [DISCUSS] Incubating Proposal of DevLake
Hi JB,

Thanks for offering to help.
I just added you to the mentor list.

Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Fri, Apr 22, 2022 at 1:19 PM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
> Hi Hezheng
>
> Thanks for the details. It helps as well.
>
> If you need help/additional mentor, please let me know. I don't know
> go very well but happy to learn and help. However, I think you already
> have enough and good mentors on the proposal.
>
> Regards
> JB
>
> On Thu, Apr 21, 2022 at 8:18 AM Hezheng Yin <he...@merico.dev.invalid> wrote:
> >
> > Hi JB,
> >
> > Thanks for your interests in DevLake. One key difference between DevLake and Gobblin/NiFi is that Gobblin/NiFi are domain agnostic general frameworks while DevLake specializes in the domain of software development data. This focus allows DevLake to better “understand” the data that it ingests, cleanses, transforms, analyzes, and visualizes for developers. At the foundation of this understanding is DevLake’s data model<https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema> built on top of the software development process. We’ll keep expanding this model as DevLake supports new DevOps tools (data sources) requested by the community. If you have any other question or suggestion, please let us know. Any feedback is greatly appreciated!
> >
> > Best,
> > Hezheng
> > Maintainer of DevLake
> >
> > From: Jean-Baptiste Onofré <jb...@nanthrax.net>
> > Date: Monday, April 18, 2022 at 7:23 AM
> > To: general@incubator.apache.org <ge...@incubator.apache.org>
> > Subject: Re: [DISCUSS] Incubating Proposal of DevLake
> > Thanks, it helps !
> >
> > Regards
> > JB
> >
> > On Mon, Apr 18, 2022 at 4:14 PM Willem Jiang <wi...@gmail.com> wrote:
> > >
> > > Hi JB
> > >
> > > You may find the information about the DevOps data collection here[1]
> > > There are some domain related entities schema[2] which are built on
> > > top of the development process.
> > >
> > > [1]https://github.com/merico-dev/lake/blob/main/ARCHITECTURE.md
> > > [2]https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema
> > >
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > On Sun, Apr 17, 2022 at 12:14 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> > > >
> > > > Hi Willem,
> > > >
> > > > It looks interesting. I took a look on github repo. I don't see the
> > > > relation between DevOps and data collection/ETL part mentioned on the
> > > > README.
> > > >
> > > > For the data collection/ETL framework, it sounds similar to
> > > > Gobblin/NiFi, etc. The DevOps part is more interesting IMHO. I have to
> > > > dig into this.
> > > >
> > > > Regards
> > > > JB
> > > >
> > > > On Thu, Apr 7, 2022 at 10:20 AM Willem Jiang <wi...@gmail.com> wrote:
> > > > >
> > > > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > > > >
> > > > > DevLake helps developer teams integrate and analyze software
> > > > > development data throughout the software development life cycle
> > > > > (SDLC).
> > > > > Specifically, DevLake provides:
> > > > >
> > > > > * High-quality connectors that integrate data from various DevOps tools;
> > > > > * A comprehensive and unified data model and metrics that enable
> > > > > developers to easily query data and answer questions regarding their
> > > > > development process;
> > > > > * A plugin system that allows customizable data connectors and enrichers;
> > > > > * An unified ETL management module that orchestrates data collection
> > > > > and analysis.
> > > > >
> > > > > I'd be happy to be the Champion of this project and many thanks to
> > > > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> > > > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
> > > > > project and helping us to polish the incubating proposal[2].
> > > > >
> > > > > Looking forward to your feedback and thank you very much.
> > > > >
> > > > > [1]https://github.com/merico-dev/lake
> > > > > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > > > >
> > > > > Willem Jiang
> > > > >
> > > > > Twitter: willemjiang
> > > > > Weibo: 姜宁willem
> > > > >
> > > > > ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > > >
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org

Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Willem Jiang <wi...@gmail.com>.
Hi JB,

Thanks for offering to help.
I just added you to the mentor list.

Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Fri, Apr 22, 2022 at 1:19 PM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
> Hi Hezheng
>
> Thanks for the details. It helps as well.
>
> If you need help/additional mentor, please let me know. I don't know
> go very well but happy to learn and help. However, I think you already
> have enough and good mentors on the proposal.
>
> Regards
> JB
>
> On Thu, Apr 21, 2022 at 8:18 AM Hezheng Yin <he...@merico.dev.invalid> wrote:
> >
> > Hi JB,
> >
> > Thanks for your interests in DevLake. One key difference between DevLake and Gobblin/NiFi is that Gobblin/NiFi are domain agnostic general frameworks while DevLake specializes in the domain of software development data. This focus allows DevLake to better “understand” the data that it ingests, cleanses, transforms, analyzes, and visualizes for developers. At the foundation of this understanding is DevLake’s data model<https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema> built on top of the software development process. We’ll keep expanding this model as DevLake supports new DevOps tools (data sources) requested by the community. If you have any other question or suggestion, please let us know. Any feedback is greatly appreciated!
> >
> > Best,
> > Hezheng
> > Maintainer of DevLake
> >
> > From: Jean-Baptiste Onofré <jb...@nanthrax.net>
> > Date: Monday, April 18, 2022 at 7:23 AM
> > To: general@incubator.apache.org <ge...@incubator.apache.org>
> > Subject: Re: [DISCUSS] Incubating Proposal of DevLake
> > Thanks, it helps !
> >
> > Regards
> > JB
> >
> > On Mon, Apr 18, 2022 at 4:14 PM Willem Jiang <wi...@gmail.com> wrote:
> > >
> > > Hi JB
> > >
> > > You may find the information about the DevOps data collection here[1]
> > > There are some domain related entities schema[2] which are built on
> > > top of the development process.
> > >
> > > [1]https://github.com/merico-dev/lake/blob/main/ARCHITECTURE.md
> > > [2]https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema
> > >
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > On Sun, Apr 17, 2022 at 12:14 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> > > >
> > > > Hi Willem,
> > > >
> > > > It looks interesting. I took a look on github repo. I don't see the
> > > > relation between DevOps and data collection/ETL part mentioned on the
> > > > README.
> > > >
> > > > For the data collection/ETL framework, it sounds similar to
> > > > Gobblin/NiFi, etc. The DevOps part is more interesting IMHO. I have to
> > > > dig into this.
> > > >
> > > > Regards
> > > > JB
> > > >
> > > > On Thu, Apr 7, 2022 at 10:20 AM Willem Jiang <wi...@gmail.com> wrote:
> > > > >
> > > > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > > > >
> > > > > DevLake helps developer teams integrate and analyze software
> > > > > development data throughout the software development life cycle
> > > > > (SDLC).
> > > > > Specifically, DevLake provides:
> > > > >
> > > > > * High-quality connectors that integrate data from various DevOps tools;
> > > > > * A comprehensive and unified data model and metrics that enable
> > > > > developers to easily query data and answer questions regarding their
> > > > > development process;
> > > > > * A plugin system that allows customizable data connectors and enrichers;
> > > > > * An unified ETL management module that orchestrates data collection
> > > > > and analysis.
> > > > >
> > > > > I'd be happy to be the Champion of this project and many thanks to
> > > > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> > > > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
> > > > > project and helping us to polish the incubating proposal[2].
> > > > >
> > > > > Looking forward to your feedback and thank you very much.
> > > > >
> > > > > [1]https://github.com/merico-dev/lake
> > > > > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > > > >
> > > > > Willem Jiang
> > > > >
> > > > > Twitter: willemjiang
> > > > > Weibo: 姜宁willem
> > > > >
> > > > > ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > > >
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Hezheng

Thanks for the details. It helps as well.

If you need help/additional mentor, please let me know. I don't know
go very well but happy to learn and help. However, I think you already
have enough and good mentors on the proposal.

Regards
JB

On Thu, Apr 21, 2022 at 8:18 AM Hezheng Yin <he...@merico.dev.invalid> wrote:
>
> Hi JB,
>
> Thanks for your interests in DevLake. One key difference between DevLake and Gobblin/NiFi is that Gobblin/NiFi are domain agnostic general frameworks while DevLake specializes in the domain of software development data. This focus allows DevLake to better “understand” the data that it ingests, cleanses, transforms, analyzes, and visualizes for developers. At the foundation of this understanding is DevLake’s data model<https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema> built on top of the software development process. We’ll keep expanding this model as DevLake supports new DevOps tools (data sources) requested by the community. If you have any other question or suggestion, please let us know. Any feedback is greatly appreciated!
>
> Best,
> Hezheng
> Maintainer of DevLake
>
> From: Jean-Baptiste Onofré <jb...@nanthrax.net>
> Date: Monday, April 18, 2022 at 7:23 AM
> To: general@incubator.apache.org <ge...@incubator.apache.org>
> Subject: Re: [DISCUSS] Incubating Proposal of DevLake
> Thanks, it helps !
>
> Regards
> JB
>
> On Mon, Apr 18, 2022 at 4:14 PM Willem Jiang <wi...@gmail.com> wrote:
> >
> > Hi JB
> >
> > You may find the information about the DevOps data collection here[1]
> > There are some domain related entities schema[2] which are built on
> > top of the development process.
> >
> > [1]https://github.com/merico-dev/lake/blob/main/ARCHITECTURE.md
> > [2]https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema
> >
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > On Sun, Apr 17, 2022 at 12:14 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> > >
> > > Hi Willem,
> > >
> > > It looks interesting. I took a look on github repo. I don't see the
> > > relation between DevOps and data collection/ETL part mentioned on the
> > > README.
> > >
> > > For the data collection/ETL framework, it sounds similar to
> > > Gobblin/NiFi, etc. The DevOps part is more interesting IMHO. I have to
> > > dig into this.
> > >
> > > Regards
> > > JB
> > >
> > > On Thu, Apr 7, 2022 at 10:20 AM Willem Jiang <wi...@gmail.com> wrote:
> > > >
> > > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > > >
> > > > DevLake helps developer teams integrate and analyze software
> > > > development data throughout the software development life cycle
> > > > (SDLC).
> > > > Specifically, DevLake provides:
> > > >
> > > > * High-quality connectors that integrate data from various DevOps tools;
> > > > * A comprehensive and unified data model and metrics that enable
> > > > developers to easily query data and answer questions regarding their
> > > > development process;
> > > > * A plugin system that allows customizable data connectors and enrichers;
> > > > * An unified ETL management module that orchestrates data collection
> > > > and analysis.
> > > >
> > > > I'd be happy to be the Champion of this project and many thanks to
> > > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> > > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
> > > > project and helping us to polish the incubating proposal[2].
> > > >
> > > > Looking forward to your feedback and thank you very much.
> > > >
> > > > [1]https://github.com/merico-dev/lake
> > > > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > > >
> > > > Willem Jiang
> > > >
> > > > Twitter: willemjiang
> > > > Weibo: 姜宁willem
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Hezheng Yin <he...@merico.dev.INVALID>.
Hi JB,

Thanks for your interests in DevLake. One key difference between DevLake and Gobblin/NiFi is that Gobblin/NiFi are domain agnostic general frameworks while DevLake specializes in the domain of software development data. This focus allows DevLake to better “understand” the data that it ingests, cleanses, transforms, analyzes, and visualizes for developers. At the foundation of this understanding is DevLake’s data model<https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema> built on top of the software development process. We’ll keep expanding this model as DevLake supports new DevOps tools (data sources) requested by the community. If you have any other question or suggestion, please let us know. Any feedback is greatly appreciated!

Best,
Hezheng
Maintainer of DevLake

From: Jean-Baptiste Onofré <jb...@nanthrax.net>
Date: Monday, April 18, 2022 at 7:23 AM
To: general@incubator.apache.org <ge...@incubator.apache.org>
Subject: Re: [DISCUSS] Incubating Proposal of DevLake
Thanks, it helps !

Regards
JB

On Mon, Apr 18, 2022 at 4:14 PM Willem Jiang <wi...@gmail.com> wrote:
>
> Hi JB
>
> You may find the information about the DevOps data collection here[1]
> There are some domain related entities schema[2] which are built on
> top of the development process.
>
> [1]https://github.com/merico-dev/lake/blob/main/ARCHITECTURE.md
> [2]https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema
>
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> On Sun, Apr 17, 2022 at 12:14 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> >
> > Hi Willem,
> >
> > It looks interesting. I took a look on github repo. I don't see the
> > relation between DevOps and data collection/ETL part mentioned on the
> > README.
> >
> > For the data collection/ETL framework, it sounds similar to
> > Gobblin/NiFi, etc. The DevOps part is more interesting IMHO. I have to
> > dig into this.
> >
> > Regards
> > JB
> >
> > On Thu, Apr 7, 2022 at 10:20 AM Willem Jiang <wi...@gmail.com> wrote:
> > >
> > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > >
> > > DevLake helps developer teams integrate and analyze software
> > > development data throughout the software development life cycle
> > > (SDLC).
> > > Specifically, DevLake provides:
> > >
> > > * High-quality connectors that integrate data from various DevOps tools;
> > > * A comprehensive and unified data model and metrics that enable
> > > developers to easily query data and answer questions regarding their
> > > development process;
> > > * A plugin system that allows customizable data connectors and enrichers;
> > > * An unified ETL management module that orchestrates data collection
> > > and analysis.
> > >
> > > I'd be happy to be the Champion of this project and many thanks to
> > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
> > > project and helping us to polish the incubating proposal[2].
> > >
> > > Looking forward to your feedback and thank you very much.
> > >
> > > [1]https://github.com/merico-dev/lake
> > > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org

Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Thanks, it helps !

Regards
JB

On Mon, Apr 18, 2022 at 4:14 PM Willem Jiang <wi...@gmail.com> wrote:
>
> Hi JB
>
> You may find the information about the DevOps data collection here[1]
> There are some domain related entities schema[2] which are built on
> top of the development process.
>
> [1]https://github.com/merico-dev/lake/blob/main/ARCHITECTURE.md
> [2]https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema
>
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> On Sun, Apr 17, 2022 at 12:14 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> >
> > Hi Willem,
> >
> > It looks interesting. I took a look on github repo. I don't see the
> > relation between DevOps and data collection/ETL part mentioned on the
> > README.
> >
> > For the data collection/ETL framework, it sounds similar to
> > Gobblin/NiFi, etc. The DevOps part is more interesting IMHO. I have to
> > dig into this.
> >
> > Regards
> > JB
> >
> > On Thu, Apr 7, 2022 at 10:20 AM Willem Jiang <wi...@gmail.com> wrote:
> > >
> > > We want to propose  DevLake[1]  as a new Apache Incubator project.
> > >
> > > DevLake helps developer teams integrate and analyze software
> > > development data throughout the software development life cycle
> > > (SDLC).
> > > Specifically, DevLake provides:
> > >
> > > * High-quality connectors that integrate data from various DevOps tools;
> > > * A comprehensive and unified data model and metrics that enable
> > > developers to easily query data and answer questions regarding their
> > > development process;
> > > * A plugin system that allows customizable data connectors and enrichers;
> > > * An unified ETL management module that orchestrates data collection
> > > and analysis.
> > >
> > > I'd be happy to be the Champion of this project and many thanks to
> > > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> > > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
> > > project and helping us to polish the incubating proposal[2].
> > >
> > > Looking forward to your feedback and thank you very much.
> > >
> > > [1]https://github.com/merico-dev/lake
> > > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> > >
> > > Willem Jiang
> > >
> > > Twitter: willemjiang
> > > Weibo: 姜宁willem
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Willem Jiang <wi...@gmail.com>.
Hi JB

You may find the information about the DevOps data collection here[1]
There are some domain related entities schema[2] which are built on
top of the development process.

[1]https://github.com/merico-dev/lake/blob/main/ARCHITECTURE.md
[2]https://github.com/merico-dev/lake/wiki/DataModel.Domain-layer-schema


Willem Jiang

Twitter: willemjiang
Weibo: 姜宁willem

On Sun, Apr 17, 2022 at 12:14 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
> Hi Willem,
>
> It looks interesting. I took a look on github repo. I don't see the
> relation between DevOps and data collection/ETL part mentioned on the
> README.
>
> For the data collection/ETL framework, it sounds similar to
> Gobblin/NiFi, etc. The DevOps part is more interesting IMHO. I have to
> dig into this.
>
> Regards
> JB
>
> On Thu, Apr 7, 2022 at 10:20 AM Willem Jiang <wi...@gmail.com> wrote:
> >
> > We want to propose  DevLake[1]  as a new Apache Incubator project.
> >
> > DevLake helps developer teams integrate and analyze software
> > development data throughout the software development life cycle
> > (SDLC).
> > Specifically, DevLake provides:
> >
> > * High-quality connectors that integrate data from various DevOps tools;
> > * A comprehensive and unified data model and metrics that enable
> > developers to easily query data and answer questions regarding their
> > development process;
> > * A plugin system that allows customizable data connectors and enrichers;
> > * An unified ETL management module that orchestrates data collection
> > and analysis.
> >
> > I'd be happy to be the Champion of this project and many thanks to
> > Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> > dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
> > project and helping us to polish the incubating proposal[2].
> >
> > Looking forward to your feedback and thank you very much.
> >
> > [1]https://github.com/merico-dev/lake
> > [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
> >
> > Willem Jiang
> >
> > Twitter: willemjiang
> > Weibo: 姜宁willem
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Re: [DISCUSS] Incubating Proposal of DevLake

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Willem,

It looks interesting. I took a look on github repo. I don't see the
relation between DevOps and data collection/ETL part mentioned on the
README.

For the data collection/ETL framework, it sounds similar to
Gobblin/NiFi, etc. The DevOps part is more interesting IMHO. I have to
dig into this.

Regards
JB

On Thu, Apr 7, 2022 at 10:20 AM Willem Jiang <wi...@gmail.com> wrote:
>
> We want to propose  DevLake[1]  as a new Apache Incubator project.
>
> DevLake helps developer teams integrate and analyze software
> development data throughout the software development life cycle
> (SDLC).
> Specifically, DevLake provides:
>
> * High-quality connectors that integrate data from various DevOps tools;
> * A comprehensive and unified data model and metrics that enable
> developers to easily query data and answer questions regarding their
> development process;
> * A plugin system that allows customizable data connectors and enrichers;
> * An unified ETL management module that orchestrates data collection
> and analysis.
>
> I'd be happy to be the Champion of this project and many thanks to
> Liang Zhang (zhangliang at apache dot org),Lidong Dai (lidongdai at apache
> dot org),Sijie Guo (sijie at apache dot org) for being the mentor of  DevLake
> project and helping us to polish the incubating proposal[2].
>
> Looking forward to your feedback and thank you very much.
>
> [1]https://github.com/merico-dev/lake
> [2]https://cwiki.apache.org/confluence/display/INCUBATOR/DevLakeProposal
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org