You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@apache.org by Huxing Zhang <hu...@apache.org> on 2019/02/15 08:10:41 UTC
Re: Continuous deployment for Dubbo
Hi,
CCing builds@apache.org
On Fri, Feb 15, 2019 at 11:16 AM jun liu <ke...@gmail.com> wrote:
>
> Hi,
>
> I’ve figure out the integration with Travis. With this PR[1] travis can automatically deploy SNAPSHOT artifacts to the apache maven repository.
>
> But there’s one potential security issue to be aware.
> To make sure the deployment process get the proper right, I have to give my Apache ID to Travis. It’s guaranteed by Travis that the raw username/password will be safely kept in Travis and the public will only see the encrypted codes[2]. Travis Ci uses asymmetric cryptography[3] to achieve that, which I personally think is pretty safe and trustable. Even though I think it’s still an issue worth discussing, especially considering there maybe have some ASF policies denying this action (providing Apache ID to a trusted third party platform) but I do not aware of.
I am leaning towards do not expose a personal Apache credentials to
third parties unless we know it is safe to do so.
And I do think there is a recommended way in order to deploy snapshot
to maven repository upon successful build for each commit.
Just want to confirm with builds@apache.org, is this safe to do so?
I just checked [1] it clearly states it can
a) Automatically Build and Deploy Snapshots to Nexus staging area
b) Build and Deploy your website to a staging area for review
which is what I want, however I do not want to switch completely from
Travis CI to buildbot.
So my next question is, can we achieve a) and b) with buildbot while
keeping Travis for everything else?
[1] https://ci.apache.org/buildbot.html
>
> 1. https://github.com/apache/incubator-dubbo/pull/3452
> 2. https://github.com/apache/incubator-dubbo/pull/3452/files#diff-354f30a63fb0907d4ad57269548329e3R26
> 3. https://docs.travis-ci.com/user/encryption-keys/
>
> Jun
>
> > On Jan 15, 2019, at 2:35 PM, Huxing Zhang <hu...@apache.org> wrote:
> >
> > Hi All,
> >
> > I am trying to achieve continuous deployment for Dubbo, specifically speaking:
> >
> > - deploy snapshot to maven repository upon successful build for each commit
> > - deploy dubbo-ops as a preview upon successful build for each commit
> > - build & deploy dubbo-website for each commit
> >
> > I am looking for following:
> > - ASF official tools like Jenkins and Buildbot
> > - 3rd party tools like Travis CI
> > - GitHub Actions (currently in limited public beta)
> >
> > I am trying to investigate and compare them in next few days.
> > Feel free to provide advices.
> >
> > --
> > Best Regards！
> > Huxing
>
--
Best Regards！
Huxing
Re: Re: Continuous deployment for Dubbo
Posted by Huxing Zhang <hu...@apache.org>.
Hi,
On Fri, May 24, 2019 at 8:33 PM <ke...@163.com> wrote:
>
> Hi
>
> > - build & deploy dubbo-website for each commit
>
> As I know, travis-ci already support this
Yes, but travis-ci is a third-party tool, it does not have write
permission to dubbo-website, so it may not be able to used for Apache
project.
> 在 2019-05-24 11:23:47，"Huxing Zhang" <hu...@apache.org> 写道：
> Hi
>
> On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org> wrote:
> >
> > Hi all,
> >
> > Do we have any update for this one?
>
> Not yet.
>
> Can Jenkins support the following scenarios?
>
> - deploy snapshot to maven repository upon successful build for each commit
> - deploy dubbo-ops as a preview upon successful build for each commit
> - build & deploy dubbo-website for each commit
>
> If so I am +1 on it.
>
>
> --
> Best Regards！
> Huxing
--
Best Regards！
Huxing
Re:Re: Continuous deployment for Dubbo
Posted by ke...@163.com.
Hi
> - build & deploy dubbo-website for each commit
As I know, travis-ci already support this
在 2019-05-24 11:23:47，"Huxing Zhang" <hu...@apache.org> 写道：
Hi
On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org> wrote:
>
> Hi all,
>
> Do we have any update for this one?
Not yet.
Can Jenkins support the following scenarios?
- deploy snapshot to maven repository upon successful build for each commit
- deploy dubbo-ops as a preview upon successful build for each commit
- build & deploy dubbo-website for each commit
If so I am +1 on it.
--
Best Regards！
Huxing
Re: Continuous deployment for Dubbo
Posted by YunKun Huang <hy...@apache.org>.
Yeah, it can send email when build fail.
I try in jenkins[1] looks like it can easily deploy snapshot to apache snapshot repo.
This job will run every 6 hours and check current commit status (which means travis CI build status). I also open a new PR[2] to add a snapshot version check via maven plugin to make sure we only run `mvn deploy` for snapshot version.
[1]:https://builds.apache.org/job/Apache%20Dubbo/job/apache-dubbo-snapshot-deployment/
[2]:https://github.com/apache/incubator-dubbo/pull/4157
On 2019/05/24 09:49:07, Huxing Zhang <hu...@apache.org> wrote:
> Hi,
>
> On Fri, May 24, 2019 at 3:59 PM YunKun Huang <hy...@apache.org> wrote:
> >
> > Thanks. I checked it and I have access to create jenkins job now.
> >
> > And for maillist, I have subscribed them according to document.
>
> Can failed job be sent to dev@ list?
>
> >
> > On 2019/05/24 07:13:44, Ian Luo <ia...@gmail.com> wrote:
> > > YunKun,
> > >
> > > I've added you into hudson-jobadmin group. Pls. proceed. As the doc
> > > instructs, You must subscribe to users@infra and builds@ to receive
> > > notifications of Jenkins upgrades, outages, etc.
> > >
> > > Thanks,
> > > -Ian.
> > >
> > >
> > > On Fri, May 24, 2019 at 11:40 AM YunKun Huang <hy...@apache.org> wrote:
> > >
> > > > To be honest, I'm not sure if it can support all of those scenarios.
> > > >
> > > > But I'm happy to help on this to investigate and try what can we achieve
> > > > via jenkins.
> > > >
> > > > According to this WIKI[1], in order to get access to jenkins, user should
> > > > be a member of the hudson-jobadmin group, and PMC chair should able to
> > > > change this.
> > > >
> > > > @Ian Luo, could you have a look at this wiki when you get time and give me
> > > > access so I can start investigate this stuff?
> > > >
> > > > [1] https://cwiki.apache.org/confluence/display/INFRA/Jenkins
> > > >
> > > > On 2019/05/24 03:23:47, Huxing Zhang <hu...@apache.org> wrote:
> > > > > Hi
> > > > >
> > > > > On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > Do we have any update for this one?
> > > > >
> > > > > Not yet.
> > > > >
> > > > > Can Jenkins support the following scenarios?
> > > > >
> > > > > - deploy snapshot to maven repository upon successful build for each
> > > > commit
> > > > > - deploy dubbo-ops as a preview upon successful build for each commit
> > > > > - build & deploy dubbo-website for each commit
> > > > >
> > > > > If so I am +1 on it.
> > > > >
> > > > >
> > > > > --
> > > > > Best Regards！
> > > > > Huxing
> > > > >
> > > >
> > >
>
>
>
> --
> Best Regards！
> Huxing
>
Re: Continuous deployment for Dubbo
Posted by Huxing Zhang <hu...@apache.org>.
Hi,
On Fri, May 24, 2019 at 3:59 PM YunKun Huang <hy...@apache.org> wrote:
>
> Thanks. I checked it and I have access to create jenkins job now.
>
> And for maillist, I have subscribed them according to document.
Can failed job be sent to dev@ list?
>
> On 2019/05/24 07:13:44, Ian Luo <ia...@gmail.com> wrote:
> > YunKun,
> >
> > I've added you into hudson-jobadmin group. Pls. proceed. As the doc
> > instructs, You must subscribe to users@infra and builds@ to receive
> > notifications of Jenkins upgrades, outages, etc.
> >
> > Thanks,
> > -Ian.
> >
> >
> > On Fri, May 24, 2019 at 11:40 AM YunKun Huang <hy...@apache.org> wrote:
> >
> > > To be honest, I'm not sure if it can support all of those scenarios.
> > >
> > > But I'm happy to help on this to investigate and try what can we achieve
> > > via jenkins.
> > >
> > > According to this WIKI[1], in order to get access to jenkins, user should
> > > be a member of the hudson-jobadmin group, and PMC chair should able to
> > > change this.
> > >
> > > @Ian Luo, could you have a look at this wiki when you get time and give me
> > > access so I can start investigate this stuff?
> > >
> > > [1] https://cwiki.apache.org/confluence/display/INFRA/Jenkins
> > >
> > > On 2019/05/24 03:23:47, Huxing Zhang <hu...@apache.org> wrote:
> > > > Hi
> > > >
> > > > On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org>
> > > wrote:
> > > > >
> > > > > Hi all,
> > > > >
> > > > > Do we have any update for this one?
> > > >
> > > > Not yet.
> > > >
> > > > Can Jenkins support the following scenarios?
> > > >
> > > > - deploy snapshot to maven repository upon successful build for each
> > > commit
> > > > - deploy dubbo-ops as a preview upon successful build for each commit
> > > > - build & deploy dubbo-website for each commit
> > > >
> > > > If so I am +1 on it.
> > > >
> > > >
> > > > --
> > > > Best Regards！
> > > > Huxing
> > > >
> > >
> >
--
Best Regards！
Huxing
Re: Continuous deployment for Dubbo
Posted by YunKun Huang <hy...@apache.org>.
Thanks. I checked it and I have access to create jenkins job now.
And for maillist, I have subscribed them according to document.
On 2019/05/24 07:13:44, Ian Luo <ia...@gmail.com> wrote:
> YunKun,
>
> I've added you into hudson-jobadmin group. Pls. proceed. As the doc
> instructs, You must subscribe to users@infra and builds@ to receive
> notifications of Jenkins upgrades, outages, etc.
>
> Thanks,
> -Ian.
>
>
> On Fri, May 24, 2019 at 11:40 AM YunKun Huang <hy...@apache.org> wrote:
>
> > To be honest, I'm not sure if it can support all of those scenarios.
> >
> > But I'm happy to help on this to investigate and try what can we achieve
> > via jenkins.
> >
> > According to this WIKI[1], in order to get access to jenkins, user should
> > be a member of the hudson-jobadmin group, and PMC chair should able to
> > change this.
> >
> > @Ian Luo, could you have a look at this wiki when you get time and give me
> > access so I can start investigate this stuff?
> >
> > [1] https://cwiki.apache.org/confluence/display/INFRA/Jenkins
> >
> > On 2019/05/24 03:23:47, Huxing Zhang <hu...@apache.org> wrote:
> > > Hi
> > >
> > > On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org>
> > wrote:
> > > >
> > > > Hi all,
> > > >
> > > > Do we have any update for this one?
> > >
> > > Not yet.
> > >
> > > Can Jenkins support the following scenarios?
> > >
> > > - deploy snapshot to maven repository upon successful build for each
> > commit
> > > - deploy dubbo-ops as a preview upon successful build for each commit
> > > - build & deploy dubbo-website for each commit
> > >
> > > If so I am +1 on it.
> > >
> > >
> > > --
> > > Best Regards！
> > > Huxing
> > >
> >
>
Re: Continuous deployment for Dubbo
Posted by Ian Luo <ia...@gmail.com>.
YunKun,
I've added you into hudson-jobadmin group. Pls. proceed. As the doc
instructs, You must subscribe to users@infra and builds@ to receive
notifications of Jenkins upgrades, outages, etc.
Thanks,
-Ian.
On Fri, May 24, 2019 at 11:40 AM YunKun Huang <hy...@apache.org> wrote:
> To be honest, I'm not sure if it can support all of those scenarios.
>
> But I'm happy to help on this to investigate and try what can we achieve
> via jenkins.
>
> According to this WIKI[1], in order to get access to jenkins, user should
> be a member of the hudson-jobadmin group, and PMC chair should able to
> change this.
>
> @Ian Luo, could you have a look at this wiki when you get time and give me
> access so I can start investigate this stuff?
>
> [1] https://cwiki.apache.org/confluence/display/INFRA/Jenkins
>
> On 2019/05/24 03:23:47, Huxing Zhang <hu...@apache.org> wrote:
> > Hi
> >
> > On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org>
> wrote:
> > >
> > > Hi all,
> > >
> > > Do we have any update for this one?
> >
> > Not yet.
> >
> > Can Jenkins support the following scenarios?
> >
> > - deploy snapshot to maven repository upon successful build for each
> commit
> > - deploy dubbo-ops as a preview upon successful build for each commit
> > - build & deploy dubbo-website for each commit
> >
> > If so I am +1 on it.
> >
> >
> > --
> > Best Regards！
> > Huxing
> >
>
Re: Continuous deployment for Dubbo
Posted by YunKun Huang <hy...@apache.org>.
To be honest, I'm not sure if it can support all of those scenarios.
But I'm happy to help on this to investigate and try what can we achieve via jenkins.
According to this WIKI[1], in order to get access to jenkins, user should be a member of the hudson-jobadmin group, and PMC chair should able to change this.
@Ian Luo, could you have a look at this wiki when you get time and give me access so I can start investigate this stuff?
[1] https://cwiki.apache.org/confluence/display/INFRA/Jenkins
On 2019/05/24 03:23:47, Huxing Zhang <hu...@apache.org> wrote:
> Hi
>
> On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org> wrote:
> >
> > Hi all,
> >
> > Do we have any update for this one?
>
> Not yet.
>
> Can Jenkins support the following scenarios?
>
> - deploy snapshot to maven repository upon successful build for each commit
> - deploy dubbo-ops as a preview upon successful build for each commit
> - build & deploy dubbo-website for each commit
>
> If so I am +1 on it.
>
>
> --
> Best Regards！
> Huxing
>
Re: Continuous deployment for Dubbo
Posted by Huxing Zhang <hu...@apache.org>.
Hi
On Fri, May 24, 2019 at 10:25 AM YunKun Huang <hy...@apache.org> wrote:
>
> Hi all,
>
> Do we have any update for this one?
Not yet.
Can Jenkins support the following scenarios?
- deploy snapshot to maven repository upon successful build for each commit
- deploy dubbo-ops as a preview upon successful build for each commit
- build & deploy dubbo-website for each commit
If so I am +1 on it.
--
Best Regards！
Huxing
Re: Continuous deployment for Dubbo
Posted by YunKun Huang <hy...@apache.org>.
Hi all,
Do we have any update for this one?
I guess now we are still upload snapshot version to apache snapshot repo by manual?
For me, jenkins is more easy to use, and I also find some snapshot deployment job in jenkins[1], maybe we can do same thing?
[1] https://builds.apache.org/job/flink-snapshot-deployment-1.6/
On 2019/02/15 10:43:32, sebb <se...@gmail.com> wrote:
> On Fri, 15 Feb 2019 at 08:11, Huxing Zhang <hu...@apache.org> wrote:
> >
> > Hi,
> >
> > CCing builds@apache.org
> >
> > On Fri, Feb 15, 2019 at 11:16 AM jun liu <ke...@gmail.com> wrote:
> > >
> > > Hi,
> > >
> > > I’ve figure out the integration with Travis. With this PR[1] travis can automatically deploy SNAPSHOT artifacts to the apache maven repository.
> > >
> > > But there’s one potential security issue to be aware.
> > > To make sure the deployment process get the proper right, I have to give my Apache ID to Travis. It’s guaranteed by Travis that the raw username/password will be safely kept in Travis and the public will only see the encrypted codes[2]. Travis Ci uses asymmetric cryptography[3] to achieve that, which I personally think is pretty safe and trustable. Even though I think it’s still an issue worth discussing, especially considering there maybe have some ASF policies denying this action (providing Apache ID to a trusted third party platform) but I do not aware of.
> >
> > I am leaning towards do not expose a personal Apache credentials to
> > third parties unless we know it is safe to do so.
>
> As far as I know, you must never store your ASF credentials on a
> system you do not own/control.
>
> But feel free to check with Infra.
>
> > And I do think there is a recommended way in order to deploy snapshot
> > to maven repository upon successful build for each commit.
>
> Yes, Jenkins can deploy snapshots on successful build. It uses its own
> credentials to do so.
>
> > Just want to confirm with builds@apache.org, is this safe to do so?
> >
> > I just checked [1] it clearly states it can
> > a) Automatically Build and Deploy Snapshots to Nexus staging area
> > b) Build and Deploy your website to a staging area for review
> >
> > which is what I want, however I do not want to switch completely from
> > Travis CI to buildbot.
> > So my next question is, can we achieve a) and b) with buildbot while
> > keeping Travis for everything else?
> >
> > [1] https://ci.apache.org/buildbot.html
> >
> >
> > >
> > > 1. https://github.com/apache/incubator-dubbo/pull/3452
> > > 2. https://github.com/apache/incubator-dubbo/pull/3452/files#diff-354f30a63fb0907d4ad57269548329e3R26
> > > 3. https://docs.travis-ci.com/user/encryption-keys/
> > >
> > > Jun
> > >
> > > > On Jan 15, 2019, at 2:35 PM, Huxing Zhang <hu...@apache.org> wrote:
> > > >
> > > > Hi All,
> > > >
> > > > I am trying to achieve continuous deployment for Dubbo, specifically speaking:
> > > >
> > > > - deploy snapshot to maven repository upon successful build for each commit
> > > > - deploy dubbo-ops as a preview upon successful build for each commit
> > > > - build & deploy dubbo-website for each commit
> > > >
> > > > I am looking for following:
> > > > - ASF official tools like Jenkins and Buildbot
> > > > - 3rd party tools like Travis CI
> > > > - GitHub Actions (currently in limited public beta)
> > > >
> > > > I am trying to investigate and compare them in next few days.
> > > > Feel free to provide advices.
> > > >
> > > > --
> > > > Best Regards！
> > > > Huxing
> > >
> >
> >
> > --
> > Best Regards！
> >
> > Huxing
>
Re: Continuous deployment for Dubbo
Posted by sebb <se...@gmail.com>.
On Fri, 15 Feb 2019 at 08:11, Huxing Zhang <hu...@apache.org> wrote:
>
> Hi,
>
> CCing builds@apache.org
>
> On Fri, Feb 15, 2019 at 11:16 AM jun liu <ke...@gmail.com> wrote:
> >
> > Hi,
> >
> > I’ve figure out the integration with Travis. With this PR[1] travis can automatically deploy SNAPSHOT artifacts to the apache maven repository.
> >
> > But there’s one potential security issue to be aware.
> > To make sure the deployment process get the proper right, I have to give my Apache ID to Travis. It’s guaranteed by Travis that the raw username/password will be safely kept in Travis and the public will only see the encrypted codes[2]. Travis Ci uses asymmetric cryptography[3] to achieve that, which I personally think is pretty safe and trustable. Even though I think it’s still an issue worth discussing, especially considering there maybe have some ASF policies denying this action (providing Apache ID to a trusted third party platform) but I do not aware of.
>
> I am leaning towards do not expose a personal Apache credentials to
> third parties unless we know it is safe to do so.
As far as I know, you must never store your ASF credentials on a
system you do not own/control.
But feel free to check with Infra.
> And I do think there is a recommended way in order to deploy snapshot
> to maven repository upon successful build for each commit.
Yes, Jenkins can deploy snapshots on successful build. It uses its own
credentials to do so.
> Just want to confirm with builds@apache.org, is this safe to do so?
>
> I just checked [1] it clearly states it can
> a) Automatically Build and Deploy Snapshots to Nexus staging area
> b) Build and Deploy your website to a staging area for review
>
> which is what I want, however I do not want to switch completely from
> Travis CI to buildbot.
> So my next question is, can we achieve a) and b) with buildbot while
> keeping Travis for everything else?
>
> [1] https://ci.apache.org/buildbot.html
>
>
> >
> > 1. https://github.com/apache/incubator-dubbo/pull/3452
> > 2. https://github.com/apache/incubator-dubbo/pull/3452/files#diff-354f30a63fb0907d4ad57269548329e3R26
> > 3. https://docs.travis-ci.com/user/encryption-keys/
> >
> > Jun
> >
> > > On Jan 15, 2019, at 2:35 PM, Huxing Zhang <hu...@apache.org> wrote:
> > >
> > > Hi All,
> > >
> > > I am trying to achieve continuous deployment for Dubbo, specifically speaking:
> > >
> > > - deploy snapshot to maven repository upon successful build for each commit
> > > - deploy dubbo-ops as a preview upon successful build for each commit
> > > - build & deploy dubbo-website for each commit
> > >
> > > I am looking for following:
> > > - ASF official tools like Jenkins and Buildbot
> > > - 3rd party tools like Travis CI
> > > - GitHub Actions (currently in limited public beta)
> > >
> > > I am trying to investigate and compare them in next few days.
> > > Feel free to provide advices.
> > >
> > > --
> > > Best Regards！
> > > Huxing
> >
>
>
> --
> Best Regards！
>
> Huxing
Re: Continuous deployment for Dubbo
Posted by sebb <se...@gmail.com>.
On Fri, 15 Feb 2019 at 08:11, Huxing Zhang <hu...@apache.org> wrote:
>
> Hi,
>
> CCing builds@apache.org
>
> On Fri, Feb 15, 2019 at 11:16 AM jun liu <ke...@gmail.com> wrote:
> >
> > Hi,
> >
> > I’ve figure out the integration with Travis. With this PR[1] travis can automatically deploy SNAPSHOT artifacts to the apache maven repository.
> >
> > But there’s one potential security issue to be aware.
> > To make sure the deployment process get the proper right, I have to give my Apache ID to Travis. It’s guaranteed by Travis that the raw username/password will be safely kept in Travis and the public will only see the encrypted codes[2]. Travis Ci uses asymmetric cryptography[3] to achieve that, which I personally think is pretty safe and trustable. Even though I think it’s still an issue worth discussing, especially considering there maybe have some ASF policies denying this action (providing Apache ID to a trusted third party platform) but I do not aware of.
>
> I am leaning towards do not expose a personal Apache credentials to
> third parties unless we know it is safe to do so.
As far as I know, you must never store your ASF credentials on a
system you do not own/control.
But feel free to check with Infra.
> And I do think there is a recommended way in order to deploy snapshot
> to maven repository upon successful build for each commit.
Yes, Jenkins can deploy snapshots on successful build. It uses its own
credentials to do so.
> Just want to confirm with builds@apache.org, is this safe to do so?
>
> I just checked [1] it clearly states it can
> a) Automatically Build and Deploy Snapshots to Nexus staging area
> b) Build and Deploy your website to a staging area for review
>
> which is what I want, however I do not want to switch completely from
> Travis CI to buildbot.
> So my next question is, can we achieve a) and b) with buildbot while
> keeping Travis for everything else?
>
> [1] https://ci.apache.org/buildbot.html
>
>
> >
> > 1. https://github.com/apache/incubator-dubbo/pull/3452
> > 2. https://github.com/apache/incubator-dubbo/pull/3452/files#diff-354f30a63fb0907d4ad57269548329e3R26
> > 3. https://docs.travis-ci.com/user/encryption-keys/
> >
> > Jun
> >
> > > On Jan 15, 2019, at 2:35 PM, Huxing Zhang <hu...@apache.org> wrote:
> > >
> > > Hi All,
> > >
> > > I am trying to achieve continuous deployment for Dubbo, specifically speaking:
> > >
> > > - deploy snapshot to maven repository upon successful build for each commit
> > > - deploy dubbo-ops as a preview upon successful build for each commit
> > > - build & deploy dubbo-website for each commit
> > >
> > > I am looking for following:
> > > - ASF official tools like Jenkins and Buildbot
> > > - 3rd party tools like Travis CI
> > > - GitHub Actions (currently in limited public beta)
> > >
> > > I am trying to investigate and compare them in next few days.
> > > Feel free to provide advices.
> > >
> > > --
> > > Best Regards！
> > > Huxing
> >
>
>
> --
> Best Regards！
>
> Huxing