You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudberry.apache.org by Dianjin Wang <wa...@gmail.com> on 2025/04/15 05:16:00 UTC
[DISCUSS] Setting up CI/CD workflows for other Cloudberry repos
Hi all,
I’d like to start a discussion about setting up basic CI/CD workflows
for the other Cloudberry repos under the Apache GitHub organization —
including cloudberry-pxf, cloudberry-gpbackup-s3-plugin,
cloudberry-go-libs, and cloudberry-gpbackup.
These repos are currently 1–2 years behind their corresponding
Greenplum archived projects, and we’ll need to cherry-pick a number of
commits to bring them up to date. Before diving into that work, it
would be helpful to have CI/CD in place to ensure we can easily verify
changes along the way.
While this is not a strict requirement for the Cloudberry 2.0 release,
it would be great to kick off this effort soon so that users can more
easily adopt these components as part of their Cloudberry 2.0
deployments.
Let me know what you think, and feel free to share your feedback.
Best,
Dianjin Wang
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [DISCUSS] Setting up CI/CD workflows for other Cloudberry repos
Posted by Dianjin Wang <wa...@gmail.com>.
Would like to add more notes for reference:
- @ostinru is working on the ci workflows for pxf [1]
- cloudberry-gpbackup has one but needs to be fixed to make it work [2]
And, for the non-official cloudberry-contrib projects, there is a need
to add the CICD workflow supports to the ecosystem projects too.
[1] https://github.com/apache/cloudberry-pxf/pull/6
[2] https://github.com/apache/cloudberry-gpbackup
Best,
Dianjin Wang
On Tue, Apr 15, 2025 at 1:24 PM Lirong Jian <ji...@gmail.com> wrote:
>
> Yes, I think this is very necessary. Thank you very much for bringing up
> this issue.
>
> Best,
> Lirong
>
>
>
> Dianjin Wang <wa...@gmail.com> 于2025年4月15日周二 13:17写道:
>
> > Hi all,
> >
> > I’d like to start a discussion about setting up basic CI/CD workflows
> > for the other Cloudberry repos under the Apache GitHub organization —
> > including cloudberry-pxf, cloudberry-gpbackup-s3-plugin,
> > cloudberry-go-libs, and cloudberry-gpbackup.
> >
> > These repos are currently 1–2 years behind their corresponding
> > Greenplum archived projects, and we’ll need to cherry-pick a number of
> > commits to bring them up to date. Before diving into that work, it
> > would be helpful to have CI/CD in place to ensure we can easily verify
> > changes along the way.
> >
> > While this is not a strict requirement for the Cloudberry 2.0 release,
> > it would be great to kick off this effort soon so that users can more
> > easily adopt these components as part of their Cloudberry 2.0
> > deployments.
> >
> > Let me know what you think, and feel free to share your feedback.
> >
> > Best,
> > Dianjin Wang
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
> > For additional commands, e-mail: dev-help@cloudberry.apache.org
> >
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: dev-help@cloudberry.apache.org
Re: [DISCUSS] Setting up CI/CD workflows for other Cloudberry repos
Posted by Lirong Jian <ji...@gmail.com>.
Yes, I think this is very necessary. Thank you very much for bringing up
this issue.
Best,
Lirong
Dianjin Wang <wa...@gmail.com> 于2025年4月15日周二 13:17写道:
> Hi all,
>
> I’d like to start a discussion about setting up basic CI/CD workflows
> for the other Cloudberry repos under the Apache GitHub organization —
> including cloudberry-pxf, cloudberry-gpbackup-s3-plugin,
> cloudberry-go-libs, and cloudberry-gpbackup.
>
> These repos are currently 1–2 years behind their corresponding
> Greenplum archived projects, and we’ll need to cherry-pick a number of
> commits to bring them up to date. Before diving into that work, it
> would be helpful to have CI/CD in place to ensure we can easily verify
> changes along the way.
>
> While this is not a strict requirement for the Cloudberry 2.0 release,
> it would be great to kick off this effort soon so that users can more
> easily adopt these components as part of their Cloudberry 2.0
> deployments.
>
> Let me know what you think, and feel free to share your feedback.
>
> Best,
> Dianjin Wang
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
> For additional commands, e-mail: dev-help@cloudberry.apache.org
>
>
Re: [DISCUSS] Setting up CI/CD workflows for other Cloudberry repos
Posted by Max Yang <ma...@gmail.com>.
Good to know if we can enable performance testing.
On Tue, Apr 15, 2025 at 10:02 PM Jianghua Yang <yj...@apache.org> wrote:
> One suggestion is to add a CI pipeline for performance regression testing.
>
> Max Yang <ma...@gmail.com> 于2025年4月14日周一 23:21写道:
>
> > +1
> >
> > On Tue, Apr 15, 2025 at 1:16 PM Dianjin Wang <wa...@gmail.com>
> > wrote:
> >
> > > Hi all,
> > >
> > > I’d like to start a discussion about setting up basic CI/CD workflows
> > > for the other Cloudberry repos under the Apache GitHub organization —
> > > including cloudberry-pxf, cloudberry-gpbackup-s3-plugin,
> > > cloudberry-go-libs, and cloudberry-gpbackup.
> > >
> > > These repos are currently 1–2 years behind their corresponding
> > > Greenplum archived projects, and we’ll need to cherry-pick a number of
> > > commits to bring them up to date. Before diving into that work, it
> > > would be helpful to have CI/CD in place to ensure we can easily verify
> > > changes along the way.
> > >
> > > While this is not a strict requirement for the Cloudberry 2.0 release,
> > > it would be great to kick off this effort soon so that users can more
> > > easily adopt these components as part of their Cloudberry 2.0
> > > deployments.
> > >
> > > Let me know what you think, and feel free to share your feedback.
> > >
> > > Best,
> > > Dianjin Wang
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
> > > For additional commands, e-mail: dev-help@cloudberry.apache.org
> > >
> > >
> >
>
Re: [DISCUSS] Setting up CI/CD workflows for other Cloudberry repos
Posted by Jianghua Yang <yj...@apache.org>.
One suggestion is to add a CI pipeline for performance regression testing.
Max Yang <ma...@gmail.com> 于2025年4月14日周一 23:21写道:
> +1
>
> On Tue, Apr 15, 2025 at 1:16 PM Dianjin Wang <wa...@gmail.com>
> wrote:
>
> > Hi all,
> >
> > I’d like to start a discussion about setting up basic CI/CD workflows
> > for the other Cloudberry repos under the Apache GitHub organization —
> > including cloudberry-pxf, cloudberry-gpbackup-s3-plugin,
> > cloudberry-go-libs, and cloudberry-gpbackup.
> >
> > These repos are currently 1–2 years behind their corresponding
> > Greenplum archived projects, and we’ll need to cherry-pick a number of
> > commits to bring them up to date. Before diving into that work, it
> > would be helpful to have CI/CD in place to ensure we can easily verify
> > changes along the way.
> >
> > While this is not a strict requirement for the Cloudberry 2.0 release,
> > it would be great to kick off this effort soon so that users can more
> > easily adopt these components as part of their Cloudberry 2.0
> > deployments.
> >
> > Let me know what you think, and feel free to share your feedback.
> >
> > Best,
> > Dianjin Wang
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
> > For additional commands, e-mail: dev-help@cloudberry.apache.org
> >
> >
>
Re: [DISCUSS] Setting up CI/CD workflows for other Cloudberry repos
Posted by Max Yang <ma...@gmail.com>.
+1
On Tue, Apr 15, 2025 at 1:16 PM Dianjin Wang <wa...@gmail.com> wrote:
> Hi all,
>
> I’d like to start a discussion about setting up basic CI/CD workflows
> for the other Cloudberry repos under the Apache GitHub organization —
> including cloudberry-pxf, cloudberry-gpbackup-s3-plugin,
> cloudberry-go-libs, and cloudberry-gpbackup.
>
> These repos are currently 1–2 years behind their corresponding
> Greenplum archived projects, and we’ll need to cherry-pick a number of
> commits to bring them up to date. Before diving into that work, it
> would be helpful to have CI/CD in place to ensure we can easily verify
> changes along the way.
>
> While this is not a strict requirement for the Cloudberry 2.0 release,
> it would be great to kick off this effort soon so that users can more
> easily adopt these components as part of their Cloudberry 2.0
> deployments.
>
> Let me know what you think, and feel free to share your feedback.
>
> Best,
> Dianjin Wang
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@cloudberry.apache.org
> For additional commands, e-mail: dev-help@cloudberry.apache.org
>
>