You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudberry.apache.org by Ed Espino <es...@apache.org> on 2024/11/15 09:22:53 UTC
Re: [DISCUSS] Apache Cloudberry CI Implementation Update
Hi Cloudberry Dev Team,
I wanted to share a progress update on our CI implementation efforts.
We have successfully implemented the creation of Apache Cloudberry
(incubating) Docker containers for both building and testing on:
- Rocky Linux 8
- Rocky Linux 9
These containers are now being automatically created via GitHub workflows.
You can view:
- Workflow runs and artifacts:
https://github.com/apache/cloudberry-devops-release/actions
- DockerHub Published containers:
https://hub.docker.com/r/apache/incubator-cloudberry
These containers will serve as the foundation for our subsequent CI
implementation phases that we discussed in the previous emails.
Best regards,
-=e
--
Ed Espino
Apache Cloudberry (incubating) & MADlib
Re: [DISCUSS] Apache Cloudberry CI Implementation Update
Posted by Ed Espino <es...@apache.org>.
Dianjin,
I will try to build the ARM containers tonight. Stay tuned.
-=e
On Sun, Dec 8, 2024 at 7:07 PM Dianjin Wang <wa...@gmail.com> wrote:
> Hi Ed,
>
> I encountered an issue while running the Docker test/build image on my Mac
> M1. It indicates that the Docker image does not support Linux/arm64/v8.
>
> ```
> $ sudo docker run -it -h cdw --rm
> apache/incubator-cloudberry:cbdb-test-rocky9-latest
>
> Unable to find image 'apache/incubator-cloudberry:cbdb-test-rocky9-latest'
> locally
> cbdb-test-rocky9-latest: Pulling from apache/incubator-cloudberry
> docker: no matching manifest for linux/arm64/v8 in the manifest list
> entries.
> ```
>
> I searched and I can add `--platfrom linux/amd64` to support running on my
> Macbook:
> ```
> $ sudo docker run -it -h cdw --platform linux/amd64 --rm
> apache/incubator-cloudberry:cbdb-test-rocky9-latest
> ```
>
> It would be great to have support for arm64 by default! This change could
> make it much easier for folks, especially those with limited Docker
> experience like me, to use the Docker image. Thanks for considering it!
>
> Best,
> Dianjin Wang
>
>
> On Fri, Nov 15, 2024 at 5:23 PM Ed Espino <es...@apache.org> wrote:
>
> > Hi Cloudberry Dev Team,
> >
> > I wanted to share a progress update on our CI implementation efforts.
> >
> > We have successfully implemented the creation of Apache Cloudberry
> > (incubating) Docker containers for both building and testing on:
> >
> > - Rocky Linux 8
> > - Rocky Linux 9
> >
> > These containers are now being automatically created via GitHub
> workflows.
> > You can view:
> >
> > - Workflow runs and artifacts:
> > https://github.com/apache/cloudberry-devops-release/actions
> > - DockerHub Published containers:
> > https://hub.docker.com/r/apache/incubator-cloudberry
> >
> > These containers will serve as the foundation for our subsequent CI
> > implementation phases that we discussed in the previous emails.
> >
> > Best regards,
> > -=e
> > --
> > Ed Espino
> > Apache Cloudberry (incubating) & MADlib
> >
>
--
Ed Espino
Apache Cloudberry (incubating) & MADlib
Re: [DISCUSS] Apache Cloudberry CI Implementation Update
Posted by Dianjin Wang <wa...@gmail.com>.
Run the test image successfully on my Macbook.
Approved. Thanks!
Best,
Dianjin Wang
On Mon, Dec 9, 2024 at 10:52 PM Dianjin Wang <wa...@gmail.com> wrote:
> Thanks so much, Ed! I really appreciate it. I'll take a look later.
> If anyone else is available to help with the technical review, that would
> be better, thanks in advance.
>
> On Monday, December 9, 2024, Ed Espino <es...@apache.org> wrote:
>
>> Dianjin,
>>
>> I have a PR (https://github.com/apache/cloudberry-devops-release/pull/8)
>> that addresses this issue. If you could review and possibly approve, we
>> will have arm64 containers for Rocky 8 & 9.
>>
>> -=e
>>
>> On Sun, Dec 8, 2024 at 7:07 PM Dianjin Wang <wa...@gmail.com>
>> wrote:
>>
>> > Hi Ed,
>> >
>> > I encountered an issue while running the Docker test/build image on my
>> Mac
>> > M1. It indicates that the Docker image does not support Linux/arm64/v8.
>> >
>> > ```
>> > $ sudo docker run -it -h cdw --rm
>> > apache/incubator-cloudberry:cbdb-test-rocky9-latest
>> >
>> > Unable to find image
>> 'apache/incubator-cloudberry:cbdb-test-rocky9-latest'
>> > locally
>> > cbdb-test-rocky9-latest: Pulling from apache/incubator-cloudberry
>> > docker: no matching manifest for linux/arm64/v8 in the manifest list
>> > entries.
>> > ```
>> >
>> > I searched and I can add `--platfrom linux/amd64` to support running on
>> my
>> > Macbook:
>> > ```
>> > $ sudo docker run -it -h cdw --platform linux/amd64 --rm
>> > apache/incubator-cloudberry:cbdb-test-rocky9-latest
>> > ```
>> >
>> > It would be great to have support for arm64 by default! This change
>> could
>> > make it much easier for folks, especially those with limited Docker
>> > experience like me, to use the Docker image. Thanks for considering it!
>> >
>> > Best,
>> > Dianjin Wang
>> >
>> >
>> > On Fri, Nov 15, 2024 at 5:23 PM Ed Espino <es...@apache.org> wrote:
>> >
>> > > Hi Cloudberry Dev Team,
>> > >
>> > > I wanted to share a progress update on our CI implementation efforts.
>> > >
>> > > We have successfully implemented the creation of Apache Cloudberry
>> > > (incubating) Docker containers for both building and testing on:
>> > >
>> > > - Rocky Linux 8
>> > > - Rocky Linux 9
>> > >
>> > > These containers are now being automatically created via GitHub
>> > workflows.
>> > > You can view:
>> > >
>> > > - Workflow runs and artifacts:
>> > > https://github.com/apache/cloudberry-devops-release/actions
>> > > - DockerHub Published containers:
>> > > https://hub.docker.com/r/apache/incubator-cloudberry
>> > >
>> > > These containers will serve as the foundation for our subsequent CI
>> > > implementation phases that we discussed in the previous emails.
>> > >
>> > > Best regards,
>> > > -=e
>> > > --
>> > > Ed Espino
>> > > Apache Cloudberry (incubating) & MADlib
>> > >
>> >
>>
>>
>> --
>> Ed Espino
>> Apache Cloudberry (incubating) & MADlib
>>
>
>
> --
>
> Best,
> Dianjin Wang
>
>
Re: [DISCUSS] Apache Cloudberry CI Implementation Update
Posted by Dianjin Wang <wa...@gmail.com>.
Thanks so much, Ed! I really appreciate it. I'll take a look later.
If anyone else is available to help with the technical review, that would
be better, thanks in advance.
On Monday, December 9, 2024, Ed Espino <es...@apache.org> wrote:
> Dianjin,
>
> I have a PR (https://github.com/apache/cloudberry-devops-release/pull/8)
> that addresses this issue. If you could review and possibly approve, we
> will have arm64 containers for Rocky 8 & 9.
>
> -=e
>
> On Sun, Dec 8, 2024 at 7:07 PM Dianjin Wang <wa...@gmail.com> wrote:
>
> > Hi Ed,
> >
> > I encountered an issue while running the Docker test/build image on my
> Mac
> > M1. It indicates that the Docker image does not support Linux/arm64/v8.
> >
> > ```
> > $ sudo docker run -it -h cdw --rm
> > apache/incubator-cloudberry:cbdb-test-rocky9-latest
> >
> > Unable to find image 'apache/incubator-cloudberry:
> cbdb-test-rocky9-latest'
> > locally
> > cbdb-test-rocky9-latest: Pulling from apache/incubator-cloudberry
> > docker: no matching manifest for linux/arm64/v8 in the manifest list
> > entries.
> > ```
> >
> > I searched and I can add `--platfrom linux/amd64` to support running on
> my
> > Macbook:
> > ```
> > $ sudo docker run -it -h cdw --platform linux/amd64 --rm
> > apache/incubator-cloudberry:cbdb-test-rocky9-latest
> > ```
> >
> > It would be great to have support for arm64 by default! This change could
> > make it much easier for folks, especially those with limited Docker
> > experience like me, to use the Docker image. Thanks for considering it!
> >
> > Best,
> > Dianjin Wang
> >
> >
> > On Fri, Nov 15, 2024 at 5:23 PM Ed Espino <es...@apache.org> wrote:
> >
> > > Hi Cloudberry Dev Team,
> > >
> > > I wanted to share a progress update on our CI implementation efforts.
> > >
> > > We have successfully implemented the creation of Apache Cloudberry
> > > (incubating) Docker containers for both building and testing on:
> > >
> > > - Rocky Linux 8
> > > - Rocky Linux 9
> > >
> > > These containers are now being automatically created via GitHub
> > workflows.
> > > You can view:
> > >
> > > - Workflow runs and artifacts:
> > > https://github.com/apache/cloudberry-devops-release/actions
> > > - DockerHub Published containers:
> > > https://hub.docker.com/r/apache/incubator-cloudberry
> > >
> > > These containers will serve as the foundation for our subsequent CI
> > > implementation phases that we discussed in the previous emails.
> > >
> > > Best regards,
> > > -=e
> > > --
> > > Ed Espino
> > > Apache Cloudberry (incubating) & MADlib
> > >
> >
>
>
> --
> Ed Espino
> Apache Cloudberry (incubating) & MADlib
>
--
Best,
Dianjin Wang
Re: [DISCUSS] Apache Cloudberry CI Implementation Update
Posted by Ed Espino <es...@apache.org>.
Dianjin,
I have a PR (https://github.com/apache/cloudberry-devops-release/pull/8)
that addresses this issue. If you could review and possibly approve, we
will have arm64 containers for Rocky 8 & 9.
-=e
On Sun, Dec 8, 2024 at 7:07 PM Dianjin Wang <wa...@gmail.com> wrote:
> Hi Ed,
>
> I encountered an issue while running the Docker test/build image on my Mac
> M1. It indicates that the Docker image does not support Linux/arm64/v8.
>
> ```
> $ sudo docker run -it -h cdw --rm
> apache/incubator-cloudberry:cbdb-test-rocky9-latest
>
> Unable to find image 'apache/incubator-cloudberry:cbdb-test-rocky9-latest'
> locally
> cbdb-test-rocky9-latest: Pulling from apache/incubator-cloudberry
> docker: no matching manifest for linux/arm64/v8 in the manifest list
> entries.
> ```
>
> I searched and I can add `--platfrom linux/amd64` to support running on my
> Macbook:
> ```
> $ sudo docker run -it -h cdw --platform linux/amd64 --rm
> apache/incubator-cloudberry:cbdb-test-rocky9-latest
> ```
>
> It would be great to have support for arm64 by default! This change could
> make it much easier for folks, especially those with limited Docker
> experience like me, to use the Docker image. Thanks for considering it!
>
> Best,
> Dianjin Wang
>
>
> On Fri, Nov 15, 2024 at 5:23 PM Ed Espino <es...@apache.org> wrote:
>
> > Hi Cloudberry Dev Team,
> >
> > I wanted to share a progress update on our CI implementation efforts.
> >
> > We have successfully implemented the creation of Apache Cloudberry
> > (incubating) Docker containers for both building and testing on:
> >
> > - Rocky Linux 8
> > - Rocky Linux 9
> >
> > These containers are now being automatically created via GitHub
> workflows.
> > You can view:
> >
> > - Workflow runs and artifacts:
> > https://github.com/apache/cloudberry-devops-release/actions
> > - DockerHub Published containers:
> > https://hub.docker.com/r/apache/incubator-cloudberry
> >
> > These containers will serve as the foundation for our subsequent CI
> > implementation phases that we discussed in the previous emails.
> >
> > Best regards,
> > -=e
> > --
> > Ed Espino
> > Apache Cloudberry (incubating) & MADlib
> >
>
--
Ed Espino
Apache Cloudberry (incubating) & MADlib
Re: [DISCUSS] Apache Cloudberry CI Implementation Update
Posted by Dianjin Wang <wa...@gmail.com>.
Hi Ed,
I encountered an issue while running the Docker test/build image on my Mac
M1. It indicates that the Docker image does not support Linux/arm64/v8.
```
$ sudo docker run -it -h cdw --rm
apache/incubator-cloudberry:cbdb-test-rocky9-latest
Unable to find image 'apache/incubator-cloudberry:cbdb-test-rocky9-latest'
locally
cbdb-test-rocky9-latest: Pulling from apache/incubator-cloudberry
docker: no matching manifest for linux/arm64/v8 in the manifest list
entries.
```
I searched and I can add `--platfrom linux/amd64` to support running on my
Macbook:
```
$ sudo docker run -it -h cdw --platform linux/amd64 --rm
apache/incubator-cloudberry:cbdb-test-rocky9-latest
```
It would be great to have support for arm64 by default! This change could
make it much easier for folks, especially those with limited Docker
experience like me, to use the Docker image. Thanks for considering it!
Best,
Dianjin Wang
On Fri, Nov 15, 2024 at 5:23 PM Ed Espino <es...@apache.org> wrote:
> Hi Cloudberry Dev Team,
>
> I wanted to share a progress update on our CI implementation efforts.
>
> We have successfully implemented the creation of Apache Cloudberry
> (incubating) Docker containers for both building and testing on:
>
> - Rocky Linux 8
> - Rocky Linux 9
>
> These containers are now being automatically created via GitHub workflows.
> You can view:
>
> - Workflow runs and artifacts:
> https://github.com/apache/cloudberry-devops-release/actions
> - DockerHub Published containers:
> https://hub.docker.com/r/apache/incubator-cloudberry
>
> These containers will serve as the foundation for our subsequent CI
> implementation phases that we discussed in the previous emails.
>
> Best regards,
> -=e
> --
> Ed Espino
> Apache Cloudberry (incubating) & MADlib
>