You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudberry.apache.org by "leborchuk (via GitHub)" <gi...@apache.org> on 2025/03/26 12:47:02 UTC
[PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
leborchuk opened a new pull request, #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13
In these PR I added to workflow building jammy Docker container.
The main peculiarity of the Debian package is that we need to build the binary in a specific directory and then install it in /usr/local/cloudberry-db. This differs from the package creation process for RPM-based distros, where you simply list what you want to package (*.spec) along with absolute paths. For Ubuntu you should list relative local build paths and then write install script to copy it in /usr/local/cloudberry-db.
So, I added the ${BUILD_DESTINATION} path (with defaults to /usr/ local/cloudberry-db) to all build automation scripts. This has made my PR slightly more dangerous, because if something goes wrong (I don't think I have, but it needs to be thoroughly reviewed), all our builds could suffer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022565519
##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
Review Comment:
I build the image by removing these 3 lines, without any negative effects.
We also need to add the following env to make the test happy:
```
ENV USER=gpadmin
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2782956123
> @leborchuk I can provide a list based on how we set up Rocky Linux 9. We can then collaborate on that effort.
@edespino It would be great, I really appreciate your help.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2778237995
> **Missing Cleanup**
>
Fixed, now the main place is occupied by binary files.
Image size:
```
REPOSITORY TAG IMAGE ID CREATED SIZE
cloudberry-db-build-env latest 693ae32596fc 20 minutes ago 1.43GB
```
Total directory sizes in the container:
```
gpadmin@cdw:~$ du -c / | sort -n | tail -10
182160 /usr/lib/jvm/java-11-openjdk-amd64/lib
183140 /usr/lib/jvm/java-11-openjdk-amd64
183148 /usr/lib/jvm
274664 /usr/local/go1.23.4
278432 /usr/lib/x86_64-linux-gnu
364992 /usr/local
705304 /usr/lib
1388800 /usr
1409736 /
1409736 total
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2783898999
I'm done, PR could be reviewed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2983605038
> Thanks @leborchuk for helping push this big feature forward again! Just left some comments, FYI. Will help test earlier this week.
Thanks, fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "ostinru (via GitHub)" <gi...@apache.org>.
ostinru commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2163174130
##########
packaging/deb/ubuntu22.04/debian/postinst:
##########
@@ -0,0 +1,15 @@
+#!/bin/bash
+
+set -e
+
+GPADMIN=gpadmin
+GPHOME=/usr/cloudberry-db
+
+if [ "$1" = configure ]; then
+
+ chown -R ${GPADMIN}:${GPADMIN} ${GPHOME}
Review Comment:
@leborchuk , let's leave file permission as root:root
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768641783
After building and installing Cloudberry in the build image, I run the test for twice with the following command:
```
PGOPTIONS='-c optimizer=on' make installcheck
```
Some errors return:
[regression-diffs.txt](https://github.com/user-attachments/files/19547650/regression-diffs.txt)
```
+20250401:07:07:21:037248 gpconfig:cdw:gpadmin-[ERROR]:-USER environment variable must be set.
+USER environment variable must be set.
```
Should we add the `ENV USER=gpadmin` to the build Dockerfile? FYI. Will test later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2029108185
##########
scripts/build-deb.sh:
##########
@@ -0,0 +1,148 @@
+#!/bin/bash
+#
+# Script Name: build-deb.sh
+#
+# Description:
+# This script automates the process of building an DEB package using a specified
+# version number. It ensures that the necessary tools are installed
+# and that the control file exists before attempting to build the DEB. The script
+# also includes error handling to provide meaningful feedback in case of failure.
+#
+# Usage:
+# ./build-deb.sh [-v <version>] [-h] [--dry-run]
+#
+# Options:
+# -v, --version <version> : Specify the version (required)
+# -h, --help : Display this help and exit
+# -n, --dry-run : Show what would be done, without making any changes
+#
+# Example:
+# ./build-deb.sh -v 1.5.5 # Build with version 1.5.5
+#
+# Prerequisites:
+# - The dpkg-buildpackage package must be installed (provides the dpkg-buildpackage command).
+# - The control file must exist at debian/control.
+#
+# Error Handling:
+# The script includes checks to ensure:
+# - The version option (-v or --version) is provided.
+# - The necessary commands are available.
+# - The control file exists at the specified location.
+# If any of these checks fail, the script exits with an appropriate error message.
+
+# Enable strict mode for better error handling
+set -euo pipefail
+
+# Default values
+VERSION=""
+RELEASE="1"
+DEBUG_BUILD=false
+
+# Function to display usage information
+usage() {
+ echo "Usage: $0 [-v <version>] [-h] [--dry-run]"
+ echo " -v, --version <version> : Specify the version (optional)"
+ echo " -h, --help : Display this help and exit"
Review Comment:
There is no need to generate it manually, everything is done automatically since debhelper >= 9.2 https://wiki.debian.org/AutomaticDebugPackages
We have (my test output) files
```
-rw-r--r-- 1 gpadmin root 12103622 Apr 4 16:15 apache-cloudberry-db-incubating-dbgsym_1.6.0-1-._amd64.ddeb
-rw-r--r-- 1 gpadmin root 1163 Apr 4 16:14 apache-cloudberry-db-incubating_1.6.0-1-..dsc
-rw-r--r-- 1 gpadmin root 62554652 Apr 4 16:14 apache-cloudberry-db-incubating_1.6.0-1-..tar.xz
-rw-r--r-- 1 gpadmin root 12427 Apr 4 16:15 apache-cloudberry-db-incubating_1.6.0-1-._amd64.buildinfo
-rw-r--r-- 1 gpadmin root 2318 Apr 4 16:15 apache-cloudberry-db-incubating_1.6.0-1-._amd64.changes
-rw-r--r-- 1 gpadmin root 13566216 Apr 4 16:15 apache-cloudberry-db-incubating_1.6.0-1-._amd64.deb
```
apache-cloudberry-db-incubating-dbgsym_1.6.0-1-._amd64.ddeb package - with debug symbols
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2785376071
> > I'm done, PR could be reviewed
>
> Cool. I will help test today.
Now I can build and run the building and test image based on Ubuntu 22.04 successfully. I can also build Cloudberry from the source on the build image. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3112500686
Hey @leborchuk, would you like to start planning the migration of this repo to the main one, as discussed here: https://lists.apache.org/thread/p6otyrrnosg8fsbyr6ok7hl8wxpx4ss2? I think it would be better to open a new PR on the main after this repo's migration is complete. Otherwise, it could make the migration more difficult.
How about this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2853683674
> @leborchuk & @tuhaihe
>
> I have made significant progress in getting a smaller Ubuntu 22.04 docker images created (993MB vs. 1.4GB from this PR). I also have small changes to Cloudberry to allow the greenplum_path.sh to function properly. I also have a mechanism to create a .deb which functions similar to the .rpm implementation which creates a single directory (/usr/local/cloudberry-db-2.0.0) with a symbolic link to it (/usr/local/cloduberry-db).
>
> Here are my repositories:
>
> * https://github.com/edespino/cloudberry-devops-release/tree/ubuntu-22.04
> * https://github.com/edespino/cloudberry/tree/ubuntu-22.04
>
> The container that I can build contains the necessary build time dependencies as well as .deb build dependencies.
>
> You will see that the container does not include the building of xerces-c. This is because it is available from standard ubuntu repositories where other build time dependencies are available. On Rocky Linux, xerces-c is only available from epel which for all intents and purposes is an un-trusted repository for reproducible build purposes. This is why for those platforms, it is built from source.
Awesome! Thank you so much, Ed!
I tested it out and successfully logged into the new container using your codebase. I noticed that your code changed a bit with @leborchuk's's PR in some files. I think it would be great if we could merge @leborchuk's’s PR to establish a base Ubuntu image. Then you could rebase your codebase to create a new PR to update and generate a newer Docker image.
Trying to achieve perfection in just one PR might slow down our progress. What do you think about this approach?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2779622231
> @leborchuk If you don't mind me asking, what is your ultimate goal here? I assume you will also be introducing Ubuntu 22.04 into the Apache Cloudberry build and test processes. Is that correct?
Yes, I'd like to add Ubuntu 22.04 into the Apache Cloudberry build and test processes. I want to be able to
- Test if it builds successfully
- Create artifacts (Debian packages/docker files) for releases
- Add a QA workflow to run Installcheckworld by specific tag
Sorry, I see comments you've made but didn't have time to think about them thoroughly. It would be great to split work to pieces. And to describe properly what I really going to do. But it needs some time to understand how it should be done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2795845493
Hi any process on this PR review?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3161437859
Created https://github.com/apache/cloudberry/pull/1292
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2149603840
##########
.github/workflows/docker-cbdb-test-containers.yml:
##########
@@ -144,8 +147,8 @@ jobs:
type=gha,scope=docker-cbdb-test-${{ matrix.platform }}
# Tag with both latest and version-specific tags
tags: |
- apache/incubator-cloudberry:cbdb-test-${{ matrix.platform }}-latest
- apache/incubator-cloudberry:cbdb-test-${{ matrix.platform }}-${{ steps.version.outputs.BUILD_DATE }}-${{ steps.version.outputs.SHA_SHORT }}
+ ghcr.io/${{ github.repository }}:cbdb-test-${{ matrix.platform }}-latest
+ ghcr.io/${{ github.repository }}:cbdb-test-${{ matrix.platform }}-${{ steps.version.outputs.BUILD_DATE }}-${{ steps.version.outputs.SHA_SHORT }}
Review Comment:
No need to change them here?
##########
.github/workflows/docker-cbdb-build-containers.yml:
##########
@@ -103,17 +104,17 @@ jobs:
- 'images/docker/cbdb/build/rocky8/**'
rocky9:
- 'images/docker/cbdb/build/rocky9/**'
+ ubuntu22.04:
+ - 'images/docker/cbdb/build/ubuntu22.04/**'
# Set up QEMU for multi-architecture support
# This allows building ARM64 images on AMD64 infrastructure and vice versa
- name: Set up QEMU
if: ${{ steps.platform-filter.outputs[matrix.platform] == 'true' }}
uses: docker/setup-qemu-action@v3
- # Login to DockerHub for pushing images
- # Requires DOCKERHUB_USER and DOCKERHUB_TOKEN secrets to be set
- - name: Login to Docker Hub
- if: ${{ steps.platform-filter.outputs[matrix.platform] == 'true' }}
+ # Login to GitHub Container Registry for pushing images
+ - name: Login to GitHub Container Registry
Review Comment:
Still use the Docker hub instead of GitHub to push the images in the production env. So no need to change these lines.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2032772669
##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,118 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:22.04
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+ENV DEBCONF_NOWARNINGS="yes"
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/${TIMEZONE_VAR} /etc/localtime && echo "${TIMEZONE_VAR}" > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update && apt-get install -y --no-install-recommends \
+ file \
+ gdb \
+ glibc-source \
+ make \
+ openssh-client \
+ openssh-server \
+ procps \
+ sudo \
+ net-tools \
+ python-pip \
+ python-six
+
+RUN apt-get install -y locales && \
+ locale-gen "en_US.UTF-8" && \
+ update-locale LC_ALL="en_US.UTF-8"
+
+# --------------------------------------------------------------------
+# Copy Configuration Files and Setup the Environment
+# --------------------------------------------------------------------
+
+RUN ln -s /usr/bin/python2.7 /usr/bin/python
Review Comment:
Yep, fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2782127693
@leborchuk I can provide a list based on how we set up Rocky Linux 9. We can then collaborate on that effort.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2767904298
Hey @leborchuk , an error returned when running `docker build -t cloudberry-db-base-env .` under the dir `images/docker/cbdb/test/ubuntu22.04`:

Seems some packages cannot be installed from the ubuntu 22.04 software sources.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2772208867
@leborchuk I’ve put together a reference implementation for item 1 — enabling the Ubuntu 22.04 developer workflow — here:
🔗 https://github.com/edespino/cloudberry-devops-release/commit/96168251f176f68d3f31d8db947bf879637b612a
The idea is to isolate just the base container build and ensure that developers can build, install, and run installcheck against Cloudberry main. Once this is in place, we can iterate cleanly on GitHub Actions, packaging, and test image support in follow-on steps. Let me know what you think!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2760590062
I fixed issues, PR can be reviewed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2976087190
Thanks @leborchuk for helping push this big feature forward again! Just left some comments, FYI. Will help test earlier this week.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2975023622
Hi, @tuhaihe @edespino I want to reopen PR once again.
I see that no visible commits have been made to https://github.com/edespino/cloudberry/tree/ubuntu-22.04, so I decided to move forward.
I took all the work that had been done by @edespino and set up my own environment for creating Debian packages. Then, I created a Docker environment and Debian package using it (using github actions). I tried to install the Debian package in my development environment - everything worked well. Of course, all packages include PAX storage. I also checked if the simple PAX scripts worked on Ubuntu - there were no errors, everything was great.
It's a first PR where I want to add scripts do cloudberry-devops-release repo.
The plan for future work:
1. run workflow and upload created ubuntu docker files to registry
2. create test debian package workflow (manual run) build based on https://github.com/leborchuk/cloudberrydb/blob/AddJammyBuild/.github/workflows/build-deb-cloudberry.yml and check if all works well
3. Add build & test debian packages to https://github.com/apache/cloudberry/blob/main/.github/workflows/build-cloudberry.yml
4. Discuss whether we want to be able to run tests using a special tag on a Debian image or not.
Here you can find details about the workflow and produced artifacts:
1. Dockerfile - https://github.com/leborchuk/cloudberry-devops-release/actions/runs/15562547058/job/43818330748
2. Debian package - https://github.com/leborchuk/cloudberrydb/actions/runs/15662457461/job/44122150152
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2840725029
@leborchuk & @tuhaihe
I have made significant progress in getting a smaller Ubuntu 22.04 docker images created (993MB vs. 1.4GB from this PR). I also have small changes to Cloudberry to allow the greenplum_path.sh to function properly. I also have a mechanism to create a .deb which functions similar to the .rpm implementation which creates a single directory (/usr/local/cloudberry-db-2.0.0) with a symbolic link to it (/usr/local/cloduberry-db).
Here are my repositories:
- https://github.com/edespino/cloudberry-devops-release/tree/ubuntu-22.04
- https://github.com/edespino/cloudberry/tree/ubuntu-22.04
The container that I can build contains the necessary build time dependencies as well as .deb build dependencies.
You will see that the container does not include the building of xerces-c. This is because it is available from standard ubuntu repositories where other build time dependencies are available. On Rocky Linux, xerces-c is only available from epel which for all intents and purposes is an un-trusted repository for reproducible build purposes. This is why for those platforms, it is built from source.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "yjhjstz (via GitHub)" <gi...@apache.org>.
yjhjstz commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2023285509
##########
scripts/build-deb.sh:
##########
@@ -0,0 +1,148 @@
+#!/bin/bash
+#
+# Script Name: build-deb.sh
+#
+# Description:
+# This script automates the process of building an DEB package using a specified
+# version number. It ensures that the necessary tools are installed
+# and that the control file exists before attempting to build the DEB. The script
+# also includes error handling to provide meaningful feedback in case of failure.
+#
+# Usage:
+# ./build-deb.sh [-v <version>] [-h] [--dry-run]
+#
+# Options:
+# -v, --version <version> : Specify the version (required)
+# -h, --help : Display this help and exit
+# -n, --dry-run : Show what would be done, without making any changes
+#
+# Example:
+# ./build-deb.sh -v 1.5.5 # Build with version 1.5.5
+#
+# Prerequisites:
+# - The dpkg-buildpackage package must be installed (provides the dpkg-buildpackage command).
+# - The control file must exist at debian/control.
+#
+# Error Handling:
+# The script includes checks to ensure:
+# - The version option (-v or --version) is provided.
+# - The necessary commands are available.
+# - The control file exists at the specified location.
+# If any of these checks fail, the script exits with an appropriate error message.
+
+# Enable strict mode for better error handling
+set -euo pipefail
+
+# Default values
+VERSION=""
+RELEASE="1"
+DEBUG_BUILD=false
+
+# Function to display usage information
+usage() {
+ echo "Usage: $0 [-v <version>] [-h] [--dry-run]"
+ echo " -v, --version <version> : Specify the version (optional)"
+ echo " -h, --help : Display this help and exit"
Review Comment:
Could you please product debuginfo package as well ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2771250690
Hi, there is another issue to resolve: the `/tmp/init_system.sh` cannot be executed when the new image starts up. FYI.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2837353789
Additionally, we can wait for @edespino to respond.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3284443837
I created https://github.com/apache/cloudberry/pull/1359 in the main repo, these repo will be archived soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2778221268
> Have you considered slimming the image using ubuntu:jammy-minimal?
There is no jammy-minimal on docker.io )
```
skopeo list-tags docker://docker.io/library/ubuntu
{
"Repository": "docker.io/library/ubuntu",
"Tags": [
...
"22.04",
"22.10",
...
"jammy",
"jammy-20211029",
"jammy-20211122",
"jammy-20220101",
"jammy-20220130",
"jammy-20220301",
"jammy-20220315",
"jammy-20220404",
"jammy-20220421",
"jammy-20220428",
"jammy-20220531",
"jammy-20220801",
"jammy-20220815",
"jammy-20221003",
"jammy-20221020",
"jammy-20221101",
"jammy-20221130",
"jammy-20230126",
"jammy-20230301",
"jammy-20230308",
"jammy-20230425",
"jammy-20230522",
"jammy-20230605",
"jammy-20230624",
"jammy-20230804",
"jammy-20230816",
"jammy-20230916",
"jammy-20231004",
"jammy-20231128",
"jammy-20231211.1",
"jammy-20240111",
"jammy-20240125",
"jammy-20240212",
"jammy-20240227",
"jammy-20240405",
"jammy-20240416",
"jammy-20240427",
"jammy-20240530",
"jammy-20240627.1",
"jammy-20240808",
"jammy-20240911.1",
"jammy-20250126",
```
The reason is that there is no need for jammy-minimal, here is the size of the images (not all, but interested ones)
```
xifos@xifos-dev-bionic:~/git/cloudberry-devops/images/docker/cbdb/test/ubuntu22.04$ docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
ubuntu 22.04 a24be041d957 2 months ago 77.9MB
ubuntu jammy a24be041d957 2 months ago 77.9MB
ubuntu 22.10 692eb4a905c0 21 months ago 70.3MB
```
Compare it with the build/test container size:
```
xifos@xifos-dev-bionic:~/git/cloudberry-devops/images/docker/cbdb/test/ubuntu22.04$ docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
cloudberry-db-build-env latest 693ae32596fc 20 minutes ago 1.43GB
cloudberry-db-test-env latest 62f2e7df33d6 About an hour ago 286MB
cbdb-main rockylinux9 7ee3e45c3ee1 4 months ago 1.89GB
rockylinux/rockylinux 9 bb8a97547d22 4 months ago 234MB
```
When compared to the size of a build container, a difference of a few megabytes is negligible.
Guys here https://askubuntu.com/questions/1455012/where-can-i-find-ubuntu-minimal-22-04-docker-image also came to the similar conclusion.
According to the https://canonical.com/blog/minimal-ubuntu-released minimal image actually is 22.04 LTS image
They sad:
> Tiny container base image
> The 29MB Docker image for Minimal Ubuntu 18.04 LTS serves as a highly efficient container starting point, and allows developers to deploy multicloud containerized applications faster. For modern Docker workflows with Kubernetes, the minimal Ubuntu image provides a balance of compatibility, familiarity, performance and size. This is the standard Ubuntu 18.04 LTS image on the Docker Hub.
So I switched from jammy to 22.04 base image (but they have the same image id, I don't think it matters)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2784876350
> I'm done, PR could be reviewed
Cool. I will help test today.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022127980
##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ build-essential \
+ libssl-dev \
+ gnupg \
+ openssl \
+ debhelper \
+ libfakeroot \
+ debootstrap \
+ devscripts \
+ make \
+ equivs \
+ bison \
+ ca-certificates-java \
+ ca-certificates \
+ cmake \
+ curl \
+ cgroup-tools \
+ flex \
+ gcc-11 \
+ g++-11 \
+ g++-11-multilib \
+ git \
+ krb5-multidev \
+ libapr1-dev \
+ libbz2-dev \
+ libcurl4-gnutls-dev \
+ libpstreams-dev \
+ libxerces-c-dev \
+ libsystemd-dev \
+ libevent-dev \
+ libkrb5-dev \
+ libldap2-dev \
+ libperl-dev \
+ libreadline-dev \
+ libssl-dev \
+ libxml2-dev \
+ libyaml-dev \
+ libzstd-dev \
+ libaprutil1-dev \
+ libpam0g-dev \
+ libpam0g \
+ libcgroup1 \
+ libyaml-0-2 \
+ libldap-2.5-0 \
+ libssl3 \
+ ninja-build \
+ python-setuptools \
+ python3-setuptools \
+ quilt \
+ unzip \
+ wget \
+ zlib1g-dev \
+ libuv1-dev \
+ libgpgme-dev \
+ libgpgme11 \
+ python2.7 \
+ python2.7-dev \
+ pkg-config \
+ python3.10 \
+ python3.10-dev \
+ python3-distutils \
+ sudo
Review Comment:
after testing, some packages are still needed to install for making ./configure and demo culseter successful:
```
liblz4-dev
iputils-ping
iproute2
rsync
less
openssh-client
openssh-server
lsof
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768901583
**APT Flags & Repos**
Problem: You're using --allow-unauthenticated and Acquire::AllowInsecureRepositories=true. This is not safe for production.
Fix: Unless absolutely required (e.g., for local mirrors), remove these flags. If used, explain the context in a comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2754308349
@edespino Could you please review my PR? I want to add deb packages to cloudberry and this is my first PR where I try to create Docker images.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2754455756
Cool @leborchuk, thanks for your great work. I also would like to help review this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2835553213
@tuhaihe @edespino we seem to have lost this PR. Is there anything else I can do here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2837349182
> @tuhaihe @edespino we seem to have lost this PR. Is there anything else I can do here?
Hi @leborchuk, thanks for reaching out. I can support this PR with a +1. I've already tested it on the X86 machine, and it successfully passed all Cloudberry builds and tests.
However, I encountered a new issue: when testing it on my MacBook M1 machine, I received an error.
```
11.79 E: Unable to locate package g++-11-multilib
11.79 E: Couldn't find any package by regex 'g++-11-multilib'
```
Seems the `g++-11-multilib` lacks the ARM support. That would be better to solve it before merging this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2862212038
> @leborchuk & @tuhaihe,
>
> An alternative would be to close this PR and let me carry the changes forward. I’m happy to take that on and can also help guide any remaining updates through the CI landscape. I’ll make sure both of you are added as reviewers on all subsequent changes to keep you in the loop.
Sounds good to me. Thanks dude.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2862192756
@leborchuk & @tuhaihe,
An alternative would be to close this PR and let me carry the changes forward. I’m happy to take that on and can also help guide any remaining updates through the CI landscape. I’ll make sure both of you are added as reviewers on all subsequent changes to keep you in the loop.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2866516483
> @leborchuk & @tuhaihe,
>
> An alternative would be to close this PR and let me carry the changes forward. I’m happy to take that on and can also help guide any remaining updates through the CI landscape. I’ll make sure both of you are added as reviewers on all subsequent changes to keep you in the loop.
Ok, let's close these PRs. I know how the debian package should be done technically, but it would be better to speed things up here. I see @edespino has already deployed the future deb creation prototype to https://github.com/edespino/cloudberry/tree/ubuntu-22.04 . Let's use it to put everything together.
Of course, I will be happy to participate in the review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2778994044
I found out that it's impossible to install debian binary to /usr/local directory. Debian package has special section to prevent a such danger action https://manpages.ubuntu.com/manpages/oracular/man1/dh_usrlocal.1.html
It's due to debian policy https://www.debian.org/doc/debian-policy/ch-opersys.html#s9.1.2
> As mandated by the FHS, packages must not place any files in /usr/local, either by putting them in the file system archive to be unpacked by dpkg or by manipulating them in their maintainer scripts.
> However, the package may create empty directories below /usr/local so that the system administrator knows where to place site-specific files.
So I installed all cloudberry binaries to /usr/cloudberry-db and then in postinst script create symbolic link /usr/local/cloudberry-db -> /usr/cloudberry-db
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "yjhjstz (via GitHub)" <gi...@apache.org>.
yjhjstz commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2023275740
##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ build-essential \
+ libssl-dev \
+ gnupg \
+ openssl \
+ debhelper \
+ libfakeroot \
+ debootstrap \
+ devscripts \
+ make \
+ equivs \
+ bison \
+ ca-certificates-java \
+ ca-certificates \
+ cmake \
+ curl \
+ cgroup-tools \
+ flex \
+ gcc-11 \
+ g++-11 \
+ g++-11-multilib \
+ git \
+ krb5-multidev \
+ libapr1-dev \
+ libbz2-dev \
+ libcurl4-gnutls-dev \
+ libpstreams-dev \
+ libxerces-c-dev \
+ libsystemd-dev \
+ libevent-dev \
+ libkrb5-dev \
+ libldap2-dev \
+ libperl-dev \
+ libreadline-dev \
+ libssl-dev \
+ libxml2-dev \
+ libyaml-dev \
+ libzstd-dev \
+ libaprutil1-dev \
+ libpam0g-dev \
+ libpam0g \
+ libcgroup1 \
+ libyaml-0-2 \
+ libldap-2.5-0 \
+ libssl3 \
+ ninja-build \
+ python-setuptools \
+ python3-setuptools \
+ quilt \
+ unzip \
+ wget \
+ zlib1g-dev \
+ libuv1-dev \
+ libgpgme-dev \
+ libgpgme11 \
+ python2.7 \
+ python2.7-dev \
+ pkg-config \
+ python3.10 \
+ python3.10-dev \
+ python3-distutils \
+ sudo
+
+RUN apt-get install -y locales && \
+ locale-gen "en_US.UTF-8" && \
+ update-locale LC_ALL="en_US.UTF-8"
+
+RUN cd && \
+ XERCES_LATEST_RELEASE=3.3.0 && \
+ wget -nv "https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" && \
+ echo "$(curl -sL https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz.sha256)" | sha256sum -c - && \
+ tar xf "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz"; rm "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" && \
+ cd xerces-c-${XERCES_LATEST_RELEASE} && \
+ ./configure --prefix=/usr/local/xerces-c && \
+ make -j$(nproc) && \
+ make install -C ~/xerces-c-${XERCES_LATEST_RELEASE} && \
+ rm -rf ~/xerces-c*
+
+RUN cd && GO_VERSION="go1.23.4" && \
+ ARCH=$(uname -m) && \
+ if [ "${ARCH}" = "aarch64" ]; then \
+ GO_ARCH="arm64" && \
+ GO_SHA256="16e5017863a7f6071363782b1b8042eb12c6ca4f4cd71528b2123f0a1275b13e"; \
+ elif [ "${ARCH}" = "x86_64" ]; then \
+ GO_ARCH="amd64" && \
+ GO_SHA256="6924efde5de86fe277676e929dc9917d466efa02fb934197bc2eba35d5680971"; \
+ else \
+ echo "Unsupported architecture: ${ARCH}" && exit 1; \
+ fi && \
+ GO_URL="https://go.dev/dl/${GO_VERSION}.linux-${GO_ARCH}.tar.gz" && \
+ wget -nv "${GO_URL}" && \
+ echo "${GO_SHA256} ${GO_VERSION}.linux-${GO_ARCH}.tar.gz" | sha256sum -c - && \
+ tar xf "${GO_VERSION}.linux-${GO_ARCH}.tar.gz" && \
+ mv go "/usr/local/${GO_VERSION}" && \
+ ln -s "/usr/local/${GO_VERSION}" /usr/local/go && \
+ rm -f "${GO_VERSION}.linux-${GO_ARCH}.tar.gz" && \
+ echo 'export PATH=$PATH:/usr/local/go/bin' | tee -a /etc/profile.d/go.sh > /dev/null
+
+
+# --------------------------------------------------------------------
+# Copy Configuration Files and Setup the Environment
+# --------------------------------------------------------------------
+
+RUN ln -s /usr/bin/python2.7 /usr/bin/python
Review Comment:
Can we upgrade python to python3 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3112479377
Rebased to the new cloudberry-env file
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3114184988
> Hey @leborchuk, would you like to start planning the migration of this repo to the main one, as discussed here: https://lists.apache.org/thread/p6otyrrnosg8fsbyr6ok7hl8wxpx4ss2? I think it would be better to open a new PR on the main after this repo's migration is complete. Otherwise, it could make the migration more difficult.
>
> How about this?
Well, do you think the time has come? Let's start it then) I will store scripts from this PR in my own repo, move this repo and fix building scripts, then open PR again
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022065110
##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
Review Comment:
Are these used for AWS uploading? If so, I think we are not using AWS in the workflow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022129960
##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ file \
+ gdb \
+ glibc-locale-source \
Review Comment:
```suggestion
glibc-source \
```
##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ file \
+ gdb \
+ glibc-locale-source \
+ make \
+ openssh \
+ openssh-clients \
+ openssh-server \
+ procps-ng \
Review Comment:
```suggestion
procps \
```
##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ file \
+ gdb \
+ glibc-locale-source \
+ make \
+ openssh \
+ openssh-clients \
Review Comment:
```suggestion
openssh-client \
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022127980
##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ build-essential \
+ libssl-dev \
+ gnupg \
+ openssl \
+ debhelper \
+ libfakeroot \
+ debootstrap \
+ devscripts \
+ make \
+ equivs \
+ bison \
+ ca-certificates-java \
+ ca-certificates \
+ cmake \
+ curl \
+ cgroup-tools \
+ flex \
+ gcc-11 \
+ g++-11 \
+ g++-11-multilib \
+ git \
+ krb5-multidev \
+ libapr1-dev \
+ libbz2-dev \
+ libcurl4-gnutls-dev \
+ libpstreams-dev \
+ libxerces-c-dev \
+ libsystemd-dev \
+ libevent-dev \
+ libkrb5-dev \
+ libldap2-dev \
+ libperl-dev \
+ libreadline-dev \
+ libssl-dev \
+ libxml2-dev \
+ libyaml-dev \
+ libzstd-dev \
+ libaprutil1-dev \
+ libpam0g-dev \
+ libpam0g \
+ libcgroup1 \
+ libyaml-0-2 \
+ libldap-2.5-0 \
+ libssl3 \
+ ninja-build \
+ python-setuptools \
+ python3-setuptools \
+ quilt \
+ unzip \
+ wget \
+ zlib1g-dev \
+ libuv1-dev \
+ libgpgme-dev \
+ libgpgme11 \
+ python2.7 \
+ python2.7-dev \
+ pkg-config \
+ python3.10 \
+ python3.10-dev \
+ python3-distutils \
+ sudo
Review Comment:
after testing, some packages are still needed to install for making ./configure and demo culseter successful:
```
liblz4-dev
iputils-ping
iproute2
rsync
less
openssh-client
openssh-server
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2149586324
##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,197 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:22.04
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+# Environment variables for locale and user
+ENV container=docker
+ENV LANG=en_US.UTF-8
+ENV USER=gpadmin
+ENV TZ=${TIMEZONE_VAR}
+ENV DEBIAN_FRONTEND=noninteractive
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+
+RUN sed -i "s/archive.ubuntu.com/mirror.yandex.ru/g" /etc/apt/sources.list && \
Review Comment:
Hey, we can use the default source list. A chance that the Yandex mirror will be slow for other regions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2755603167
I found out that the deb package's dependencies included our internal python packages, so removed them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2779401715
@leborchuk If you don't mind me asking, what is your ultimate goal here? I assume you will also be introducing Ubuntu 22.04 into the Apache Cloudberry build and test processes. Is that correct?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768903579
**Missing Cleanup**
Problem: The APT cache and downloaded files (e.g., .tar.gz, build dirs) are not cleaned up, which bloats the image.
Fix:
RUN apt-get clean && rm -rf /var/lib/apt/lists/*
Also clean /tmp/*, ~/xerces-c*, Go tarballs, etc., after use.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2772207957
@leborchuk This is great progress — thanks for putting in the effort to bring Ubuntu 22.04 support to Cloudberry!
That said, I’d really prefer to see this rolled out in more focused, logical chunks so each stage is easy to test, review, and validate independently. Something like:
1. Developer workflow – Introduce base support for Ubuntu 22.04: container build image, compiler config, developer installcheck support. A developer should be able to build and run installcheck against main.
2. CI build automation – Add a GitHub Actions workflow to build the Ubuntu 22.04 developer container image automatically.
3. Release engineering workflow – Extend the container image to support .deb package creation. A developer should be able to build and produce a .deb file inside the image.
4. QA workflow – Introduce a minimal runtime container image (based on Ubuntu 22.04) to install and validate the .deb package. This image should support basic Cloudberry functionality and simulate a QA-style install, including gpadmin setup and dependency resolution.
Splitting the PR this way would make it easier for others to review and test each part without merging everything at once. Would you be open to restructuring the work along these lines?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk closed pull request #13: Add scripts for create ubuntu jammy docker file
URL: https://github.com/apache/cloudberry-devops-release/pull/13
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3101421907
Tip: add here `libssh2-devel` after merging https://github.com/apache/cloudberry-devops-release/pull/27#pullrequestreview-3041510452
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2843927015
Thanks, Ed. I will be back from holiday next Tuesday and will test it then.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2015411195
##########
build_automation/cloudberry/scripts/configure-cloudberry.sh:
##########
@@ -96,22 +96,23 @@ export LOG_DIR="${SRC_DIR}/build-logs"
CONFIGURE_LOG="${LOG_DIR}/configure.log"
# Initialize environment
-init_environment "Cloudberry Configure Script" "${CONFIGURE_LOG}"
+init_environment "Cloudberry Configure Script" "${CONFIGURE_LOG}" "${BUILD_DESTINATION}"
# Initial setup
log_section "Initial Setup"
-execute_cmd sudo rm -rf /usr/local/cloudberry-db || exit 2
+execute_cmd sudo rm -rf ${BUILD_DESTINATION}/* || exit 2
execute_cmd sudo chmod a+w /usr/local || exit 2
-execute_cmd mkdir -p /usr/local/cloudberry-db/lib || exit 2
+execute_cmd sudo mkdir -p ${BUILD_DESTINATION}/lib || exit 2
+execute_cmd sudo chown -R gpadmin:gpadmin ${BUILD_DESTINATION} || exit 2
Review Comment:
Is line 106 the same as line 110?
##########
.github/workflows/docker-cbdb-build-containers.yml:
##########
@@ -76,7 +76,7 @@ jobs:
# Matrix strategy to build for both Rocky Linux 8 and 9
strategy:
matrix:
- platform: ['rocky8', 'rocky9']
+ platform: ['rocky8', 'rocky9', 'jammy']
Review Comment:
It would be clearer to change the `jammy` to `ubuntu22.04`.
##########
packaging/deb/jammy/debian/control:
##########
@@ -0,0 +1,101 @@
+Source: apache-cloudberry-db-incubating
+Maintainer: open-gpdb dev team https://github.com/open-gpdb/gpdb
Review Comment:
```suggestion
Maintainer: Apache Cloudberry (Incubating) https://cloudberry.apache.org
```
##########
packaging/deb/jammy/debian/rules:
##########
@@ -0,0 +1,49 @@
+#!/usr/bin/make -f
+
+DH_VERBOSE = 1
+DPKG_EXPORT_BUILDFLAGS = 1
+
+GPDB_BIN_PATH := /usr/local/cloudberry-db
Review Comment:
```suggestion
CBDB_BIN_PATH := /usr/local/cloudberry-db
```
##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment
Review Comment:
```suggestion
# Dockerfile for Apache Cloudberry Base Environment
```
##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Cloudberry Database. It installs
Review Comment:
```suggestion
# a base environment for evaluating the Apache Cloudberry. It installs
```
##########
packaging/deb/jammy/debian/rules:
##########
@@ -0,0 +1,49 @@
+#!/usr/bin/make -f
+
+DH_VERBOSE = 1
+DPKG_EXPORT_BUILDFLAGS = 1
+
+GPDB_BIN_PATH := /usr/local/cloudberry-db
+DEBIAN_DESTINATION := $(shell pwd)/debian/build
+
+# assumes that CWD is root of gpdb source
+GPDB_PKG_VERSION := $(GPDB_PKG_VERSION)
+PACKAGE_GPDB := $(shell cat debian/control | egrep "^Package: " | cut -d " " -f 2)
+PATH := ${DEBIAN_DESTINATION}/bin:${PATH}
+
+.PHONY: gpinstall
+
+include /usr/share/dpkg/default.mk
+
+%:
+ dh $@ --parallel
+
+gpinstall:
+ make install
+
+override_dh_auto_install: gpinstall
+ # the staging directory for creating a debian is NOT the right GPHOME.
+ # change GPHOME to point to the post-install target install directory.
+ sed -i "s#GPHOME=.*#GPHOME=${GPDB_BIN_PATH}#g" ${DEBIAN_DESTINATION}/greenplum_path.sh
+
+override_dh_auto_build:
+ echo "Skipping build"
+
+override_dh_auto_clean:
+ echo "Skipping clean"
+
+override_dh_auto_configure:
+ echo "Skipping configure"
+
+override_dh_auto_test:
+ echo "Skipping auto test"
+
+override_dh_gencontrol:
+ echo "using version ${GPDB_PKG_VERSION} for binary GPDB"
Review Comment:
```suggestion
echo "using version ${GPDB_PKG_VERSION} for binary Cloudberry"
```
##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Cloudberry Database. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Cloudberry
+# Database DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ build-essential \
+ libssl-dev \
+ gnupg \
+ openssl \
+ debhelper \
+ libfakeroot \
+ debootstrap \
+ devscripts \
+ make \
+ equivs \
+ bison \
+ ca-certificates-java \
+ ca-certificates \
+ cmake \
+ curl \
+ cgroup-tools \
+ flex \
+ gcc-11 \
+ g++-11 \
+ g++-11-multilib \
+ git \
+ krb5-multidev \
+ libapr1-dev \
+ libbz2-dev \
+ libcurl4-gnutls-dev \
+ libpstreams-dev \
+ libxerces-c-dev \
+ libsystemd-dev \
+ libevent-dev \
+ libkrb5-dev \
+ libldap2-dev \
+ libperl-dev \
+ libreadline-dev \
+ libssl-dev \
+ libxml2-dev \
+ libyaml-dev \
+ libzstd-dev \
+ libaprutil1-dev \
+ libpam0g-dev \
+ libpam0g \
+ libcgroup1 \
+ libyaml-0-2 \
+ libldap-2.5-0 \
+ libssl3 \
+ ninja-build \
+ python-setuptools \
+ python3-setuptools \
+ quilt \
+ unzip \
+ wget \
+ zlib1g-dev \
+ libuv1-dev \
+ libgpgme-dev \
+ libgpgme11 \
+ python2.7 \
+ python2.7-dev \
+ pkg-config \
+ python3.10 \
+ python3.10-dev \
+ python3-distutils \
+ sudo
+
+RUN apt-get install -y locales \
+&& locale-gen "en_US.UTF-8" \
+&& update-locale LC_ALL="en_US.UTF-8"
+
+RUN cd \
+&& XERCES_LATEST_RELEASE=3.3.0 \
+&& wget -nv "https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" \
+&& echo "$(curl -sL https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz.sha256)" | sha256sum -c - \
+&& tar xf "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz"; rm "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" \
+&& cd xerces-c-${XERCES_LATEST_RELEASE} \
+&& ./configure --prefix=/usr/local/xerces-c \
+&& make -j \
Review Comment:
`make -j$(nproc)` will be more efficent.
##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Cloudberry Database. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Cloudberry
+# Database DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+ build-essential \
+ libssl-dev \
+ gnupg \
+ openssl \
+ debhelper \
+ libfakeroot \
+ debootstrap \
+ devscripts \
+ make \
+ equivs \
+ bison \
+ ca-certificates-java \
+ ca-certificates \
+ cmake \
+ curl \
+ cgroup-tools \
+ flex \
+ gcc-11 \
+ g++-11 \
+ g++-11-multilib \
+ git \
+ krb5-multidev \
+ libapr1-dev \
+ libbz2-dev \
+ libcurl4-gnutls-dev \
+ libpstreams-dev \
+ libxerces-c-dev \
+ libsystemd-dev \
+ libevent-dev \
+ libkrb5-dev \
+ libldap2-dev \
+ libperl-dev \
+ libreadline-dev \
+ libssl-dev \
+ libxml2-dev \
+ libyaml-dev \
+ libzstd-dev \
+ libaprutil1-dev \
+ libpam0g-dev \
+ libpam0g \
+ libcgroup1 \
+ libyaml-0-2 \
+ libldap-2.5-0 \
+ libssl3 \
+ ninja-build \
+ python-setuptools \
+ python3-setuptools \
+ quilt \
+ unzip \
+ wget \
+ zlib1g-dev \
+ libuv1-dev \
+ libgpgme-dev \
+ libgpgme11 \
+ python2.7 \
+ python2.7-dev \
+ pkg-config \
+ python3.10 \
+ python3.10-dev \
+ python3-distutils \
+ sudo
+
+RUN apt-get install -y locales \
+&& locale-gen "en_US.UTF-8" \
Review Comment:
IMO, we can place `&&` at the end of the command line, which will be easier for human reading. FYI.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3125116638
> > Hey @leborchuk, would you like to start planning the migration of this repo to the main one, as discussed here: https://lists.apache.org/thread/p6otyrrnosg8fsbyr6ok7hl8wxpx4ss2? I think it would be better to open a new PR on the main after this repo's migration is complete. Otherwise, it could make the migration more difficult.
> > How about this?
>
> Well, do you think the time has come? Let's start it then) I will store scripts from this PR in my own repo, move this repo and fix building scripts, then open PR again
I think it's good to start the plan and move forward now. We can have a discussion about it and see how to reorganize these files in the main repo, then we can take actions. Sounds good?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768902669
**Duplicate Packages**
libssl-dev appears twice in the APT list.
libaprutil1-dev and libuv1-dev are also later reinstalled under gpadmin.
Fix: Install once globally under root and avoid duplication unless version/context differs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768905664
**Timezone hardcoding**
ln -snf /usr/share/zoneinfo/Europe/London is hardcoded, even though you have TIMEZONE_VAR.
Fix: Use the variable:
RUN ln -snf /usr/share/zoneinfo/${TIMEZONE_VAR} /etc/localtime && echo "${TIMEZONE_VAR}" > /etc/timezone
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768907488
Repetitive locale settings
You run locale-gen and update-locale multiple times.
Fix: Consolidate to a single layer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768910747
Have you considered slimming the image using ubuntu:jammy-minimal?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022565519
##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
Review Comment:
I build the image by removing these 3 lines, with any negative effects.
We also need to add the following env to make the test happy:
```
ENV USER=gpadmin
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2783886483
> @leborchuk I’ve put together a reference implementation for item 1 — enabling the Ubuntu 22.04 developer workflow — here:
>
> 🔗 [edespino@7ccbabe](https://github.com/edespino/cloudberry-devops-release/commit/7ccbabe6ad7441d25a38f3f72c8683518564ea16)
>
> The idea is to isolate just the base container build and ensure that developers can build, install, and run installcheck against Cloudberry main. Once this is in place, we can iterate cleanly on GitHub Actions, packaging, and test image support in follow-on steps. Let me know what you think!
@edespino Thank you, I see forgotten test_cloudberry_db_env.py script. I have added it and ensured that it works correctly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2032481236
##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,118 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+# evaluation. It includes configurations such as passwordless sudo access
+# for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+# should NOT be used in a production environment due to potential security
+# risks.
+#
+# Usage:
+# docker build -t cloudberry-db-base-env .
+# docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:22.04
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+ENV DEBCONF_NOWARNINGS="yes"
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/${TIMEZONE_VAR} /etc/localtime && echo "${TIMEZONE_VAR}" > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update && apt-get install -y --no-install-recommends \
+ file \
+ gdb \
+ glibc-source \
+ make \
+ openssh-client \
+ openssh-server \
+ procps \
+ sudo \
+ net-tools \
+ python-pip \
+ python-six
+
+RUN apt-get install -y locales && \
+ locale-gen "en_US.UTF-8" && \
+ update-locale LC_ALL="en_US.UTF-8"
+
+# --------------------------------------------------------------------
+# Copy Configuration Files and Setup the Environment
+# --------------------------------------------------------------------
+
+RUN ln -s /usr/bin/python2.7 /usr/bin/python
Review Comment:
```suggestion
RRUN ln -s /usr/bin/python3.10 /usr/bin/python
```
Similar to the build Dockerfile? FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org
Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]
Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk closed pull request #13: Add scripts for create ubuntu jammy docker file
URL: https://github.com/apache/cloudberry-devops-release/pull/13
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org