You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudberry.apache.org by "leborchuk (via GitHub)" <gi...@apache.org> on 2025/03/26 12:47:02 UTC

[PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

leborchuk opened a new pull request, #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13

   In these PR I added to workflow building jammy Docker container.
   
   The main peculiarity of the Debian package is that we need to build the binary in a specific directory and then install it in /usr/local/cloudberry-db. This differs from the package creation process for RPM-based distros, where you simply list what you want to package (*.spec) along with absolute paths. For Ubuntu you should list relative local build paths and then write install script to copy it in /usr/local/cloudberry-db.
   
   So, I added the ${BUILD_DESTINATION} path (with defaults to /usr/ local/cloudberry-db) to all build automation scripts. This has made my PR slightly more dangerous, because if something goes wrong (I don't think I have, but it needs to be thoroughly reviewed), all our builds could suffer.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022565519


##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName

Review Comment:
   I build the image by removing these 3 lines, without any negative effects.
   
   We also need to add the following env to make the test happy:
   
   ```
   ENV USER=gpadmin
   ```
   
    



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2782956123

   > @leborchuk I can provide a list based on how we set up Rocky Linux 9. We can then collaborate on that effort.
   
   @edespino It would be great, I really appreciate your help. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2778237995

   > **Missing Cleanup**
   > 
   
   
   Fixed, now the main place is occupied by binary files.
   
   Image size:
   ```
   REPOSITORY                TAG           IMAGE ID       CREATED             SIZE
   cloudberry-db-build-env   latest        693ae32596fc   20 minutes ago      1.43GB
   ```
   
   Total directory sizes in the container:
   
   ```
   gpadmin@cdw:~$ du -c / | sort -n | tail -10
   182160	/usr/lib/jvm/java-11-openjdk-amd64/lib
   183140	/usr/lib/jvm/java-11-openjdk-amd64
   183148	/usr/lib/jvm
   274664	/usr/local/go1.23.4
   278432	/usr/lib/x86_64-linux-gnu
   364992	/usr/local
   705304	/usr/lib
   1388800	/usr
   1409736	/
   1409736	total
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2783898999

   I'm done, PR could be reviewed 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2983605038

   > Thanks @leborchuk for helping push this big feature forward again! Just left some comments, FYI. Will help test earlier this week.
   
   Thanks, fixed


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "ostinru (via GitHub)" <gi...@apache.org>.
ostinru commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2163174130


##########
packaging/deb/ubuntu22.04/debian/postinst:
##########
@@ -0,0 +1,15 @@
+#!/bin/bash
+
+set -e
+
+GPADMIN=gpadmin
+GPHOME=/usr/cloudberry-db
+
+if [ "$1" = configure ]; then
+
+  chown -R ${GPADMIN}:${GPADMIN} ${GPHOME}

Review Comment:
   @leborchuk , let's leave file permission as root:root



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768641783

   After building and installing Cloudberry in the build image, I run the test for twice with the following command:
   
   ```
   PGOPTIONS='-c optimizer=on' make installcheck
   ```
   Some errors return:
   
   [regression-diffs.txt](https://github.com/user-attachments/files/19547650/regression-diffs.txt)
   
   ```
    +20250401:07:07:21:037248 gpconfig:cdw:gpadmin-[ERROR]:-USER environment variable must be set.
    +USER environment variable must be set.
   ```
   
   Should we add the `ENV USER=gpadmin` to the build Dockerfile? FYI. Will test later.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2029108185


##########
scripts/build-deb.sh:
##########
@@ -0,0 +1,148 @@
+#!/bin/bash
+#
+# Script Name: build-deb.sh
+#
+# Description:
+# This script automates the process of building an DEB package using a specified
+# version number. It ensures that the necessary tools are installed
+# and that the control file exists before attempting to build the DEB. The script
+# also includes error handling to provide meaningful feedback in case of failure.
+#
+# Usage:
+# ./build-deb.sh [-v <version>] [-h] [--dry-run]
+#
+# Options:
+#   -v, --version <version>    : Specify the version (required)
+#   -h, --help                 : Display this help and exit
+#   -n, --dry-run              : Show what would be done, without making any changes
+#
+# Example:
+#   ./build-deb.sh -v 1.5.5               # Build with version 1.5.5
+#
+# Prerequisites:
+# - The dpkg-buildpackage package must be installed (provides the dpkg-buildpackage command).
+# - The control file must exist at debian/control.
+#
+# Error Handling:
+# The script includes checks to ensure:
+# - The version option (-v or --version) is provided.
+# - The necessary commands are available.
+# - The control file exists at the specified location.
+# If any of these checks fail, the script exits with an appropriate error message.
+
+# Enable strict mode for better error handling
+set -euo pipefail
+
+# Default values
+VERSION=""
+RELEASE="1"
+DEBUG_BUILD=false
+
+# Function to display usage information
+usage() {
+  echo "Usage: $0 [-v <version>] [-h] [--dry-run]"
+  echo "  -v, --version <version>    : Specify the version (optional)"
+  echo "  -h, --help                 : Display this help and exit"

Review Comment:
   There is no need to generate it manually, everything is done automatically since debhelper >= 9.2 https://wiki.debian.org/AutomaticDebugPackages
   
   We have (my test output) files
   ```
   -rw-r--r--  1 gpadmin root   12103622 Apr  4 16:15 apache-cloudberry-db-incubating-dbgsym_1.6.0-1-._amd64.ddeb
   -rw-r--r--  1 gpadmin root       1163 Apr  4 16:14 apache-cloudberry-db-incubating_1.6.0-1-..dsc
   -rw-r--r--  1 gpadmin root   62554652 Apr  4 16:14 apache-cloudberry-db-incubating_1.6.0-1-..tar.xz
   -rw-r--r--  1 gpadmin root      12427 Apr  4 16:15 apache-cloudberry-db-incubating_1.6.0-1-._amd64.buildinfo
   -rw-r--r--  1 gpadmin root       2318 Apr  4 16:15 apache-cloudberry-db-incubating_1.6.0-1-._amd64.changes
   -rw-r--r--  1 gpadmin root   13566216 Apr  4 16:15 apache-cloudberry-db-incubating_1.6.0-1-._amd64.deb
   ```
   
   apache-cloudberry-db-incubating-dbgsym_1.6.0-1-._amd64.ddeb package - with debug symbols
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2785376071

   > > I'm done, PR could be reviewed
   > 
   > Cool. I will help test today.
   
   Now I can build and run the building and test image based on Ubuntu 22.04 successfully. I can also build Cloudberry from the source on the build image. Thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3112500686

   Hey @leborchuk, would you like to start planning the migration of this repo to the main one, as discussed here: https://lists.apache.org/thread/p6otyrrnosg8fsbyr6ok7hl8wxpx4ss2? I think it would be better to open a new PR on the main after this repo's migration is complete. Otherwise, it could make the migration more difficult.
   
   How about this? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2853683674

   > @leborchuk & @tuhaihe
   > 
   > I have made significant progress in getting a smaller Ubuntu 22.04 docker images created (993MB vs. 1.4GB from this PR). I also have small changes to Cloudberry to allow the greenplum_path.sh to function properly. I also have a mechanism to create a .deb which functions similar to the .rpm implementation which creates a single directory (/usr/local/cloudberry-db-2.0.0) with a symbolic link to it (/usr/local/cloduberry-db).
   > 
   > Here are my repositories:
   > 
   > * https://github.com/edespino/cloudberry-devops-release/tree/ubuntu-22.04
   > * https://github.com/edespino/cloudberry/tree/ubuntu-22.04
   > 
   > The container that I can build contains the necessary build time dependencies as well as .deb build dependencies.
   > 
   > You will see that the container does not include the building of xerces-c. This is because it is available from standard ubuntu repositories where other build time dependencies are available. On Rocky Linux, xerces-c is only available from epel which for all intents and purposes is an un-trusted repository for reproducible build purposes. This is why for those platforms, it is built from source.
   
   Awesome! Thank you so much, Ed! 
   
   I tested it out and successfully logged into the new container using your codebase. I noticed that your code changed a bit with @leborchuk's's PR in some files. I think it would be great if we could merge @leborchuk's’s PR to establish a base Ubuntu image. Then you could rebase your codebase to create a new PR to update and generate a newer Docker image. 
   
   Trying to achieve perfection in just one PR might slow down our progress. What do you think about this approach?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2779622231

   > @leborchuk If you don't mind me asking, what is your ultimate goal here? I assume you will also be introducing Ubuntu 22.04 into the Apache Cloudberry build and test processes. Is that correct?
   
   Yes, I'd like to add Ubuntu 22.04 into the Apache Cloudberry build and test processes. I want to be able to 
   - Test if it builds successfully
   - Create artifacts (Debian packages/docker files) for releases
   - Add a QA workflow to run Installcheckworld by specific tag
   
   Sorry, I see comments you've made but didn't have time to think about them thoroughly. It would be great to split work to pieces. And to describe properly what I really going to do. But it needs some time to understand how it should be done.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2795845493

   Hi any process on this PR review?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3161437859

   Created https://github.com/apache/cloudberry/pull/1292


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2149603840


##########
.github/workflows/docker-cbdb-test-containers.yml:
##########
@@ -144,8 +147,8 @@ jobs:
             type=gha,scope=docker-cbdb-test-${{ matrix.platform }}
           # Tag with both latest and version-specific tags
           tags: |
-            apache/incubator-cloudberry:cbdb-test-${{ matrix.platform }}-latest
-            apache/incubator-cloudberry:cbdb-test-${{ matrix.platform }}-${{ steps.version.outputs.BUILD_DATE }}-${{ steps.version.outputs.SHA_SHORT }}
+            ghcr.io/${{ github.repository }}:cbdb-test-${{ matrix.platform }}-latest
+            ghcr.io/${{ github.repository }}:cbdb-test-${{ matrix.platform }}-${{ steps.version.outputs.BUILD_DATE }}-${{ steps.version.outputs.SHA_SHORT }}

Review Comment:
   No need to change them here?



##########
.github/workflows/docker-cbdb-build-containers.yml:
##########
@@ -103,17 +104,17 @@ jobs:
               - 'images/docker/cbdb/build/rocky8/**'
             rocky9:
               - 'images/docker/cbdb/build/rocky9/**'
+            ubuntu22.04:
+              - 'images/docker/cbdb/build/ubuntu22.04/**'
 
       # Set up QEMU for multi-architecture support
       # This allows building ARM64 images on AMD64 infrastructure and vice versa
       - name: Set up QEMU
         if: ${{ steps.platform-filter.outputs[matrix.platform] == 'true' }}
         uses: docker/setup-qemu-action@v3
 
-      # Login to DockerHub for pushing images
-      # Requires DOCKERHUB_USER and DOCKERHUB_TOKEN secrets to be set
-      - name: Login to Docker Hub
-        if: ${{ steps.platform-filter.outputs[matrix.platform] == 'true' }}
+      # Login to  GitHub Container Registry for pushing images
+      - name: Login to GitHub Container Registry

Review Comment:
   Still use the Docker hub instead of GitHub to push the images in the production env. So no need to change these lines.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2032772669


##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,118 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:22.04
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+ENV DEBCONF_NOWARNINGS="yes"
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/${TIMEZONE_VAR} /etc/localtime && echo "${TIMEZONE_VAR}" > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update && apt-get install -y --no-install-recommends \
+        file \
+        gdb \
+        glibc-source \
+        make \
+        openssh-client \
+        openssh-server \
+        procps \
+        sudo \
+        net-tools \
+        python-pip \
+        python-six
+
+RUN apt-get install -y locales && \
+    locale-gen "en_US.UTF-8" && \
+    update-locale LC_ALL="en_US.UTF-8"
+
+# --------------------------------------------------------------------
+# Copy Configuration Files and Setup the Environment
+# --------------------------------------------------------------------
+
+RUN ln -s /usr/bin/python2.7 /usr/bin/python

Review Comment:
   Yep, fixed



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2782127693

   @leborchuk I can provide a list based on how we set up Rocky Linux 9. We can then collaborate on that effort.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2767904298

   Hey @leborchuk , an error returned when running `docker build -t cloudberry-db-base-env .` under the dir `images/docker/cbdb/test/ubuntu22.04`:
   
   ![image](https://github.com/user-attachments/assets/8cb722ee-e4b1-4b66-9703-b50e48d82ddb)
   
   Seems some packages cannot be installed from the ubuntu 22.04 software sources.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2772208867

   @leborchuk I’ve put together a reference implementation for item 1 — enabling the Ubuntu 22.04 developer workflow — here:
   
   🔗 https://github.com/edespino/cloudberry-devops-release/commit/96168251f176f68d3f31d8db947bf879637b612a
   
   The idea is to isolate just the base container build and ensure that developers can build, install, and run installcheck against Cloudberry main. Once this is in place, we can iterate cleanly on GitHub Actions, packaging, and test image support in follow-on steps. Let me know what you think!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2760590062

   I fixed issues, PR can be reviewed 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2976087190

   Thanks @leborchuk for helping push this big feature forward again! Just left some comments, FYI. Will help test earlier this week.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2975023622

   Hi, @tuhaihe @edespino I want to reopen PR once again. 
   
   I see that no visible commits have been made to https://github.com/edespino/cloudberry/tree/ubuntu-22.04, so I decided to move forward.
   
   I took all the work that had been done by @edespino and set up my own environment for creating Debian packages. Then, I created a Docker environment and Debian package using it (using github actions). I tried to install the Debian package in my development environment - everything worked well. Of course, all packages include PAX storage.  I also checked if the simple PAX scripts worked on Ubuntu - there were no errors, everything was great.
   
   It's a first PR where I want to add scripts do cloudberry-devops-release repo.
   
   The plan for future work:
   1. run workflow and upload created ubuntu docker files to registry
   2. create test debian package workflow (manual run) build based on https://github.com/leborchuk/cloudberrydb/blob/AddJammyBuild/.github/workflows/build-deb-cloudberry.yml and check if all works well
   3. Add build & test debian packages to https://github.com/apache/cloudberry/blob/main/.github/workflows/build-cloudberry.yml
   4. Discuss whether we want to be able to run tests using a special tag on a Debian image or not.
   
   Here you can find details about the workflow and produced artifacts:
   1. Dockerfile - https://github.com/leborchuk/cloudberry-devops-release/actions/runs/15562547058/job/43818330748
   2. Debian package - https://github.com/leborchuk/cloudberrydb/actions/runs/15662457461/job/44122150152


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2840725029

   @leborchuk & @tuhaihe 
   
   I have made significant progress in getting a smaller Ubuntu 22.04 docker images created (993MB vs. 1.4GB from this PR). I also have small changes to Cloudberry to allow the greenplum_path.sh to function properly. I also have a mechanism to create a .deb which functions similar to the .rpm implementation which creates a single directory (/usr/local/cloudberry-db-2.0.0) with a symbolic link to it (/usr/local/cloduberry-db).
   
   Here are my repositories:
   - https://github.com/edespino/cloudberry-devops-release/tree/ubuntu-22.04
   - https://github.com/edespino/cloudberry/tree/ubuntu-22.04
   
   The container that I can build contains the necessary build time dependencies as well as .deb build dependencies.
   
   You will see that the container does not include the building of xerces-c. This is because it is available from standard ubuntu repositories where other build time dependencies are available. On Rocky Linux, xerces-c is only available from epel which for all intents and purposes is an un-trusted repository for reproducible build purposes. This is why for those platforms, it is built from source.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "yjhjstz (via GitHub)" <gi...@apache.org>.
yjhjstz commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2023285509


##########
scripts/build-deb.sh:
##########
@@ -0,0 +1,148 @@
+#!/bin/bash
+#
+# Script Name: build-deb.sh
+#
+# Description:
+# This script automates the process of building an DEB package using a specified
+# version number. It ensures that the necessary tools are installed
+# and that the control file exists before attempting to build the DEB. The script
+# also includes error handling to provide meaningful feedback in case of failure.
+#
+# Usage:
+# ./build-deb.sh [-v <version>] [-h] [--dry-run]
+#
+# Options:
+#   -v, --version <version>    : Specify the version (required)
+#   -h, --help                 : Display this help and exit
+#   -n, --dry-run              : Show what would be done, without making any changes
+#
+# Example:
+#   ./build-deb.sh -v 1.5.5               # Build with version 1.5.5
+#
+# Prerequisites:
+# - The dpkg-buildpackage package must be installed (provides the dpkg-buildpackage command).
+# - The control file must exist at debian/control.
+#
+# Error Handling:
+# The script includes checks to ensure:
+# - The version option (-v or --version) is provided.
+# - The necessary commands are available.
+# - The control file exists at the specified location.
+# If any of these checks fail, the script exits with an appropriate error message.
+
+# Enable strict mode for better error handling
+set -euo pipefail
+
+# Default values
+VERSION=""
+RELEASE="1"
+DEBUG_BUILD=false
+
+# Function to display usage information
+usage() {
+  echo "Usage: $0 [-v <version>] [-h] [--dry-run]"
+  echo "  -v, --version <version>    : Specify the version (optional)"
+  echo "  -h, --help                 : Display this help and exit"

Review Comment:
   Could you please product debuginfo package as well ?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2771250690

   Hi, there is another issue to resolve: the `/tmp/init_system.sh` cannot be executed when the new image starts up. FYI.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2837353789

   Additionally, we can wait for @edespino to respond.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3284443837

   I created https://github.com/apache/cloudberry/pull/1359 in the main repo, these repo will be archived soon.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2778221268

   > Have you considered slimming the image using ubuntu:jammy-minimal?
   
   There is no jammy-minimal on docker.io )
   
   ```
   skopeo list-tags docker://docker.io/library/ubuntu
   {
       "Repository": "docker.io/library/ubuntu",
       "Tags": [
   ...
           "22.04",
           "22.10",
   ...
           "jammy",
           "jammy-20211029",
           "jammy-20211122",
           "jammy-20220101",
           "jammy-20220130",
           "jammy-20220301",
           "jammy-20220315",
           "jammy-20220404",
           "jammy-20220421",
           "jammy-20220428",
           "jammy-20220531",
           "jammy-20220801",
           "jammy-20220815",
           "jammy-20221003",
           "jammy-20221020",
           "jammy-20221101",
           "jammy-20221130",
           "jammy-20230126",
           "jammy-20230301",
           "jammy-20230308",
           "jammy-20230425",
           "jammy-20230522",
           "jammy-20230605",
           "jammy-20230624",
           "jammy-20230804",
           "jammy-20230816",
           "jammy-20230916",
           "jammy-20231004",
           "jammy-20231128",
           "jammy-20231211.1",
           "jammy-20240111",
           "jammy-20240125",
           "jammy-20240212",
           "jammy-20240227",
           "jammy-20240405",
           "jammy-20240416",
           "jammy-20240427",
           "jammy-20240530",
           "jammy-20240627.1",
           "jammy-20240808",
           "jammy-20240911.1",
           "jammy-20250126",
   ```
   
   The reason is that there is no need for jammy-minimal, here is the size of the images (not all, but interested ones)
   ```
   xifos@xifos-dev-bionic:~/git/cloudberry-devops/images/docker/cbdb/test/ubuntu22.04$ docker images
   REPOSITORY                TAG           IMAGE ID       CREATED             SIZE
   ubuntu                    22.04         a24be041d957   2 months ago        77.9MB
   ubuntu                    jammy         a24be041d957   2 months ago        77.9MB
   ubuntu                    22.10         692eb4a905c0   21 months ago       70.3MB
   ```
   
   Compare it with the build/test container size:
   ```
   xifos@xifos-dev-bionic:~/git/cloudberry-devops/images/docker/cbdb/test/ubuntu22.04$ docker images
   REPOSITORY                TAG           IMAGE ID       CREATED             SIZE
   cloudberry-db-build-env   latest        693ae32596fc   20 minutes ago      1.43GB
   cloudberry-db-test-env    latest        62f2e7df33d6   About an hour ago   286MB
   cbdb-main                 rockylinux9   7ee3e45c3ee1   4 months ago        1.89GB
   rockylinux/rockylinux     9             bb8a97547d22   4 months ago        234MB
   ```
   When compared to the size of a build container, a difference of a few megabytes is negligible.
   
   Guys here https://askubuntu.com/questions/1455012/where-can-i-find-ubuntu-minimal-22-04-docker-image also came to the similar conclusion.
   
   According to the https://canonical.com/blog/minimal-ubuntu-released minimal image actually is 22.04 LTS image
   They sad:
   
   > Tiny container base image
   > The 29MB Docker image for Minimal Ubuntu 18.04 LTS serves as a highly efficient container starting point, and allows developers to deploy multicloud containerized applications faster. For modern Docker workflows with Kubernetes, the minimal Ubuntu image provides a balance of compatibility, familiarity, performance and size. This is the standard Ubuntu 18.04 LTS image on the Docker Hub.
   
   So I switched from jammy to 22.04 base image (but they have the same image id, I don't think it matters)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2784876350

   > I'm done, PR could be reviewed
   
   Cool. I will help test today.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022127980


##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+  build-essential \
+  libssl-dev \
+  gnupg \
+  openssl \
+  debhelper \
+  libfakeroot \
+  debootstrap \
+  devscripts \
+  make \
+  equivs \
+  bison \
+  ca-certificates-java \
+  ca-certificates \
+  cmake \
+  curl \
+  cgroup-tools \
+  flex \
+  gcc-11 \
+  g++-11 \
+  g++-11-multilib \
+  git \
+  krb5-multidev \
+  libapr1-dev \
+  libbz2-dev \
+  libcurl4-gnutls-dev \
+  libpstreams-dev \
+  libxerces-c-dev \
+  libsystemd-dev \
+  libevent-dev \
+  libkrb5-dev \
+  libldap2-dev \
+  libperl-dev \
+  libreadline-dev \
+  libssl-dev \
+  libxml2-dev \
+  libyaml-dev \
+  libzstd-dev \
+  libaprutil1-dev \
+  libpam0g-dev \
+  libpam0g \
+  libcgroup1 \
+  libyaml-0-2 \
+  libldap-2.5-0 \
+  libssl3 \
+  ninja-build \
+  python-setuptools \
+  python3-setuptools \
+  quilt \
+  unzip \
+  wget \
+  zlib1g-dev \
+  libuv1-dev \
+  libgpgme-dev \
+  libgpgme11 \
+  python2.7 \
+  python2.7-dev \
+  pkg-config \
+  python3.10 \
+  python3.10-dev \
+  python3-distutils \
+  sudo

Review Comment:
   after testing, some packages are still needed to install for making ./configure and demo culseter successful:
   
   ```
   liblz4-dev
   iputils-ping 
   iproute2 
   rsync 
   less
   openssh-client
   openssh-server
   lsof
   ``` 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768901583

   **APT Flags & Repos**
   
       Problem: You're using --allow-unauthenticated and Acquire::AllowInsecureRepositories=true. This is not safe for production.
   
       Fix: Unless absolutely required (e.g., for local mirrors), remove these flags. If used, explain the context in a comment.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2754308349

   @edespino Could you please review my PR? I want to add deb packages to cloudberry and this is my first PR where I try to create Docker images.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2754455756

   Cool @leborchuk, thanks for your great work. I also would like to help review this PR. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2835553213

   @tuhaihe @edespino  we seem to have lost this PR. Is there anything else I can do here?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2837349182

   > @tuhaihe @edespino we seem to have lost this PR. Is there anything else I can do here?
   
   Hi @leborchuk, thanks for reaching out. I can support this PR with a +1. I've already tested it on the X86 machine, and it successfully passed all Cloudberry builds and tests. 
   
   However, I encountered a new issue: when testing it on my MacBook M1 machine, I received an error.
   
   ```
   11.79 E: Unable to locate package g++-11-multilib
   11.79 E: Couldn't find any package by regex 'g++-11-multilib'
   ```
   
   Seems the `g++-11-multilib` lacks the ARM support. That would be better to solve it before merging this PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2862212038

   > @leborchuk & @tuhaihe,
   > 
   > An alternative would be to close this PR and let me carry the changes forward. I’m happy to take that on and can also help guide any remaining updates through the CI landscape. I’ll make sure both of you are added as reviewers on all subsequent changes to keep you in the loop.
   
   Sounds good to me. Thanks dude.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2862192756

   @leborchuk & @tuhaihe,
   
   An alternative would be to close this PR and let me carry the changes forward. I’m happy to take that on and can also help guide any remaining updates through the CI landscape. I’ll make sure both of you are added as reviewers on all subsequent changes to keep you in the loop.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2866516483

   > @leborchuk & @tuhaihe,
   > 
   > An alternative would be to close this PR and let me carry the changes forward. I’m happy to take that on and can also help guide any remaining updates through the CI landscape. I’ll make sure both of you are added as reviewers on all subsequent changes to keep you in the loop.
   
   Ok, let's close these PRs. I know how the debian package should be done technically, but it would be better to speed things up here. I see @edespino has already deployed the future  deb creation prototype to https://github.com/edespino/cloudberry/tree/ubuntu-22.04 . Let's use it to put everything together. 
   
   Of course, I will be happy to participate in the review.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2778994044

   I found out that it's impossible to install debian binary to /usr/local directory. Debian package has special section to prevent a such danger action https://manpages.ubuntu.com/manpages/oracular/man1/dh_usrlocal.1.html
   
   It's due to debian policy https://www.debian.org/doc/debian-policy/ch-opersys.html#s9.1.2
   
   > As mandated by the FHS, packages must not place any files in /usr/local, either by putting them in the file system archive to be unpacked by dpkg or by manipulating them in their maintainer scripts.
   > However, the package may create empty directories below /usr/local so that the system administrator knows where to place site-specific files. 
   
   So I installed all cloudberry binaries to /usr/cloudberry-db and then in postinst script create symbolic link /usr/local/cloudberry-db -> /usr/cloudberry-db


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "yjhjstz (via GitHub)" <gi...@apache.org>.
yjhjstz commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2023275740


##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+  build-essential \
+  libssl-dev \
+  gnupg \
+  openssl \
+  debhelper \
+  libfakeroot \
+  debootstrap \
+  devscripts \
+  make \
+  equivs \
+  bison \
+  ca-certificates-java \
+  ca-certificates \
+  cmake \
+  curl \
+  cgroup-tools \
+  flex \
+  gcc-11 \
+  g++-11 \
+  g++-11-multilib \
+  git \
+  krb5-multidev \
+  libapr1-dev \
+  libbz2-dev \
+  libcurl4-gnutls-dev \
+  libpstreams-dev \
+  libxerces-c-dev \
+  libsystemd-dev \
+  libevent-dev \
+  libkrb5-dev \
+  libldap2-dev \
+  libperl-dev \
+  libreadline-dev \
+  libssl-dev \
+  libxml2-dev \
+  libyaml-dev \
+  libzstd-dev \
+  libaprutil1-dev \
+  libpam0g-dev \
+  libpam0g \
+  libcgroup1 \
+  libyaml-0-2 \
+  libldap-2.5-0 \
+  libssl3 \
+  ninja-build \
+  python-setuptools \
+  python3-setuptools \
+  quilt \
+  unzip \
+  wget \
+  zlib1g-dev \
+  libuv1-dev \
+  libgpgme-dev \
+  libgpgme11 \
+  python2.7 \
+  python2.7-dev \
+  pkg-config \
+  python3.10 \
+  python3.10-dev \
+  python3-distutils \
+  sudo
+
+RUN apt-get install -y locales && \
+    locale-gen "en_US.UTF-8" && \
+    update-locale LC_ALL="en_US.UTF-8"
+
+RUN cd && \
+    XERCES_LATEST_RELEASE=3.3.0 && \
+    wget -nv "https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" && \
+    echo "$(curl -sL https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz.sha256)" | sha256sum -c - && \
+    tar xf "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz"; rm "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" && \
+    cd xerces-c-${XERCES_LATEST_RELEASE} && \
+    ./configure --prefix=/usr/local/xerces-c && \
+    make -j$(nproc) && \
+    make install -C ~/xerces-c-${XERCES_LATEST_RELEASE} && \
+    rm -rf ~/xerces-c*
+
+RUN cd && GO_VERSION="go1.23.4" && \
+    ARCH=$(uname -m) && \
+    if [ "${ARCH}" = "aarch64" ]; then \
+        GO_ARCH="arm64" && \
+        GO_SHA256="16e5017863a7f6071363782b1b8042eb12c6ca4f4cd71528b2123f0a1275b13e"; \
+    elif [ "${ARCH}" = "x86_64" ]; then \
+        GO_ARCH="amd64" && \
+        GO_SHA256="6924efde5de86fe277676e929dc9917d466efa02fb934197bc2eba35d5680971"; \
+    else \
+        echo "Unsupported architecture: ${ARCH}" && exit 1; \
+    fi && \
+    GO_URL="https://go.dev/dl/${GO_VERSION}.linux-${GO_ARCH}.tar.gz" && \
+    wget -nv "${GO_URL}" && \
+    echo "${GO_SHA256}  ${GO_VERSION}.linux-${GO_ARCH}.tar.gz" | sha256sum -c - && \
+    tar xf "${GO_VERSION}.linux-${GO_ARCH}.tar.gz" && \
+    mv go "/usr/local/${GO_VERSION}" && \
+    ln -s "/usr/local/${GO_VERSION}" /usr/local/go && \
+    rm -f "${GO_VERSION}.linux-${GO_ARCH}.tar.gz" && \
+    echo 'export PATH=$PATH:/usr/local/go/bin' | tee -a /etc/profile.d/go.sh > /dev/null
+
+
+# --------------------------------------------------------------------
+# Copy Configuration Files and Setup the Environment
+# --------------------------------------------------------------------
+
+RUN ln -s /usr/bin/python2.7 /usr/bin/python

Review Comment:
   Can we upgrade python to python3 ?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3112479377

   Rebased to the new cloudberry-env file


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3114184988

   > Hey @leborchuk, would you like to start planning the migration of this repo to the main one, as discussed here: https://lists.apache.org/thread/p6otyrrnosg8fsbyr6ok7hl8wxpx4ss2? I think it would be better to open a new PR on the main after this repo's migration is complete. Otherwise, it could make the migration more difficult.
   > 
   > How about this?
   
   Well, do you think the time has come? Let's start it then) I will store scripts from this PR in my own repo, move this repo and fix building scripts, then open PR again


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022065110


##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName

Review Comment:
   Are these used for AWS uploading? If so, I think we are not using AWS in the workflow.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022129960


##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+        file \
+        gdb \
+        glibc-locale-source \

Review Comment:
   ```suggestion
           glibc-source \
   ```



##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+        file \
+        gdb \
+        glibc-locale-source \
+        make \
+        openssh \
+        openssh-clients \
+        openssh-server \
+        procps-ng \

Review Comment:
   ```suggestion
           procps \
   ```



##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,119 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+        file \
+        gdb \
+        glibc-locale-source \
+        make \
+        openssh \
+        openssh-clients \

Review Comment:
   ```suggestion
           openssh-client \
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022127980


##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+  build-essential \
+  libssl-dev \
+  gnupg \
+  openssl \
+  debhelper \
+  libfakeroot \
+  debootstrap \
+  devscripts \
+  make \
+  equivs \
+  bison \
+  ca-certificates-java \
+  ca-certificates \
+  cmake \
+  curl \
+  cgroup-tools \
+  flex \
+  gcc-11 \
+  g++-11 \
+  g++-11-multilib \
+  git \
+  krb5-multidev \
+  libapr1-dev \
+  libbz2-dev \
+  libcurl4-gnutls-dev \
+  libpstreams-dev \
+  libxerces-c-dev \
+  libsystemd-dev \
+  libevent-dev \
+  libkrb5-dev \
+  libldap2-dev \
+  libperl-dev \
+  libreadline-dev \
+  libssl-dev \
+  libxml2-dev \
+  libyaml-dev \
+  libzstd-dev \
+  libaprutil1-dev \
+  libpam0g-dev \
+  libpam0g \
+  libcgroup1 \
+  libyaml-0-2 \
+  libldap-2.5-0 \
+  libssl3 \
+  ninja-build \
+  python-setuptools \
+  python3-setuptools \
+  quilt \
+  unzip \
+  wget \
+  zlib1g-dev \
+  libuv1-dev \
+  libgpgme-dev \
+  libgpgme11 \
+  python2.7 \
+  python2.7-dev \
+  pkg-config \
+  python3.10 \
+  python3.10-dev \
+  python3-distutils \
+  sudo

Review Comment:
   after testing, some packages are still needed to install for making ./configure and demo culseter successful:
   
   ```
   liblz4-dev
   iputils-ping 
   iproute2 
   rsync 
   less
   openssh-client
   openssh-server
   ``` 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2149586324


##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,197 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:22.04
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+# Environment variables for locale and user
+ENV container=docker
+ENV LANG=en_US.UTF-8
+ENV USER=gpadmin
+ENV TZ=${TIMEZONE_VAR}
+ENV DEBIAN_FRONTEND=noninteractive
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+
+RUN sed -i "s/archive.ubuntu.com/mirror.yandex.ru/g" /etc/apt/sources.list && \

Review Comment:
   Hey, we can use the default source list. A chance that the Yandex mirror will be slow for other regions.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2755603167

   I found out that the deb package's dependencies included our internal python packages, so removed them.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2779401715

   @leborchuk If you don't mind me asking, what is your ultimate goal here? I assume you will also be introducing Ubuntu 22.04 into the Apache Cloudberry build and test processes. Is that correct?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768903579

   **Missing Cleanup**
   
       Problem: The APT cache and downloaded files (e.g., .tar.gz, build dirs) are not cleaned up, which bloats the image.
   
       Fix:
   
   RUN apt-get clean && rm -rf /var/lib/apt/lists/*
   
   Also clean /tmp/*, ~/xerces-c*, Go tarballs, etc., after use.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2772207957

   @leborchuk This is great progress — thanks for putting in the effort to bring Ubuntu 22.04 support to Cloudberry!
   
   That said, I’d really prefer to see this rolled out in more focused, logical chunks so each stage is easy to test, review, and validate independently. Something like:
   
   1. Developer workflow – Introduce base support for Ubuntu 22.04: container build image, compiler config, developer installcheck support. A developer should be able to build and run installcheck against main.
   2. CI build automation – Add a GitHub Actions workflow to build the Ubuntu 22.04 developer container image automatically.
   3. Release engineering workflow – Extend the container image to support .deb package creation. A developer should be able to build and produce a .deb file inside the image.
   4. QA workflow – Introduce a minimal runtime container image (based on Ubuntu 22.04) to install and validate the .deb package. This image should support basic Cloudberry functionality and simulate a QA-style install, including gpadmin setup and dependency resolution.
   
   Splitting the PR this way would make it easier for others to review and test each part without merging everything at once. Would you be open to restructuring the work along these lines?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk closed pull request #13: Add scripts for create ubuntu jammy docker file
URL: https://github.com/apache/cloudberry-devops-release/pull/13


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3101421907

   Tip: add here `libssh2-devel` after merging https://github.com/apache/cloudberry-devops-release/pull/27#pullrequestreview-3041510452


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2843927015

   Thanks, Ed. I will be back from holiday next Tuesday and will test it then.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2015411195


##########
build_automation/cloudberry/scripts/configure-cloudberry.sh:
##########
@@ -96,22 +96,23 @@ export LOG_DIR="${SRC_DIR}/build-logs"
 CONFIGURE_LOG="${LOG_DIR}/configure.log"
 
 # Initialize environment
-init_environment "Cloudberry Configure Script" "${CONFIGURE_LOG}"
+init_environment "Cloudberry Configure Script" "${CONFIGURE_LOG}" "${BUILD_DESTINATION}"
 
 # Initial setup
 log_section "Initial Setup"
-execute_cmd sudo rm -rf /usr/local/cloudberry-db || exit 2
+execute_cmd sudo rm -rf ${BUILD_DESTINATION}/* || exit 2
 execute_cmd sudo chmod a+w /usr/local || exit 2
-execute_cmd mkdir -p /usr/local/cloudberry-db/lib || exit 2
+execute_cmd sudo mkdir -p ${BUILD_DESTINATION}/lib || exit 2
+execute_cmd sudo chown -R gpadmin:gpadmin ${BUILD_DESTINATION} || exit 2

Review Comment:
   Is line 106 the same as line 110?



##########
.github/workflows/docker-cbdb-build-containers.yml:
##########
@@ -76,7 +76,7 @@ jobs:
     # Matrix strategy to build for both Rocky Linux 8 and 9
     strategy:
       matrix:
-        platform: ['rocky8', 'rocky9']
+        platform: ['rocky8', 'rocky9', 'jammy']

Review Comment:
   It would be clearer to change the `jammy` to `ubuntu22.04`.



##########
packaging/deb/jammy/debian/control:
##########
@@ -0,0 +1,101 @@
+Source: apache-cloudberry-db-incubating
+Maintainer: open-gpdb dev team https://github.com/open-gpdb/gpdb

Review Comment:
   ```suggestion
   Maintainer: Apache Cloudberry (Incubating) https://cloudberry.apache.org
   ```



##########
packaging/deb/jammy/debian/rules:
##########
@@ -0,0 +1,49 @@
+#!/usr/bin/make -f
+
+DH_VERBOSE = 1
+DPKG_EXPORT_BUILDFLAGS = 1
+
+GPDB_BIN_PATH := /usr/local/cloudberry-db

Review Comment:
   ```suggestion
   CBDB_BIN_PATH := /usr/local/cloudberry-db
   ```



##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment

Review Comment:
   ```suggestion
   # Dockerfile for Apache Cloudberry Base Environment
   ```



##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Cloudberry Database. It installs

Review Comment:
   ```suggestion
   # a base environment for evaluating the Apache Cloudberry. It installs
   ```



##########
packaging/deb/jammy/debian/rules:
##########
@@ -0,0 +1,49 @@
+#!/usr/bin/make -f
+
+DH_VERBOSE = 1
+DPKG_EXPORT_BUILDFLAGS = 1
+
+GPDB_BIN_PATH := /usr/local/cloudberry-db
+DEBIAN_DESTINATION := $(shell pwd)/debian/build
+
+# assumes that CWD is root of gpdb source
+GPDB_PKG_VERSION := $(GPDB_PKG_VERSION)
+PACKAGE_GPDB := $(shell cat debian/control | egrep "^Package: " | cut -d " " -f 2)
+PATH := ${DEBIAN_DESTINATION}/bin:${PATH}
+
+.PHONY: gpinstall
+
+include /usr/share/dpkg/default.mk
+
+%:
+	dh $@ --parallel
+
+gpinstall:
+	make install
+
+override_dh_auto_install: gpinstall
+	# the staging directory for creating a debian is NOT the right GPHOME.
+	# change GPHOME to point to the post-install target install directory.
+	sed -i "s#GPHOME=.*#GPHOME=${GPDB_BIN_PATH}#g" ${DEBIAN_DESTINATION}/greenplum_path.sh
+
+override_dh_auto_build:
+	echo "Skipping build"
+
+override_dh_auto_clean:
+	echo "Skipping clean"
+
+override_dh_auto_configure:
+	echo "Skipping configure"
+
+override_dh_auto_test:
+	echo "Skipping auto test"
+
+override_dh_gencontrol:
+	echo "using version ${GPDB_PKG_VERSION} for binary GPDB"

Review Comment:
   ```suggestion
   	echo "using version ${GPDB_PKG_VERSION} for binary Cloudberry"
   ```



##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Cloudberry Database. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Cloudberry
+# Database DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+  build-essential \
+  libssl-dev \
+  gnupg \
+  openssl \
+  debhelper \
+  libfakeroot \
+  debootstrap \
+  devscripts \
+  make \
+  equivs \
+  bison \
+  ca-certificates-java \
+  ca-certificates \
+  cmake \
+  curl \
+  cgroup-tools \
+  flex \
+  gcc-11 \
+  g++-11 \
+  g++-11-multilib \
+  git \
+  krb5-multidev \
+  libapr1-dev \
+  libbz2-dev \
+  libcurl4-gnutls-dev \
+  libpstreams-dev \
+  libxerces-c-dev \
+  libsystemd-dev \
+  libevent-dev \
+  libkrb5-dev \
+  libldap2-dev \
+  libperl-dev \
+  libreadline-dev \
+  libssl-dev \
+  libxml2-dev \
+  libyaml-dev \
+  libzstd-dev \
+  libaprutil1-dev \
+  libpam0g-dev \
+  libpam0g \
+  libcgroup1 \
+  libyaml-0-2 \
+  libldap-2.5-0 \
+  libssl3 \
+  ninja-build \
+  python-setuptools \
+  python3-setuptools \
+  quilt \
+  unzip \
+  wget \
+  zlib1g-dev \
+  libuv1-dev \
+  libgpgme-dev \
+  libgpgme11 \
+  python2.7 \
+  python2.7-dev \
+  pkg-config \
+  python3.10 \
+  python3.10-dev \
+  python3-distutils \
+  sudo
+
+RUN apt-get install -y locales \
+&& locale-gen "en_US.UTF-8" \
+&& update-locale LC_ALL="en_US.UTF-8"
+
+RUN cd \
+&& XERCES_LATEST_RELEASE=3.3.0 \
+&& wget -nv "https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" \
+&& echo "$(curl -sL https://archive.apache.org/dist/xerces/c/3/sources/xerces-c-${XERCES_LATEST_RELEASE}.tar.gz.sha256)" | sha256sum -c - \
+&& tar xf "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz"; rm "xerces-c-${XERCES_LATEST_RELEASE}.tar.gz" \
+&& cd xerces-c-${XERCES_LATEST_RELEASE} \
+&& ./configure --prefix=/usr/local/xerces-c \
+&& make -j \

Review Comment:
   `make -j$(nproc)` will be more efficent.



##########
images/docker/cbdb/build/jammy/Dockerfile:
##########
@@ -0,0 +1,204 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Cloudberry Database Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Cloudberry Database. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Cloudberry
+# Database DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/Europe/London /etc/localtime && echo $TIMEZONE_VAR > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update -o Acquire::AllowInsecureRepositories=true && apt-get install -y --no-install-recommends --allow-unauthenticated \
+  build-essential \
+  libssl-dev \
+  gnupg \
+  openssl \
+  debhelper \
+  libfakeroot \
+  debootstrap \
+  devscripts \
+  make \
+  equivs \
+  bison \
+  ca-certificates-java \
+  ca-certificates \
+  cmake \
+  curl \
+  cgroup-tools \
+  flex \
+  gcc-11 \
+  g++-11 \
+  g++-11-multilib \
+  git \
+  krb5-multidev \
+  libapr1-dev \
+  libbz2-dev \
+  libcurl4-gnutls-dev \
+  libpstreams-dev \
+  libxerces-c-dev \
+  libsystemd-dev \
+  libevent-dev \
+  libkrb5-dev \
+  libldap2-dev \
+  libperl-dev \
+  libreadline-dev \
+  libssl-dev \
+  libxml2-dev \
+  libyaml-dev \
+  libzstd-dev \
+  libaprutil1-dev \
+  libpam0g-dev \
+  libpam0g \
+  libcgroup1 \
+  libyaml-0-2 \
+  libldap-2.5-0 \
+  libssl3 \
+  ninja-build \
+  python-setuptools \
+  python3-setuptools \
+  quilt \
+  unzip \
+  wget \
+  zlib1g-dev \
+  libuv1-dev \
+  libgpgme-dev \
+  libgpgme11 \
+  python2.7 \
+  python2.7-dev \
+  pkg-config \
+  python3.10 \
+  python3.10-dev \
+  python3-distutils \
+  sudo
+
+RUN apt-get install -y locales \
+&& locale-gen "en_US.UTF-8" \

Review Comment:
   IMO, we can place `&&` at the end of the command line, which will be easier for human reading. FYI.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-3125116638

   > > Hey @leborchuk, would you like to start planning the migration of this repo to the main one, as discussed here: https://lists.apache.org/thread/p6otyrrnosg8fsbyr6ok7hl8wxpx4ss2? I think it would be better to open a new PR on the main after this repo's migration is complete. Otherwise, it could make the migration more difficult.
   > > How about this?
   > 
   > Well, do you think the time has come? Let's start it then) I will store scripts from this PR in my own repo, move this repo and fix building scripts, then open PR again
   
   I think it's good to start the plan and move forward now. We can have a discussion about it and see how to reorganize these files in the main repo, then we can take actions. Sounds good?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768902669

   **Duplicate Packages**
   
       libssl-dev appears twice in the APT list.
   
       libaprutil1-dev and libuv1-dev are also later reinstalled under gpadmin.
   
   Fix: Install once globally under root and avoid duplication unless version/context differs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768905664

   **Timezone hardcoding**
   
       ln -snf /usr/share/zoneinfo/Europe/London is hardcoded, even though you have TIMEZONE_VAR.
       
   Fix: Use the variable:
       
       RUN ln -snf /usr/share/zoneinfo/${TIMEZONE_VAR} /etc/localtime && echo "${TIMEZONE_VAR}" > /etc/timezone
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768907488

   Repetitive locale settings
   
       You run locale-gen and update-locale multiple times.
   
       Fix: Consolidate to a single layer.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "edespino (via GitHub)" <gi...@apache.org>.
edespino commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2768910747

   Have you considered slimming the image using ubuntu:jammy-minimal?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2022565519


##########
images/docker/cbdb/build/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,203 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache Cloudberry
+# DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:jammy
+
+ARG accessKeyId
+ARG secretAccessKey
+ARG bucketName

Review Comment:
   I build the image by removing these 3 lines, with any negative effects.
   
   We also need to add the following env to make the test happy:
   
   ```
   ENV USER=gpadmin
   ```
   
    



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk commented on PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#issuecomment-2783886483

   
   > @leborchuk I’ve put together a reference implementation for item 1 — enabling the Ubuntu 22.04 developer workflow — here:
   > 
   > 🔗 [edespino@7ccbabe](https://github.com/edespino/cloudberry-devops-release/commit/7ccbabe6ad7441d25a38f3f72c8683518564ea16)
   > 
   > The idea is to isolate just the base container build and ensure that developers can build, install, and run installcheck against Cloudberry main. Once this is in place, we can iterate cleanly on GitHub Actions, packaging, and test image support in follow-on steps. Let me know what you think!
   
   @edespino Thank you, I see forgotten test_cloudberry_db_env.py script. I have added it and ensured that it works correctly.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "tuhaihe (via GitHub)" <gi...@apache.org>.
tuhaihe commented on code in PR #13:
URL: https://github.com/apache/cloudberry-devops-release/pull/13#discussion_r2032481236


##########
images/docker/cbdb/test/ubuntu22.04/Dockerfile:
##########
@@ -0,0 +1,118 @@
+# --------------------------------------------------------------------
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed
+# with this work for additional information regarding copyright
+# ownership. The ASF licenses this file to You under the Apache
+# License, Version 2.0 (the "License"); you may not use this file
+# except in compliance with the License. You may obtain a copy of the
+# License at
+#
+#    http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+# implied. See the License for the specific language governing
+# permissions and limitations under the License.
+#
+# --------------------------------------------------------------------
+#
+# Apache Cloudberry (incubating) is an effort undergoing incubation at
+# the Apache Software Foundation (ASF), sponsored by the Apache
+# Incubator PMC.
+#
+# Incubation is required of all newly accepted projects until a
+# further review indicates that the infrastructure, communications,
+# and decision making process have stabilized in a manner consistent
+# with other successful ASF projects.
+#
+# While incubation status is not necessarily a reflection of the
+# completeness or stability of the code, it does indicate that the
+# project has yet to be fully endorsed by the ASF.
+#
+# --------------------------------------------------------------------
+# Dockerfile for Apache Cloudberry Base Environment
+# --------------------------------------------------------------------
+# This Dockerfile sets up a Ubuntu jammy 22.04 -based container to serve as
+# a base environment for evaluating the Apache Cloudberry. It installs
+# necessary system utilities, configures the environment for SSH access,
+# and sets up a 'gpadmin' user with sudo privileges. The Apache
+# Cloudberry DEB can be installed into this container for testing and
+# functional verification.
+#
+# Key Features:
+# - Locale setup for en_US.UTF-8
+# - SSH daemon setup for remote access
+# - Essential system utilities installation
+# - Separate user creation and configuration steps
+#
+# Security Considerations:
+# - This Dockerfile prioritizes ease of use for functional testing and
+#   evaluation. It includes configurations such as passwordless sudo access
+#   for the 'gpadmin' user and SSH access with password authentication.
+# - These configurations are suitable for testing and development but
+#   should NOT be used in a production environment due to potential security
+#   risks.
+#
+# Usage:
+#   docker build -t cloudberry-db-base-env .
+#   docker run -h cdw -it cloudberry-db-base-env
+# --------------------------------------------------------------------
+
+FROM ubuntu:22.04
+
+# Argument for configuring the timezone
+ARG TIMEZONE_VAR="Europe/London"
+
+SHELL ["/bin/bash", "-o", "pipefail", "-c"]
+ENV DEBIAN_FRONTEND=noninteractive
+ENV DEBCONF_NOWARNINGS="yes"
+
+RUN stat -fc %T /sys/fs/cgroup/
+
+RUN ln -snf /usr/share/zoneinfo/${TIMEZONE_VAR} /etc/localtime && echo "${TIMEZONE_VAR}" > /etc/timezone
+
+# --------------------------------------------------------------------
+# Install Development Tools and Utilities
+# --------------------------------------------------------------------
+RUN apt-get update && apt-get install -y --no-install-recommends \
+        file \
+        gdb \
+        glibc-source \
+        make \
+        openssh-client \
+        openssh-server \
+        procps \
+        sudo \
+        net-tools \
+        python-pip \
+        python-six
+
+RUN apt-get install -y locales && \
+    locale-gen "en_US.UTF-8" && \
+    update-locale LC_ALL="en_US.UTF-8"
+
+# --------------------------------------------------------------------
+# Copy Configuration Files and Setup the Environment
+# --------------------------------------------------------------------
+
+RUN ln -s /usr/bin/python2.7 /usr/bin/python

Review Comment:
   ```suggestion
   RRUN ln -s /usr/bin/python3.10 /usr/bin/python
   ```
   
   Similar to the build Dockerfile? FYI



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org


Re: [PR] Add scripts for create ubuntu jammy docker file [cloudberry-devops-release]

Posted by "leborchuk (via GitHub)" <gi...@apache.org>.
leborchuk closed pull request #13: Add scripts for create ubuntu jammy docker file
URL: https://github.com/apache/cloudberry-devops-release/pull/13


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cloudberry.apache.org
For additional commands, e-mail: commits-help@cloudberry.apache.org