You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "kevinjqliu (via GitHub)" <gi...@apache.org> on 2024/12/01 19:42:02 UTC
[PR] automate building Release Candidate in github action [iceberg-python]
kevinjqliu opened a new pull request, #1391:
URL: https://github.com/apache/iceberg-python/pull/1391
This PR changes `.github/workflows/python-release.yml` to build the artifacts for both svn and pypi.
* Add required input fields for `version` and `rc`
* Validate input format and current library version
* Changed `actions/checkout@v4` `fetch-depth` from `0` to `1` to fetch only a single commit (fetch-depth 0 fetch all history for all branches and tags)
* PyPi build sets the version to one with RC (same behavior as before)
* SVN build also generates checksum and signature files
* Final artifact is `svn-release-candidate-{RC}` and `pypi-release-candidate-{RC}`
TODO
* Change github action to run against tag push (e.g. `0.8.1rc1` tag)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938564633
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,192 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
Review Comment:
yep the `else` branch on L60 handles the workflow-dispatch part
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938565110
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,192 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
+ TAG=${GITHUB_REF#refs/tags/} # Extract the tag name
+ VERSION_AND_RC=${TAG#pyiceberg-} # Remove the 'pyiceberg-' prefix
+ VERSION=${VERSION_AND_RC%rc*} # Extract VERSION by removing everything after 'rc'
+ RC=${VERSION_AND_RC#*rc} # Extract RC by keeping everything after 'rc'
+
+ if [[ -z "$VERSION" || -z "$RC" ]]; then
+ echo "Error: Unable to parse VERSION or RC from tag ($TAG). Ensure the tag format is correct."
+ exit 1
+ fi
+ else
+ echo "Workflow triggered manually via workflow_dispatch."
+ VERSION="${{ github.event.inputs.version }}"
+ RC="${{ github.event.inputs.rc }}"
+
+ # Validate version (e.g., 1.0.0)
+ if [[ ! "$VERSION" =~ ^[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
+ echo "Error: version ($VERSION) must be in the format: <number>.<number>.<number>"
+ exit 1
+ fi
+
+ # Validate rc (e.g., 1)
+ if [[ ! "$RC" =~ ^[0-9]+$ ]]; then
+ echo "Error: rc ($RC) must be in the format: <number>"
+ exit 1
+ fi
+ fi
+
+ # Export variables for future steps
+ echo "VERSION=$VERSION" >> $GITHUB_OUTPUT
+ echo "RC=$RC" >> $GITHUB_OUTPUT
+
+ - name: Display Extracted Version and RC
+ run: |
+ echo "Using Version: ${{ steps.validate-inputs.outputs.VERSION }}"
+ echo "Using RC: ${{ steps.validate-inputs.outputs.RC }}"
+
+ validate-library-version:
+ runs-on: ubuntu-latest
+ needs:
+ - validate-inputs
+ steps:
+ - uses: actions/checkout@v4
+ with:
+ fetch-depth: 1
+
+ - uses: actions/setup-python@v5
+ with:
+ python-version: 3.12
+
+ - name: Install Poetry
+ run: |
+ pip install poetry
Review Comment:
good catch! changed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#issuecomment-2629550063
Thanks for the review @Fokko :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938574146
##########
mkdocs/docs/how-to-release.md:
##########
@@ -109,66 +109,81 @@ Create a signed tag:
Replace `VERSION` and `RC` with the appropriate values for the release.
```bash
-export RC=rc1
-export VERSION=0.7.0${RC}
-export VERSION_WITHOUT_RC=${VERSION/rc?/}
-export VERSION_BRANCH=${VERSION_WITHOUT_RC//./-}
-export GIT_TAG=pyiceberg-${VERSION}
+export VERSION=0.7.0
+export RC=1
-git tag -s ${GIT_TAG} -m "PyIceberg ${VERSION}"
+export VERSION_WITH_RC=${VERSION}rc${RC}
+export GIT_TAG=pyiceberg-${VERSION_WITH_RC}
+
+git tag -s ${GIT_TAG} -m "PyIceberg ${VERSION_WITH_RC}"
git push git@github.com:apache/iceberg-python.git ${GIT_TAG}
```
-### Publish Release Candidate (RC)
+### Create Artifacts
-#### Upload to Apache Dev SVN
+The [`Python Build Release Candidate` Github Action](https://github.com/apache/iceberg-python/actions/workflows/python-release.yml) will run automatically upon tag push.
-##### Create Artifacts for SVN
+This action will generate artifacts that will include both source distribution (`sdist`) and binary distributions (`wheels` using [`cibuildwheel`](https://github.com/pypa/cibuildwheel)) for each architectures.
-Run the [`Python release` Github Action](https://github.com/apache/iceberg-python/actions/workflows/python-release.yml).
+This action will generate two final artifacts:
-* Tag: Use the newly created tag.
-* Version: Set the `version` to `main`, as the source cannot be modified.
+* `svn-release-candidate-${VERSION}rc${RC}` for SVN
+* `pypi-release-candidate-${VERSION}rc${RC}` for PyPi
-
+If `gh` is available, watch the GitHub Action progress using:
Review Comment:
Love it!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938572601
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,192 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
Review Comment:
Ah, missed the identation 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu merged PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938573122
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,118 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
+ TAG=${GITHUB_REF#refs/tags/} # Extract the tag name
+ VERSION_AND_RC=${TAG#pyiceberg-} # Remove the 'pyiceberg-' prefix
+ VERSION=${VERSION_AND_RC%rc*} # Extract VERSION by removing everything after 'rc'
+ RC=${VERSION_AND_RC#*rc} # Extract RC by keeping everything after 'rc'
+
+ if [[ -z "$VERSION" || -z "$RC" ]]; then
+ echo "Error: Unable to parse VERSION or RC from tag ($TAG). Ensure the tag format is correct."
+ exit 1
+ fi
+ else
+ echo "Workflow triggered manually via workflow_dispatch."
+ VERSION="${{ github.event.inputs.version }}"
+ RC="${{ github.event.inputs.rc }}"
+
+ # Validate version (e.g., 1.0.0)
+ if [[ ! "$VERSION" =~ ^[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
+ echo "Error: version ($VERSION) must be in the format: <number>.<number>.<number>"
+ exit 1
+ fi
+
+ # Validate rc (e.g., 1)
+ if [[ ! "$RC" =~ ^[0-9]+$ ]]; then
+ echo "Error: rc ($RC) must be in the format: <number>"
+ exit 1
+ fi
+ fi
+
+ # Export variables for future steps
+ echo "VERSION=$VERSION" >> $GITHUB_OUTPUT
+ echo "RC=$RC" >> $GITHUB_OUTPUT
+
+ - name: Display Extracted Version and RC
+ run: |
+ echo "Using Version: ${{ steps.validate-inputs.outputs.VERSION }}"
+ echo "Using RC: ${{ steps.validate-inputs.outputs.RC }}"
+
+ validate-library-version:
+ runs-on: ubuntu-latest
+ needs:
+ - validate-inputs
+ steps:
+ - uses: actions/checkout@v4
+ with:
+ fetch-depth: 1
+
+ - uses: actions/setup-python@v5
+ with:
+ python-version: 3.12
+
+ - name: Install Poetry
+ run: make install-poetry
+
+ - name: Validate current pyiceberg version
+ env:
+ VERSION: ${{ needs.validate-inputs.outputs.VERSION }}
+ run: |
+ # Extract the current version from Poetry
+ current_pyiceberg_version=$(poetry version --short)
+ echo "Detected Poetry version: $current_pyiceberg_version"
+
+ # Compare the input version with the Poetry version
+ if [[ "$VERSION" != "$current_pyiceberg_version" ]]; then
+ echo "Error: Input version ($VERSION) does not match the Poetry version ($current_pyiceberg_version)"
+ exit 1
+ fi
+
+ # SVN
+ svn_build_artifacts:
Review Comment:
For consistency, should we use dashes here?
```suggestion
svn-build-artifacts:
```
Same for some other jobs below
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938573122
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,118 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
+ TAG=${GITHUB_REF#refs/tags/} # Extract the tag name
+ VERSION_AND_RC=${TAG#pyiceberg-} # Remove the 'pyiceberg-' prefix
+ VERSION=${VERSION_AND_RC%rc*} # Extract VERSION by removing everything after 'rc'
+ RC=${VERSION_AND_RC#*rc} # Extract RC by keeping everything after 'rc'
+
+ if [[ -z "$VERSION" || -z "$RC" ]]; then
+ echo "Error: Unable to parse VERSION or RC from tag ($TAG). Ensure the tag format is correct."
+ exit 1
+ fi
+ else
+ echo "Workflow triggered manually via workflow_dispatch."
+ VERSION="${{ github.event.inputs.version }}"
+ RC="${{ github.event.inputs.rc }}"
+
+ # Validate version (e.g., 1.0.0)
+ if [[ ! "$VERSION" =~ ^[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
+ echo "Error: version ($VERSION) must be in the format: <number>.<number>.<number>"
+ exit 1
+ fi
+
+ # Validate rc (e.g., 1)
+ if [[ ! "$RC" =~ ^[0-9]+$ ]]; then
+ echo "Error: rc ($RC) must be in the format: <number>"
+ exit 1
+ fi
+ fi
+
+ # Export variables for future steps
+ echo "VERSION=$VERSION" >> $GITHUB_OUTPUT
+ echo "RC=$RC" >> $GITHUB_OUTPUT
+
+ - name: Display Extracted Version and RC
+ run: |
+ echo "Using Version: ${{ steps.validate-inputs.outputs.VERSION }}"
+ echo "Using RC: ${{ steps.validate-inputs.outputs.RC }}"
+
+ validate-library-version:
+ runs-on: ubuntu-latest
+ needs:
+ - validate-inputs
+ steps:
+ - uses: actions/checkout@v4
+ with:
+ fetch-depth: 1
+
+ - uses: actions/setup-python@v5
+ with:
+ python-version: 3.12
+
+ - name: Install Poetry
+ run: make install-poetry
+
+ - name: Validate current pyiceberg version
+ env:
+ VERSION: ${{ needs.validate-inputs.outputs.VERSION }}
+ run: |
+ # Extract the current version from Poetry
+ current_pyiceberg_version=$(poetry version --short)
+ echo "Detected Poetry version: $current_pyiceberg_version"
+
+ # Compare the input version with the Poetry version
+ if [[ "$VERSION" != "$current_pyiceberg_version" ]]; then
+ echo "Error: Input version ($VERSION) does not match the Poetry version ($current_pyiceberg_version)"
+ exit 1
+ fi
+
+ # SVN
+ svn_build_artifacts:
Review Comment:
For consistency, should we use dashes here?
```suggestion
svn-build-artifacts:
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#issuecomment-2629549886
had to add an unrelated change in `mkdocs/docs/api.md`. The url referenced is dead, causing CI to fail
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#issuecomment-2630045458
Any time, sorry for taking so long :3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#issuecomment-2521310260
@Fokko could you take a look at this PR when you get a chance?
I tested the new action and instructions via my fork, had to push this branch to `main` on my fork in order to run the GitHub Action.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938561415
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,192 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
+ TAG=${GITHUB_REF#refs/tags/} # Extract the tag name
+ VERSION_AND_RC=${TAG#pyiceberg-} # Remove the 'pyiceberg-' prefix
+ VERSION=${VERSION_AND_RC%rc*} # Extract VERSION by removing everything after 'rc'
+ RC=${VERSION_AND_RC#*rc} # Extract RC by keeping everything after 'rc'
+
+ if [[ -z "$VERSION" || -z "$RC" ]]; then
+ echo "Error: Unable to parse VERSION or RC from tag ($TAG). Ensure the tag format is correct."
+ exit 1
+ fi
+ else
+ echo "Workflow triggered manually via workflow_dispatch."
+ VERSION="${{ github.event.inputs.version }}"
+ RC="${{ github.event.inputs.rc }}"
+
+ # Validate version (e.g., 1.0.0)
+ if [[ ! "$VERSION" =~ ^[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
+ echo "Error: version ($VERSION) must be in the format: <number>.<number>.<number>"
+ exit 1
+ fi
+
+ # Validate rc (e.g., 1)
+ if [[ ! "$RC" =~ ^[0-9]+$ ]]; then
+ echo "Error: rc ($RC) must be in the format: <number>"
+ exit 1
+ fi
+ fi
+
+ # Export variables for future steps
+ echo "VERSION=$VERSION" >> $GITHUB_OUTPUT
+ echo "RC=$RC" >> $GITHUB_OUTPUT
+
+ - name: Display Extracted Version and RC
+ run: |
+ echo "Using Version: ${{ steps.validate-inputs.outputs.VERSION }}"
+ echo "Using RC: ${{ steps.validate-inputs.outputs.RC }}"
+
+ validate-library-version:
+ runs-on: ubuntu-latest
+ needs:
+ - validate-inputs
+ steps:
+ - uses: actions/checkout@v4
+ with:
+ fetch-depth: 1
+
+ - uses: actions/setup-python@v5
+ with:
+ python-version: 3.12
+
+ - name: Install Poetry
+ run: |
+ pip install poetry
Review Comment:
Should we reuse `make install-poetry` here? In the Makefile we pin the version of Poetry
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938560927
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,192 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
Review Comment:
This also runs on workflow-dispatch, right?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938560759
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,192 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
Review Comment:
👍 In line with the current tags: https://github.com/apache/iceberg-python/tags
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] automate building Release Candidate in github action [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on code in PR #1391:
URL: https://github.com/apache/iceberg-python/pull/1391#discussion_r1938565110
##########
.github/workflows/python-release.yml:
##########
@@ -17,29 +17,192 @@
# under the License.
#
-name: "Python Release"
+name: "Python Build Release Candidate"
on:
+ push:
+ tags:
+ # Trigger this workflow when tag follows the versioning format: pyiceberg-<major>.<minor>.<patch>rc<release_candidate>
+ # Example valid tags: pyiceberg-0.8.0rc2, pyiceberg-1.0.0rc1
+ - 'pyiceberg-[0-9]+.[0-9]+.[0-9]+rc[0-9]+'
workflow_dispatch:
inputs:
version:
- description: 'Version'
+ description: 'Version (e.g., 0.8.0)'
type: string
- default: 'main'
-
+ required: true
+ rc:
+ description: 'Release Candidate (RC) (e.g., 1)'
+ type: number
+ required: true
jobs:
- build_wheels:
- name: Build wheels on ${{ matrix.os }}
+ validate-inputs:
+ runs-on: ubuntu-latest
+ outputs:
+ VERSION: ${{ steps.validate-inputs.outputs.VERSION }} # e.g. 0.8.0
+ RC: ${{ steps.validate-inputs.outputs.RC }} # e.g. 1
+ steps:
+ - name: Validate and Extract Version and RC
+ id: validate-inputs
+ run: |
+ if [ "$GITHUB_EVENT_NAME" = "push" ]; then
+ echo "Workflow triggered by tag push."
+ TAG=${GITHUB_REF#refs/tags/} # Extract the tag name
+ VERSION_AND_RC=${TAG#pyiceberg-} # Remove the 'pyiceberg-' prefix
+ VERSION=${VERSION_AND_RC%rc*} # Extract VERSION by removing everything after 'rc'
+ RC=${VERSION_AND_RC#*rc} # Extract RC by keeping everything after 'rc'
+
+ if [[ -z "$VERSION" || -z "$RC" ]]; then
+ echo "Error: Unable to parse VERSION or RC from tag ($TAG). Ensure the tag format is correct."
+ exit 1
+ fi
+ else
+ echo "Workflow triggered manually via workflow_dispatch."
+ VERSION="${{ github.event.inputs.version }}"
+ RC="${{ github.event.inputs.rc }}"
+
+ # Validate version (e.g., 1.0.0)
+ if [[ ! "$VERSION" =~ ^[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
+ echo "Error: version ($VERSION) must be in the format: <number>.<number>.<number>"
+ exit 1
+ fi
+
+ # Validate rc (e.g., 1)
+ if [[ ! "$RC" =~ ^[0-9]+$ ]]; then
+ echo "Error: rc ($RC) must be in the format: <number>"
+ exit 1
+ fi
+ fi
+
+ # Export variables for future steps
+ echo "VERSION=$VERSION" >> $GITHUB_OUTPUT
+ echo "RC=$RC" >> $GITHUB_OUTPUT
+
+ - name: Display Extracted Version and RC
+ run: |
+ echo "Using Version: ${{ steps.validate-inputs.outputs.VERSION }}"
+ echo "Using RC: ${{ steps.validate-inputs.outputs.RC }}"
+
+ validate-library-version:
+ runs-on: ubuntu-latest
+ needs:
+ - validate-inputs
+ steps:
+ - uses: actions/checkout@v4
+ with:
+ fetch-depth: 1
+
+ - uses: actions/setup-python@v5
+ with:
+ python-version: 3.12
+
+ - name: Install Poetry
+ run: |
+ pip install poetry
Review Comment:
good catch! changed
we use `make install-poetry` in other places for github action
https://grep.app/search?f.repo=apache%2Ficeberg-python&f.repo.pattern=iceberg-python&q=make+install-poetry
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org