You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2026/03/10 01:15:43 UTC
(airflow-site-archive) branch add-registry-to-github-to-s3 created (now b6842208858)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch add-registry-to-github-to-s3
in repository https://gitbox.apache.org/repos/asf/airflow-site-archive.git
at b6842208858 Add registry sync to github-to-s3 workflow
This branch includes the following new commits:
new b6842208858 Add registry sync to github-to-s3 workflow
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
(airflow-site-archive) 01/01: Add registry sync to github-to-s3 workflow
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch add-registry-to-github-to-s3
in repository https://gitbox.apache.org/repos/asf/airflow-site-archive.git
commit b6842208858ef72d2385f48399bdf8da5defac3d
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Tue Mar 10 01:15:30 2026 +0000
Add registry sync to github-to-s3 workflow
The s3-to-github workflow already syncs registry files (S3 → GitHub),
but the reverse direction (GitHub → S3) was missing. Add a sync-registry
input and a step to sync registry-archive/ to the registry/ path in S3,
mirroring the pattern used in s3-to-github.yml.
---
.github/workflows/github-to-s3.yml | 15 +++++++++++++++
1 file changed, 15 insertions(+)
diff --git a/.github/workflows/github-to-s3.yml b/.github/workflows/github-to-s3.yml
index 1a087df4fe7..4c304349f7a 100644
--- a/.github/workflows/github-to-s3.yml
+++ b/.github/workflows/github-to-s3.yml
@@ -43,6 +43,11 @@ on: # yamllint disable-line rule:truthy
required: false
default: false
type: boolean
+ sync-registry:
+ description: "Sync registry files to S3"
+ required: false
+ default: true
+ type: boolean
processes:
description: "Number of processes to use for syncing"
required: false
@@ -72,8 +77,10 @@ jobs:
set -x
if [[ "${DESTINATION}" == "live" ]]; then
echo "destination-location=s3://live-docs-airflow-apache-org/docs/" >> ${GITHUB_OUTPUT}
+ echo "registry-destination-location=s3://live-docs-airflow-apache-org/registry/" >> ${GITHUB_OUTPUT}
else
echo "destination-location=s3://staging-docs-airflow-apache-org/docs/" >> ${GITHUB_OUTPUT}
+ echo "registry-destination-location=s3://staging-docs-airflow-apache-org/registry/" >> ${GITHUB_OUTPUT}
fi
if [[ "${FULL_SYNC}" == "true" ]] ; then
echo "sync-type=full-sync" >> ${GITHUB_OUTPUT}
@@ -152,6 +159,7 @@ jobs:
packages="all"
echo "docs-archive" >> ${GITHUB_OUTPUT}
fi
+ echo "registry-archive" >> ${GITHUB_OUTPUT}
echo "EOF" >> ${GITHUB_OUTPUT}
set -x
echo "docs-packages-processed=${packages}" >> ${GITHUB_OUTPUT}
@@ -214,3 +222,10 @@ jobs:
--document-packages "${DOCUMENTS_PACKAGES}" \
--commit-ref ${COMMIT_REF} --sync-type ${SYNC_TYPE} \
--processes ${PROCESSES}
+ - name: Syncing registry to ${{ inputs.destination }}
+ env:
+ REGISTRY_DESTINATION_LOCATION: ${{ steps.parameters.outputs.registry-destination-location }}
+ run: |
+ set -x
+ aws s3 sync /mnt/cloned-airflow-site-archive/registry-archive/ "${REGISTRY_DESTINATION_LOCATION}" --delete
+ if: inputs.sync-registry == true