You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2026/03/10 01:15:43 UTC

(airflow-site-archive) branch add-registry-to-github-to-s3 created (now b6842208858)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to branch add-registry-to-github-to-s3
in repository https://gitbox.apache.org/repos/asf/airflow-site-archive.git


      at b6842208858 Add registry sync to github-to-s3 workflow

This branch includes the following new commits:

     new b6842208858 Add registry sync to github-to-s3 workflow

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.



(airflow-site-archive) 01/01: Add registry sync to github-to-s3 workflow

Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch add-registry-to-github-to-s3
in repository https://gitbox.apache.org/repos/asf/airflow-site-archive.git

commit b6842208858ef72d2385f48399bdf8da5defac3d
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Tue Mar 10 01:15:30 2026 +0000

    Add registry sync to github-to-s3 workflow
    
    The s3-to-github workflow already syncs registry files (S3 → GitHub),
    but the reverse direction (GitHub → S3) was missing. Add a sync-registry
    input and a step to sync registry-archive/ to the registry/ path in S3,
    mirroring the pattern used in s3-to-github.yml.
---
 .github/workflows/github-to-s3.yml | 15 +++++++++++++++
 1 file changed, 15 insertions(+)

diff --git a/.github/workflows/github-to-s3.yml b/.github/workflows/github-to-s3.yml
index 1a087df4fe7..4c304349f7a 100644
--- a/.github/workflows/github-to-s3.yml
+++ b/.github/workflows/github-to-s3.yml
@@ -43,6 +43,11 @@ on: # yamllint disable-line rule:truthy
         required: false
         default: false
         type: boolean
+      sync-registry:
+        description: "Sync registry files to S3"
+        required: false
+        default: true
+        type: boolean
       processes:
         description: "Number of processes to use for syncing"
         required: false
@@ -72,8 +77,10 @@ jobs:
           set -x
           if [[ "${DESTINATION}"  == "live" ]]; then
              echo "destination-location=s3://live-docs-airflow-apache-org/docs/" >> ${GITHUB_OUTPUT}
+             echo "registry-destination-location=s3://live-docs-airflow-apache-org/registry/" >> ${GITHUB_OUTPUT}
           else
              echo "destination-location=s3://staging-docs-airflow-apache-org/docs/" >> ${GITHUB_OUTPUT}
+             echo "registry-destination-location=s3://staging-docs-airflow-apache-org/registry/" >> ${GITHUB_OUTPUT}
           fi
           if [[ "${FULL_SYNC}" == "true" ]] ; then
             echo "sync-type=full-sync" >> ${GITHUB_OUTPUT}
@@ -152,6 +159,7 @@ jobs:
             packages="all"
             echo "docs-archive" >> ${GITHUB_OUTPUT}
           fi
+          echo "registry-archive" >> ${GITHUB_OUTPUT}
           echo "EOF" >> ${GITHUB_OUTPUT}
           set -x
           echo "docs-packages-processed=${packages}" >> ${GITHUB_OUTPUT}
@@ -214,3 +222,10 @@ jobs:
             --document-packages "${DOCUMENTS_PACKAGES}" \
             --commit-ref ${COMMIT_REF} --sync-type ${SYNC_TYPE} \
             --processes ${PROCESSES}
+      - name: Syncing registry to ${{ inputs.destination }}
+        env:
+          REGISTRY_DESTINATION_LOCATION: ${{ steps.parameters.outputs.registry-destination-location }}
+        run: |
+          set -x
+          aws s3 sync /mnt/cloned-airflow-site-archive/registry-archive/ "${REGISTRY_DESTINATION_LOCATION}" --delete
+        if: inputs.sync-registry == true