[PR] Registry: Clean up stale pagefind index files from S3 during registry builds [airflow]

["kaxil (via GitHub)" <gi...@apache.org>]

kaxil opened a new pull request, #63234:
URL: https://github.com/apache/airflow/pull/63234

   Pagefind generates content-hashed filenames (e.g. `en_181da6f.pf_index`, `pagefind.en_b52554cee1.pf_meta`). Each registry rebuild produces new hashes, but the S3 sync had no `--delete` flag, so old index files accumulated as orphans.
   
   ## Changes
   
   Split the S3 sync into two commands:
   - **Main sync** (`--exclude "pagefind/*"`) — uploads everything except pagefind, no `--delete` to preserve files written by the subsequent `publish-versions` step
   - **Pagefind sync** (`--delete`) — uploads the new pagefind index and removes stale hashed files


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] Registry: Clean up stale pagefind index files from S3 during registry builds [airflow]

["github-actions[bot] (via GitHub)" <gi...@apache.org>]

github-actions[bot] commented on PR #63234:
URL: https://github.com/apache/airflow/pull/63234#issuecomment-4027859292

   ### Backport failed to create: v3-1-test. View the failure log <a href='https://github.com/apache/airflow/actions/runs/22881796403'> Run details </a>
   
   Note: As of [Merging PRs targeted for Airflow 3.X](https://github.com/apache/airflow/blob/main/dev/README_AIRFLOW3_DEV.md#merging-prs-targeted-for-airflow-3x)
   the committer who merges the PR is responsible for backporting the PRs that are bug fixes (generally speaking) to the maintenance branches.
   
   In matter of doubt please ask in [#release-management](https://apache-airflow.slack.com/archives/C03G9H97MM2) Slack channel.
   
   <table>
       <tr>
           <th>Status</th>
           <th>Branch</th>
           <th>Result</th>
       </tr>
       <tr>
           <td>❌</td>
           <td>v3-1-test</td>
           <td><a href="https://github.com/apache/airflow/commit/554b1d167203f738bac0441542eae5232496d309"><img src='https://img.shields.io/badge/Commit-554b1d1-red' alt='Commit Link'></a></td>
       </tr>
   </table>
   
   You can attempt to backport this manually by running:
   
   ```bash
   cherry_picker 554b1d1 v3-1-test
   ```
   
   This should apply the commit to the v3-1-test branch and leave the commit in conflict state marking
   the files that need manual conflict resolution.
   
   After you have resolved the conflicts, you can continue the backport process by running:
   
   ```bash
   cherry_picker --continue
   ```
   
   If you don't have cherry-picker installed, see the [installation guide](https://github.com/apache/airflow/blob/main/dev/README_AIRFLOW3_DEV.md#how-to-backport-pr-with-cherry-picker-cli).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] Registry: Clean up stale pagefind index files from S3 during registry builds [airflow]

["kaxil (via GitHub)" <gi...@apache.org>]

kaxil merged PR #63234:
URL: https://github.com/apache/airflow/pull/63234


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org