You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2025/12/20 17:09:31 UTC
(airflow-site-archive) branch fix-workflow-bug created (now 22653b88a52)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch fix-workflow-bug
in repository https://gitbox.apache.org/repos/asf/airflow-site-archive.git
at 22653b88a52 Fix bug when only syncing apache-airflow package
This branch includes the following new commits:
new 22653b88a52 Fix bug when only syncing apache-airflow package
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
(airflow-site-archive) 01/01: Fix bug when only syncing apache-airflow package
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch fix-workflow-bug
in repository https://gitbox.apache.org/repos/asf/airflow-site-archive.git
commit 22653b88a52f6f3a11dbcd71e796931b86500e45
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Sat Dec 20 17:07:24 2025 +0000
Fix bug when only syncing apache-airflow package
When trying to only sync airflow package, currently it fails with following error.
https://github.com/apache/airflow-site-archive/actions/runs/20286130226/job/58260093254
```
Run echo "Input parameters summary"
+ [[ staging == \l\i\v\e ]]
Input parameters summary
+ echo destination-location=s3://staging-docs-airflow-apache-org/docs/
+ [[ false == \t\r\u\e ]]
+ echo sync-type=single-commit
+ echo commit-ref=staging
=========================
Destination: staging
Document packages: apache-airflow
Full sync: false
Commit reference: staging
Processes: 4
...
...
/mnt/cloned-airflow-site-archive/images:
total 28
drwxr-xr-x 2 runner runner 4096 Dec 16 23:28 .
+ aws configure set default.s3.max_concurrent_requests 10
drwxr-xr-x 5 runner root 4096 Dec 16 23:28 ..
-rw-r--r-- 1 runner runner 17612 Dec 16 23:28 staging.png
+ uv run ./scripts/github_to_s3.py --bucket-path s3://staging-docs-airflow-apache-org/docs/ --local-path /mnt/cloned-airflow-site-archive/docs-archive --document-packages apache-airflow-providers-apache-airflow --commit-ref staging --sync-type single-commit --processes 4
Downloading botocore (13.9MiB)
Downloaded botocore
Installed 11 packages in 64ms
Bucket s3://staging-docs-airflow-apache-org/docs/ exists.
Invalid package name apache-airflow-providers-apache-airflow for sync type single-commit - only all can be used with single-commit
Error: Process completed with exit code 1.
```
---
.github/workflows/github-to-s3.yml | 10 ++++++----
1 file changed, 6 insertions(+), 4 deletions(-)
diff --git a/.github/workflows/github-to-s3.yml b/.github/workflows/github-to-s3.yml
index d38cb6d0eef..1a087df4fe7 100644
--- a/.github/workflows/github-to-s3.yml
+++ b/.github/workflows/github-to-s3.yml
@@ -137,12 +137,14 @@ jobs:
sparse_checkout=""
separator=""
for package in ${DOCUMENTS_PACKAGES}; do
- if [[ "${package}" != apache-airflow-providers* ]]; then
- packages="${packages}${separator}apache-airflow-providers-${package/./-}"
- echo "docs-archive/apache-airflow-providers-${package/./-}" >> ${GITHUB_OUTPUT}
- else
+ # If it already starts with apache-airflow, use as-is
+ if [[ "${package}" == apache-airflow* ]]; then
packages="${packages}${separator}${package}"
echo "docs-archive/${package}" >> ${GITHUB_OUTPUT}
+ # Otherwise, it's a short provider name, add the prefix
+ else
+ packages="${packages}${separator}apache-airflow-providers-${package/./-}"
+ echo "docs-archive/apache-airflow-providers-${package/./-}" >> ${GITHUB_OUTPUT}
fi
separator=" "
done