[GitHub] [airflow-site] potiuk commented on a diff in pull request #799: Extending the back reference script to support providers

["potiuk (via GitHub)" <gi...@apache.org>]

potiuk commented on code in PR #799:
URL: https://github.com/apache/airflow-site/pull/799#discussion_r1226191142


##########
post-docs/add-back-references.py:
##########
@@ -22,14 +22,30 @@
 from urllib.request import urlopen
 import semver
 
+log = logging.getLogger(__name__)
+
 airflow_redirects_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/apache-airflow/redirects.txt"
 helm_redirects_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/helm-chart/redirects.txt"
-providers_redirect_link = "populate-this"
 
 docs_archive_path = "../docs-archive"
 airflow_docs_path = docs_archive_path + "/apache-airflow"
 helm_docs_path = docs_archive_path + "/helm-chart"
-providers_docs_path = docs_archive_path + "/apache-airflow-providers"
+
+# if any new provider is added with redirects, add it to this list

Review Comment:
   Since we are downloading the redirects from GitHub already can we simply loop over all directories in "docs-archive" and react to 404 not found by skipping a provider? that should be pretty fast.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org