You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "amoghrajesh (via GitHub)" <gi...@apache.org> on 2023/06/06 11:04:27 UTC

[GitHub] [airflow-site] amoghrajesh opened a new pull request, #792: Fixing back references for docs

amoghrajesh opened a new pull request, #792:
URL: https://github.com/apache/airflow-site/pull/792

   When we generate a new version of the docs, we only create a new version "folder" with the documentation. For example when we generate 2.6.1 docs. only this folder gets updated: https://github.com/apache/airflow-site/tree/main/docs-archive/apache-airflow/2.6.1 and "redirects.txt" work in the way that it generates an empty "refresh" HTML document:
   For example https://github.com/apache/airflow-site/blob/main/docs-archive/apache-airflow/2.6.1/listeners.html redirects to administration-and-deployment/listeners.html URL. Which means that if someone had the link to old stable page, the old URL will be redirected to the new URL.
   In order to generate changes when you change version (for example in this case for listener). you would have to add similar empty "refresh HTML" page for all the past versions releases (of airflow and providers).
   
   The script here generates and copies the new docs path.
   
   The script was able to generate the following files:
   ```
   	docs-archive/apache-airflow/1.10.1/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.1/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.1/core-concepts/
   	docs-archive/apache-airflow/1.10.1/howto/connection.html
   	docs-archive/apache-airflow/1.10.1/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.1/installation/
   	docs-archive/apache-airflow/1.10.1/tutorial/
   	docs-archive/apache-airflow/1.10.10/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.10/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.10/cli-and-env-variables-ref.html
   	docs-archive/apache-airflow/1.10.10/core-concepts/
   	docs-archive/apache-airflow/1.10.10/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/1.10.10/howto/connection.html
   	docs-archive/apache-airflow/1.10.10/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.10/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.10/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.10/howto/usage-cli.html
   	docs-archive/apache-airflow/1.10.10/installation/
   	docs-archive/apache-airflow/1.10.10/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.10/release_notes.html
   	docs-archive/apache-airflow/1.10.10/templates-ref.html
   	docs-archive/apache-airflow/1.10.10/tutorial/
   	docs-archive/apache-airflow/1.10.11/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.11/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.11/cli-and-env-variables-ref.html
   	docs-archive/apache-airflow/1.10.11/core-concepts/
   	docs-archive/apache-airflow/1.10.11/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/1.10.11/howto/connection.html
   	docs-archive/apache-airflow/1.10.11/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/1.10.11/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.11/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.11/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.11/howto/usage-cli.html
   	docs-archive/apache-airflow/1.10.11/installation/
   	docs-archive/apache-airflow/1.10.11/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.11/release_notes.html
   	docs-archive/apache-airflow/1.10.11/templates-ref.html
   	docs-archive/apache-airflow/1.10.11/tutorial/
   	docs-archive/apache-airflow/1.10.12/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.12/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.12/cli-and-env-variables-ref.html
   	docs-archive/apache-airflow/1.10.12/core-concepts/
   	docs-archive/apache-airflow/1.10.12/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/1.10.12/howto/connection.html
   	docs-archive/apache-airflow/1.10.12/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/1.10.12/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.12/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.12/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.12/howto/usage-cli.html
   	docs-archive/apache-airflow/1.10.12/installation/
   	docs-archive/apache-airflow/1.10.12/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.12/release_notes.html
   	docs-archive/apache-airflow/1.10.12/templates-ref.html
   	docs-archive/apache-airflow/1.10.12/tutorial/
   	docs-archive/apache-airflow/1.10.13/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.13/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.13/cli-and-env-variables-ref.html
   	docs-archive/apache-airflow/1.10.13/core-concepts/
   	docs-archive/apache-airflow/1.10.13/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/1.10.13/howto/connection.html
   	docs-archive/apache-airflow/1.10.13/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/1.10.13/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.13/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.13/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.13/howto/usage-cli.html
   	docs-archive/apache-airflow/1.10.13/installation/
   	docs-archive/apache-airflow/1.10.13/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.13/release_notes.html
   	docs-archive/apache-airflow/1.10.13/templates-ref.html
   	docs-archive/apache-airflow/1.10.13/tutorial/
   	docs-archive/apache-airflow/1.10.14/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.14/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.14/cli-and-env-variables-ref.html
   	docs-archive/apache-airflow/1.10.14/core-concepts/
   	docs-archive/apache-airflow/1.10.14/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/1.10.14/howto/connection.html
   	docs-archive/apache-airflow/1.10.14/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/1.10.14/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.14/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.14/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.14/howto/usage-cli.html
   	docs-archive/apache-airflow/1.10.14/installation/
   	docs-archive/apache-airflow/1.10.14/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.14/release_notes.html
   	docs-archive/apache-airflow/1.10.14/templates-ref.html
   	docs-archive/apache-airflow/1.10.14/tutorial/
   	docs-archive/apache-airflow/1.10.15/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.15/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.15/cli-and-env-variables-ref.html
   	docs-archive/apache-airflow/1.10.15/core-concepts/
   	docs-archive/apache-airflow/1.10.15/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/1.10.15/howto/connection.html
   	docs-archive/apache-airflow/1.10.15/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/1.10.15/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.15/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.15/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.15/howto/usage-cli.html
   	docs-archive/apache-airflow/1.10.15/installation/
   	docs-archive/apache-airflow/1.10.15/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.15/release_notes.html
   	docs-archive/apache-airflow/1.10.15/templates-ref.html
   	docs-archive/apache-airflow/1.10.15/tutorial/
   	docs-archive/apache-airflow/1.10.2/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.2/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.2/core-concepts/
   	docs-archive/apache-airflow/1.10.2/howto/connection.html
   	docs-archive/apache-airflow/1.10.2/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.2/installation/
   	docs-archive/apache-airflow/1.10.2/release_notes.html
   	docs-archive/apache-airflow/1.10.2/tutorial/
   	docs-archive/apache-airflow/1.10.3/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.3/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.3/core-concepts/
   	docs-archive/apache-airflow/1.10.3/howto/connection.html
   	docs-archive/apache-airflow/1.10.3/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.3/installation/
   	docs-archive/apache-airflow/1.10.3/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.3/release_notes.html
   	docs-archive/apache-airflow/1.10.3/tutorial/
   	docs-archive/apache-airflow/1.10.4/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.4/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.4/core-concepts/
   	docs-archive/apache-airflow/1.10.4/howto/connection.html
   	docs-archive/apache-airflow/1.10.4/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.4/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.4/installation/
   	docs-archive/apache-airflow/1.10.4/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.4/release_notes.html
   	docs-archive/apache-airflow/1.10.4/tutorial/
   	docs-archive/apache-airflow/1.10.5/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.5/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.5/core-concepts/
   	docs-archive/apache-airflow/1.10.5/howto/connection.html
   	docs-archive/apache-airflow/1.10.5/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.5/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.5/installation/
   	docs-archive/apache-airflow/1.10.5/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.5/release_notes.html
   	docs-archive/apache-airflow/1.10.5/tutorial/
   	docs-archive/apache-airflow/1.10.6/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.6/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.6/core-concepts/
   	docs-archive/apache-airflow/1.10.6/howto/connection.html
   	docs-archive/apache-airflow/1.10.6/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.6/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.6/installation/
   	docs-archive/apache-airflow/1.10.6/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.6/release_notes.html
   	docs-archive/apache-airflow/1.10.6/tutorial/
   	docs-archive/apache-airflow/1.10.7/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.7/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.7/core-concepts/
   	docs-archive/apache-airflow/1.10.7/howto/connection.html
   	docs-archive/apache-airflow/1.10.7/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.7/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.7/installation/
   	docs-archive/apache-airflow/1.10.7/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.7/release_notes.html
   	docs-archive/apache-airflow/1.10.7/tutorial/
   	docs-archive/apache-airflow/1.10.8/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.8/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.8/core-concepts/
   	docs-archive/apache-airflow/1.10.8/howto/connection.html
   	docs-archive/apache-airflow/1.10.8/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.8/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.8/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.8/installation/
   	docs-archive/apache-airflow/1.10.8/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.8/release_notes.html
   	docs-archive/apache-airflow/1.10.8/tutorial/
   	docs-archive/apache-airflow/1.10.9/administration-and-deployment/
   	docs-archive/apache-airflow/1.10.9/authoring-and-scheduling/
   	docs-archive/apache-airflow/1.10.9/core-concepts/
   	docs-archive/apache-airflow/1.10.9/howto/connection.html
   	docs-archive/apache-airflow/1.10.9/howto/define-extra-link.html
   	docs-archive/apache-airflow/1.10.9/howto/operator/external_task_sensor.html
   	docs-archive/apache-airflow/1.10.9/howto/set-up-database.html
   	docs-archive/apache-airflow/1.10.9/installation/
   	docs-archive/apache-airflow/1.10.9/public-airflow-interface.html
   	docs-archive/apache-airflow/1.10.9/release_notes.html
   	docs-archive/apache-airflow/1.10.9/tutorial/
   	docs-archive/apache-airflow/2.0.0/administration-and-deployment/
   	docs-archive/apache-airflow/2.0.0/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.0.0/core-concepts/
   	docs-archive/apache-airflow/2.0.0/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/2.0.0/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.0.0/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.0.0/howto/set-up-database.html
   	docs-archive/apache-airflow/2.0.0/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.0.0/howto/usage-cli.html
   	docs-archive/apache-airflow/2.0.0/installation/
   	docs-archive/apache-airflow/2.0.0/public-airflow-interface.html
   	docs-archive/apache-airflow/2.0.0/release_notes.html
   	docs-archive/apache-airflow/2.0.0/templates-ref.html
   	docs-archive/apache-airflow/2.0.0/tutorial/
   	docs-archive/apache-airflow/2.0.1/administration-and-deployment/
   	docs-archive/apache-airflow/2.0.1/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.0.1/core-concepts/
   	docs-archive/apache-airflow/2.0.1/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/2.0.1/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.0.1/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.0.1/howto/docker-compose/
   	docs-archive/apache-airflow/2.0.1/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.0.1/howto/usage-cli.html
   	docs-archive/apache-airflow/2.0.1/installation/
   	docs-archive/apache-airflow/2.0.1/public-airflow-interface.html
   	docs-archive/apache-airflow/2.0.1/release_notes.html
   	docs-archive/apache-airflow/2.0.1/templates-ref.html
   	docs-archive/apache-airflow/2.0.1/tutorial/
   	docs-archive/apache-airflow/2.0.2/administration-and-deployment/
   	docs-archive/apache-airflow/2.0.2/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.0.2/core-concepts/
   	docs-archive/apache-airflow/2.0.2/deprecated-rest-api-ref.html
   	docs-archive/apache-airflow/2.0.2/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.0.2/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.0.2/howto/docker-compose/
   	docs-archive/apache-airflow/2.0.2/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.0.2/howto/usage-cli.html
   	docs-archive/apache-airflow/2.0.2/installation/
   	docs-archive/apache-airflow/2.0.2/public-airflow-interface.html
   	docs-archive/apache-airflow/2.0.2/release_notes.html
   	docs-archive/apache-airflow/2.0.2/templates-ref.html
   	docs-archive/apache-airflow/2.0.2/tutorial/
   	docs-archive/apache-airflow/2.1.0/administration-and-deployment/
   	docs-archive/apache-airflow/2.1.0/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.1.0/core-concepts/
   	docs-archive/apache-airflow/2.1.0/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.1.0/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.1.0/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.1.0/howto/docker-compose/
   	docs-archive/apache-airflow/2.1.0/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.1.0/howto/usage-cli.html
   	docs-archive/apache-airflow/2.1.0/installation/
   	docs-archive/apache-airflow/2.1.0/public-airflow-interface.html
   	docs-archive/apache-airflow/2.1.0/release_notes.html
   	docs-archive/apache-airflow/2.1.0/templates-ref.html
   	docs-archive/apache-airflow/2.1.0/tutorial/
   	docs-archive/apache-airflow/2.1.1/administration-and-deployment/
   	docs-archive/apache-airflow/2.1.1/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.1.1/core-concepts/
   	docs-archive/apache-airflow/2.1.1/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.1.1/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.1.1/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.1.1/howto/docker-compose/
   	docs-archive/apache-airflow/2.1.1/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.1.1/howto/usage-cli.html
   	docs-archive/apache-airflow/2.1.1/installation/
   	docs-archive/apache-airflow/2.1.1/public-airflow-interface.html
   	docs-archive/apache-airflow/2.1.1/release_notes.html
   	docs-archive/apache-airflow/2.1.1/templates-ref.html
   	docs-archive/apache-airflow/2.1.1/tutorial/
   	docs-archive/apache-airflow/2.1.2/administration-and-deployment/
   	docs-archive/apache-airflow/2.1.2/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.1.2/core-concepts/
   	docs-archive/apache-airflow/2.1.2/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.1.2/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.1.2/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.1.2/howto/docker-compose/
   	docs-archive/apache-airflow/2.1.2/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.1.2/howto/usage-cli.html
   	docs-archive/apache-airflow/2.1.2/installation/
   	docs-archive/apache-airflow/2.1.2/public-airflow-interface.html
   	docs-archive/apache-airflow/2.1.2/release_notes.html
   	docs-archive/apache-airflow/2.1.2/templates-ref.html
   	docs-archive/apache-airflow/2.1.2/tutorial/
   	docs-archive/apache-airflow/2.1.3/administration-and-deployment/
   	docs-archive/apache-airflow/2.1.3/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.1.3/core-concepts/
   	docs-archive/apache-airflow/2.1.3/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.1.3/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.1.3/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.1.3/howto/docker-compose/
   	docs-archive/apache-airflow/2.1.3/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.1.3/howto/usage-cli.html
   	docs-archive/apache-airflow/2.1.3/installation/
   	docs-archive/apache-airflow/2.1.3/public-airflow-interface.html
   	docs-archive/apache-airflow/2.1.3/release_notes.html
   	docs-archive/apache-airflow/2.1.3/templates-ref.html
   	docs-archive/apache-airflow/2.1.3/tutorial/
   	docs-archive/apache-airflow/2.1.4/administration-and-deployment/
   	docs-archive/apache-airflow/2.1.4/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.1.4/core-concepts/
   	docs-archive/apache-airflow/2.1.4/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.1.4/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.1.4/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.1.4/howto/docker-compose/
   	docs-archive/apache-airflow/2.1.4/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.1.4/howto/usage-cli.html
   	docs-archive/apache-airflow/2.1.4/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.1.4/public-airflow-interface.html
   	docs-archive/apache-airflow/2.1.4/release_notes.html
   	docs-archive/apache-airflow/2.1.4/templates-ref.html
   	docs-archive/apache-airflow/2.1.4/tutorial/
   	docs-archive/apache-airflow/2.2.0/administration-and-deployment/
   	docs-archive/apache-airflow/2.2.0/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.2.0/core-concepts/
   	docs-archive/apache-airflow/2.2.0/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.2.0/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.2.0/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.2.0/howto/docker-compose/
   	docs-archive/apache-airflow/2.2.0/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.2.0/howto/usage-cli.html
   	docs-archive/apache-airflow/2.2.0/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.2.0/public-airflow-interface.html
   	docs-archive/apache-airflow/2.2.0/release_notes.html
   	docs-archive/apache-airflow/2.2.0/tutorial/
   	docs-archive/apache-airflow/2.2.1/administration-and-deployment/
   	docs-archive/apache-airflow/2.2.1/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.2.1/core-concepts/
   	docs-archive/apache-airflow/2.2.1/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.2.1/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.2.1/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.2.1/howto/docker-compose/
   	docs-archive/apache-airflow/2.2.1/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.2.1/howto/usage-cli.html
   	docs-archive/apache-airflow/2.2.1/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.2.1/public-airflow-interface.html
   	docs-archive/apache-airflow/2.2.1/release_notes.html
   	docs-archive/apache-airflow/2.2.1/tutorial/
   	docs-archive/apache-airflow/2.2.2/administration-and-deployment/
   	docs-archive/apache-airflow/2.2.2/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.2.2/core-concepts/
   	docs-archive/apache-airflow/2.2.2/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.2.2/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.2.2/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.2.2/howto/docker-compose/
   	docs-archive/apache-airflow/2.2.2/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.2.2/howto/usage-cli.html
   	docs-archive/apache-airflow/2.2.2/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.2.2/public-airflow-interface.html
   	docs-archive/apache-airflow/2.2.2/release_notes.html
   	docs-archive/apache-airflow/2.2.2/tutorial/
   	docs-archive/apache-airflow/2.2.3/administration-and-deployment/
   	docs-archive/apache-airflow/2.2.3/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.2.3/core-concepts/
   	docs-archive/apache-airflow/2.2.3/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.2.3/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.2.3/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.2.3/howto/docker-compose/
   	docs-archive/apache-airflow/2.2.3/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.2.3/howto/usage-cli.html
   	docs-archive/apache-airflow/2.2.3/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.2.3/public-airflow-interface.html
   	docs-archive/apache-airflow/2.2.3/release_notes.html
   	docs-archive/apache-airflow/2.2.3/tutorial/
   	docs-archive/apache-airflow/2.2.4/administration-and-deployment/
   	docs-archive/apache-airflow/2.2.4/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.2.4/core-concepts/
   	docs-archive/apache-airflow/2.2.4/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.2.4/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.2.4/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.2.4/howto/docker-compose/
   	docs-archive/apache-airflow/2.2.4/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.2.4/howto/usage-cli.html
   	docs-archive/apache-airflow/2.2.4/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.2.4/public-airflow-interface.html
   	docs-archive/apache-airflow/2.2.4/release_notes.html
   	docs-archive/apache-airflow/2.2.4/tutorial/
   	docs-archive/apache-airflow/2.2.5/administration-and-deployment/
   	docs-archive/apache-airflow/2.2.5/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.2.5/core-concepts/
   	docs-archive/apache-airflow/2.2.5/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.2.5/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.2.5/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.2.5/howto/docker-compose/
   	docs-archive/apache-airflow/2.2.5/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.2.5/howto/usage-cli.html
   	docs-archive/apache-airflow/2.2.5/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.2.5/public-airflow-interface.html
   	docs-archive/apache-airflow/2.2.5/release_notes.html
   	docs-archive/apache-airflow/2.2.5/tutorial/
   	docs-archive/apache-airflow/2.3.0/administration-and-deployment/
   	docs-archive/apache-airflow/2.3.0/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.3.0/core-concepts/
   	docs-archive/apache-airflow/2.3.0/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.3.0/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.3.0/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.3.0/howto/docker-compose/
   	docs-archive/apache-airflow/2.3.0/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.3.0/howto/usage-cli.html
   	docs-archive/apache-airflow/2.3.0/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.3.0/public-airflow-interface.html
   	docs-archive/apache-airflow/2.3.0/tutorial/
   	docs-archive/apache-airflow/2.3.1/administration-and-deployment/
   	docs-archive/apache-airflow/2.3.1/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.3.1/core-concepts/
   	docs-archive/apache-airflow/2.3.1/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.3.1/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.3.1/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.3.1/howto/docker-compose/
   	docs-archive/apache-airflow/2.3.1/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.3.1/howto/usage-cli.html
   	docs-archive/apache-airflow/2.3.1/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.3.1/public-airflow-interface.html
   	docs-archive/apache-airflow/2.3.1/tutorial/
   	docs-archive/apache-airflow/2.3.2/administration-and-deployment/
   	docs-archive/apache-airflow/2.3.2/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.3.2/core-concepts/
   	docs-archive/apache-airflow/2.3.2/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.3.2/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.3.2/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.3.2/howto/docker-compose/
   	docs-archive/apache-airflow/2.3.2/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.3.2/howto/usage-cli.html
   	docs-archive/apache-airflow/2.3.2/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.3.2/public-airflow-interface.html
   	docs-archive/apache-airflow/2.3.2/tutorial/
   	docs-archive/apache-airflow/2.3.3/administration-and-deployment/
   	docs-archive/apache-airflow/2.3.3/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.3.3/core-concepts/
   	docs-archive/apache-airflow/2.3.3/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.3.3/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.3.3/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.3.3/howto/docker-compose/
   	docs-archive/apache-airflow/2.3.3/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.3.3/howto/usage-cli.html
   	docs-archive/apache-airflow/2.3.3/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.3.3/public-airflow-interface.html
   	docs-archive/apache-airflow/2.3.3/tutorial/
   	docs-archive/apache-airflow/2.3.4/administration-and-deployment/
   	docs-archive/apache-airflow/2.3.4/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.3.4/core-concepts/
   	docs-archive/apache-airflow/2.3.4/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.3.4/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.3.4/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.3.4/howto/docker-compose/
   	docs-archive/apache-airflow/2.3.4/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.3.4/howto/usage-cli.html
   	docs-archive/apache-airflow/2.3.4/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.3.4/public-airflow-interface.html
   	docs-archive/apache-airflow/2.3.4/tutorial/
   	docs-archive/apache-airflow/2.4.0/administration-and-deployment/
   	docs-archive/apache-airflow/2.4.0/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.4.0/core-concepts/
   	docs-archive/apache-airflow/2.4.0/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.4.0/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.4.0/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.4.0/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.4.0/howto/usage-cli.html
   	docs-archive/apache-airflow/2.4.0/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.4.0/public-airflow-interface.html
   	docs-archive/apache-airflow/2.4.1/administration-and-deployment/
   	docs-archive/apache-airflow/2.4.1/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.4.1/core-concepts/
   	docs-archive/apache-airflow/2.4.1/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.4.1/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.4.1/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.4.1/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.4.1/howto/usage-cli.html
   	docs-archive/apache-airflow/2.4.1/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.4.1/public-airflow-interface.html
   	docs-archive/apache-airflow/2.4.2/administration-and-deployment/
   	docs-archive/apache-airflow/2.4.2/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.4.2/core-concepts/
   	docs-archive/apache-airflow/2.4.2/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.4.2/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.4.2/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.4.2/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.4.2/howto/usage-cli.html
   	docs-archive/apache-airflow/2.4.2/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.4.2/public-airflow-interface.html
   	docs-archive/apache-airflow/2.4.3/administration-and-deployment/
   	docs-archive/apache-airflow/2.4.3/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.4.3/core-concepts/
   	docs-archive/apache-airflow/2.4.3/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.4.3/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.4.3/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.4.3/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.4.3/howto/usage-cli.html
   	docs-archive/apache-airflow/2.4.3/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.4.3/public-airflow-interface.html
   	docs-archive/apache-airflow/2.5.0/administration-and-deployment/
   	docs-archive/apache-airflow/2.5.0/authoring-and-scheduling/
   	docs-archive/apache-airflow/2.5.0/core-concepts/
   	docs-archive/apache-airflow/2.5.0/howto/customize-ui.html#customizing-dag-ui-header-and-airflow-page-titles
   	docs-archive/apache-airflow/2.5.0/howto/customize-ui.html#customizing-state-colours
   	docs-archive/apache-airflow/2.5.0/howto/define-extra-link.html
   	docs-archive/apache-airflow/2.5.0/howto/upgrading-from-1-10/
   	docs-archive/apache-airflow/2.5.0/howto/usage-cli.html
   	docs-archive/apache-airflow/2.5.0/installation/upgrade-check.html
   	docs-archive/apache-airflow/2.5.0/public-airflow-interface.html
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow-site] vincbeck commented on a diff in pull request #792: Fixing back references for docs

Posted by "vincbeck (via GitHub)" <gi...@apache.org>.
vincbeck commented on code in PR #792:
URL: https://github.com/apache/airflow-site/pull/792#discussion_r1219773510


##########
post-docs/add-back-references.py:
##########
@@ -0,0 +1,81 @@
+import os
+import shutil
+from urllib.request import urlopen
+import semver
+
+docs_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/apache-airflow/redirects.txt"
+docs_archive_path = "../docs-archive"
+apache_airflow_path = docs_archive_path + "/apache-airflow"
+stable_version_path = apache_airflow_path + "/stable.txt"
+new_docs_version = "2.5.1"
+
+
+def download_file(url):
+    filedata = urlopen(url)
+    datatowrite = filedata.read()
+
+    with open('redirects.txt', 'wb') as f:
+        f.write(datatowrite)
+
+
+def construct_mapping():
+    old_to_new_map = dict()
+    with open('redirects.txt') as f:
+        file_content = []
+        lines = f.readlines()
+        # Skip empty line
+
+        for line in lines:
+            if not line.strip():
+                continue
+
+            # Skip comments
+            if line.startswith("#"):
+                continue
+
+            line = line.rstrip()
+            file_content.append(line)
+
+            old_path, new_path = line.split(" ")
+            old_path = old_path.replace(".rst", ".html")
+            new_path = new_path.replace(".rst", ".html")
+
+            old_to_new_map[old_path] = new_path
+    return old_to_new_map
+
+
+def get_stable_version():
+    version = ''
+    with open(stable_version_path) as f:
+        lines = f.readlines()
+        version = lines[0].rstrip()
+    return version
+
+
+def version_is_less_than(a):
+    return semver.compare(a, new_docs_version) == -1
+
+
+download_file(docs_link)
+old_to_new = construct_mapping()
+stable = get_stable_version()
+
+versions = [f.path.split("/")[-1] for f in os.scandir(apache_airflow_path) if f.is_dir()]
+versions = [v for v in versions if version_is_less_than(v)]
+
+for version in versions:
+    r = apache_airflow_path + "/" + version
+
+    for p in old_to_new:
+        if os.path.exists(r + "/" + p):
+            d = old_to_new[p].split("/")
+            file_name = old_to_new[p].split("/")[-1]
+            dest_fpath = r + "/" + "/".join(d[: len(d) - 1])
+            os.makedirs(dest_fpath, exist_ok=True)
+
+            dest_fpath = dest_fpath + "/" + file_name
+
+            if not os.path.exists(dest_fpath):
+                shutil.copy(r + "/" + p, dest_fpath)

Review Comment:
   As far as I understand, you're actually copying the documentation and not creating a redirect file (like this [one](https://github.com/apache/airflow-site/blob/main/docs-archive/apache-airflow/2.6.1/listeners.html)). We definitely should create redirect files instead of duplicating files



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow-site] vincbeck commented on a diff in pull request #792: Fixing back references for docs

Posted by "vincbeck (via GitHub)" <gi...@apache.org>.
vincbeck commented on code in PR #792:
URL: https://github.com/apache/airflow-site/pull/792#discussion_r1221707993


##########
post-docs/add-back-references.py:
##########
@@ -0,0 +1,108 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+import os
+from urllib.request import urlopen
+import semver
+
+docs_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/apache-airflow/redirects.txt"
+docs_archive_path = "../docs-archive"
+apache_airflow_path = docs_archive_path + "/apache-airflow"
+stable_version_path = apache_airflow_path + "/stable.txt"
+new_docs_version = "2.5.1"
+
+# back reference html template - we will replace 'dummy-url' at runtime
+template = """
+<html><head><meta http-equiv="refresh" content="0; url=dummy_url"/></head></html>
+"""

Review Comment:
   nit: instead of doing this replace you can just define a function with url as parameter:
   
   ```python
   def get_redirect_content(url: str):
       return f"<html><head><meta http-equiv="refresh" content="0; url={url}"/></head></html>"
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow-site] amoghrajesh commented on a diff in pull request #792: Fixing back references for docs

Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on code in PR #792:
URL: https://github.com/apache/airflow-site/pull/792#discussion_r1221737646


##########
post-docs/add-back-references.py:
##########
@@ -0,0 +1,108 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+import os
+from urllib.request import urlopen
+import semver
+
+docs_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/apache-airflow/redirects.txt"
+docs_archive_path = "../docs-archive"
+apache_airflow_path = docs_archive_path + "/apache-airflow"
+stable_version_path = apache_airflow_path + "/stable.txt"
+new_docs_version = "2.5.1"
+
+# back reference html template - we will replace 'dummy-url' at runtime
+template = """
+<html><head><meta http-equiv="refresh" content="0; url=dummy_url"/></head></html>
+"""

Review Comment:
   Sure, we can do that. Made the changes



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow-site] vincbeck commented on a diff in pull request #792: Fixing back references for docs

Posted by "vincbeck (via GitHub)" <gi...@apache.org>.
vincbeck commented on code in PR #792:
URL: https://github.com/apache/airflow-site/pull/792#discussion_r1219776261


##########
post-docs/add-back-references.py:
##########
@@ -0,0 +1,81 @@
+import os
+import shutil
+from urllib.request import urlopen
+import semver
+
+docs_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/apache-airflow/redirects.txt"
+docs_archive_path = "../docs-archive"
+apache_airflow_path = docs_archive_path + "/apache-airflow"
+stable_version_path = apache_airflow_path + "/stable.txt"
+new_docs_version = "2.5.1"
+
+
+def download_file(url):
+    filedata = urlopen(url)
+    datatowrite = filedata.read()
+
+    with open('redirects.txt', 'wb') as f:
+        f.write(datatowrite)
+
+
+def construct_mapping():
+    old_to_new_map = dict()
+    with open('redirects.txt') as f:
+        file_content = []
+        lines = f.readlines()
+        # Skip empty line
+
+        for line in lines:
+            if not line.strip():
+                continue
+
+            # Skip comments
+            if line.startswith("#"):
+                continue
+
+            line = line.rstrip()
+            file_content.append(line)
+
+            old_path, new_path = line.split(" ")
+            old_path = old_path.replace(".rst", ".html")
+            new_path = new_path.replace(".rst", ".html")
+
+            old_to_new_map[old_path] = new_path
+    return old_to_new_map
+
+
+def get_stable_version():
+    version = ''
+    with open(stable_version_path) as f:
+        lines = f.readlines()
+        version = lines[0].rstrip()
+    return version
+
+
+def version_is_less_than(a):
+    return semver.compare(a, new_docs_version) == -1
+
+
+download_file(docs_link)
+old_to_new = construct_mapping()
+stable = get_stable_version()
+
+versions = [f.path.split("/")[-1] for f in os.scandir(apache_airflow_path) if f.is_dir()]
+versions = [v for v in versions if version_is_less_than(v)]
+
+for version in versions:
+    r = apache_airflow_path + "/" + version
+
+    for p in old_to_new:
+        if os.path.exists(r + "/" + p):
+            d = old_to_new[p].split("/")
+            file_name = old_to_new[p].split("/")[-1]
+            dest_fpath = r + "/" + "/".join(d[: len(d) - 1])
+            os.makedirs(dest_fpath, exist_ok=True)
+
+            dest_fpath = dest_fpath + "/" + file_name
+
+            if not os.path.exists(dest_fpath):
+                shutil.copy(r + "/" + p, dest_fpath)

Review Comment:
   I just noticed it has already been brought in the Slack thread :) You can ignore then



##########
post-docs/add-back-references.py:
##########
@@ -0,0 +1,81 @@
+import os
+import shutil
+from urllib.request import urlopen
+import semver
+
+docs_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/apache-airflow/redirects.txt"
+docs_archive_path = "../docs-archive"
+apache_airflow_path = docs_archive_path + "/apache-airflow"
+stable_version_path = apache_airflow_path + "/stable.txt"
+new_docs_version = "2.5.1"
+
+
+def download_file(url):
+    filedata = urlopen(url)
+    datatowrite = filedata.read()
+
+    with open('redirects.txt', 'wb') as f:
+        f.write(datatowrite)
+
+
+def construct_mapping():
+    old_to_new_map = dict()
+    with open('redirects.txt') as f:
+        file_content = []
+        lines = f.readlines()
+        # Skip empty line
+
+        for line in lines:
+            if not line.strip():
+                continue
+
+            # Skip comments
+            if line.startswith("#"):
+                continue
+
+            line = line.rstrip()
+            file_content.append(line)
+
+            old_path, new_path = line.split(" ")
+            old_path = old_path.replace(".rst", ".html")
+            new_path = new_path.replace(".rst", ".html")
+
+            old_to_new_map[old_path] = new_path
+    return old_to_new_map
+
+
+def get_stable_version():
+    version = ''
+    with open(stable_version_path) as f:
+        lines = f.readlines()
+        version = lines[0].rstrip()
+    return version
+
+
+def version_is_less_than(a):
+    return semver.compare(a, new_docs_version) == -1
+
+
+download_file(docs_link)
+old_to_new = construct_mapping()
+stable = get_stable_version()
+
+versions = [f.path.split("/")[-1] for f in os.scandir(apache_airflow_path) if f.is_dir()]
+versions = [v for v in versions if version_is_less_than(v)]
+
+for version in versions:
+    r = apache_airflow_path + "/" + version
+
+    for p in old_to_new:
+        if os.path.exists(r + "/" + p):
+            d = old_to_new[p].split("/")
+            file_name = old_to_new[p].split("/")[-1]
+            dest_fpath = r + "/" + "/".join(d[: len(d) - 1])
+            os.makedirs(dest_fpath, exist_ok=True)
+
+            dest_fpath = dest_fpath + "/" + file_name
+
+            if not os.path.exists(dest_fpath):
+                shutil.copy(r + "/" + p, dest_fpath)

Review Comment:
   I just noticed it has already been brought up in the Slack thread :) You can ignore then



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow-site] potiuk merged pull request #792: Fixing back-references for docs

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk merged PR #792:
URL: https://github.com/apache/airflow-site/pull/792


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow-site] amoghrajesh commented on a diff in pull request #792: Fixing back references for docs

Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on code in PR #792:
URL: https://github.com/apache/airflow-site/pull/792#discussion_r1220903688


##########
post-docs/add-back-references.py:
##########
@@ -0,0 +1,81 @@
+import os
+import shutil
+from urllib.request import urlopen
+import semver
+
+docs_link = "https://raw.githubusercontent.com/apache/airflow/main/docs/apache-airflow/redirects.txt"
+docs_archive_path = "../docs-archive"
+apache_airflow_path = docs_archive_path + "/apache-airflow"
+stable_version_path = apache_airflow_path + "/stable.txt"
+new_docs_version = "2.5.1"
+
+
+def download_file(url):
+    filedata = urlopen(url)
+    datatowrite = filedata.read()
+
+    with open('redirects.txt', 'wb') as f:
+        f.write(datatowrite)
+
+
+def construct_mapping():
+    old_to_new_map = dict()
+    with open('redirects.txt') as f:
+        file_content = []
+        lines = f.readlines()
+        # Skip empty line
+
+        for line in lines:
+            if not line.strip():
+                continue
+
+            # Skip comments
+            if line.startswith("#"):
+                continue
+
+            line = line.rstrip()
+            file_content.append(line)
+
+            old_path, new_path = line.split(" ")
+            old_path = old_path.replace(".rst", ".html")
+            new_path = new_path.replace(".rst", ".html")
+
+            old_to_new_map[old_path] = new_path
+    return old_to_new_map
+
+
+def get_stable_version():
+    version = ''
+    with open(stable_version_path) as f:
+        lines = f.readlines()
+        version = lines[0].rstrip()
+    return version
+
+
+def version_is_less_than(a):
+    return semver.compare(a, new_docs_version) == -1
+
+
+download_file(docs_link)
+old_to_new = construct_mapping()
+stable = get_stable_version()
+
+versions = [f.path.split("/")[-1] for f in os.scandir(apache_airflow_path) if f.is_dir()]
+versions = [v for v in versions if version_is_less_than(v)]
+
+for version in versions:
+    r = apache_airflow_path + "/" + version
+
+    for p in old_to_new:
+        if os.path.exists(r + "/" + p):
+            d = old_to_new[p].split("/")
+            file_name = old_to_new[p].split("/")[-1]
+            dest_fpath = r + "/" + "/".join(d[: len(d) - 1])
+            os.makedirs(dest_fpath, exist_ok=True)
+
+            dest_fpath = dest_fpath + "/" + file_name
+
+            if not os.path.exists(dest_fpath):
+                shutil.copy(r + "/" + p, dest_fpath)

Review Comment:
   Yeah, thanks for the catch. Integrated with latest commit



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org