You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2024/02/10 22:56:18 UTC

(airflow) branch main updated: Limit universal-pathlib to < 0.2.0 (#37311)

This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 13012744ad Limit universal-pathlib to < 0.2.0 (#37311)
13012744ad is described below

commit 13012744ada457883e57848f6fc45454d9c25a4c
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Sat Feb 10 23:56:11 2024 +0100

    Limit universal-pathlib to < 0.2.0 (#37311)
    
    The Universal Pathlib provides  Pathlib-like interface for FSSPEC
    In 0.1. *It was not very well defined for extension, so the way how we use it for 0.1.*
    so we used a lot of private methods and attributes that were not defined in the interface
    an they are broken with version 0.2.0 which is much better suited for extension and supports
    Python 3.12. We should limit it, unti we migrate to 0.2.0
    See: https://github.com/fsspec/universal_pathlib/pull/173#issuecomment-1937090528
    This is prerequistite to make Airflow compatible with Python 3.12
    Tracked in https://github.com/apache/airflow/pull/36755
---
 pyproject.toml | 10 +++++++++-
 1 file changed, 9 insertions(+), 1 deletion(-)

diff --git a/pyproject.toml b/pyproject.toml
index 3f81303bb1..51e790a64a 100644
--- a/pyproject.toml
+++ b/pyproject.toml
@@ -147,7 +147,15 @@ dependencies = [
     # See https://github.com/apache/airflow/pull/31693
     # We should also remove "licenses/LICENSE-unicodecsv.txt" file when we remove this dependency
     "unicodecsv>=0.14.1",
-    "universal-pathlib>=0.1.4",
+    # The Universal Pathlib provides  Pathlib-like interface for FSSPEC
+    # In 0.1. *It was not very well defined for extension, so the way how we use it for 0.1.*
+    # so we used a lot of private methods and attributes that were not defined in the interface
+    # an they are broken with version 0.2.0 which is much better suited for extension and supports
+    # Python 3.12. We should limit it, unti we migrate to 0.2.0
+    # See: https://github.com/fsspec/universal_pathlib/pull/173#issuecomment-1937090528
+    # This is prerequistite to make Airflow compatible with Python 3.12
+    # Tracked in https://github.com/apache/airflow/pull/36755
+    "universal-pathlib>=0.1.4,<0.2.0",
     # Werkzug 3 breaks Flask-Login 0.6.2, also connexion needs to be updated to >= 3.0
     # we should remove this limitation when FAB supports Flask 2.3 and we migrate connexion to 3+
     "werkzeug>=2.0,<3",