You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2021/12/18 15:15:19 UTC

[airflow] branch main updated: Limit Snowflake connector to< 2.7.2 (#20395)

This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 0050e44  Limit Snowflake connector to< 2.7.2 (#20395)
0050e44 is described below

commit 0050e44f473ad2802c882cf008846a32c83d009d
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Sat Dec 18 16:14:42 2021 +0100

    Limit Snowflake connector to< 2.7.2 (#20395)
    
    The Snowflake connector 2.7.2 requires pyarrow to be >=6.0.0
    (but it has no "install_requires" for it - it checks it
    dynamically and prints warning when imported.
    
    We should limit the provider until apache-beam will remove the
    pyarrow < 6.0.0 limitation.
---
 setup.py | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/setup.py b/setup.py
index 90dd4e4..a6ad949 100644
--- a/setup.py
+++ b/setup.py
@@ -468,7 +468,9 @@ slack = [
     'slack_sdk>=3.0.0,<4.0.0',
 ]
 snowflake = [
-    'snowflake-connector-python>=2.4.1',
+    # Snowflake connector 2.7.2 requires pyarrow >=6.0.0 but apache-beam requires < 6.0.0
+    # We should remove the limitation when apache-beam upgrades pyarrow
+    'snowflake-connector-python>=2.4.1,<2.7.2',
     # The snowflake-alchemy 1.2.5 introduces a hard dependency on sqlalchemy>=1.4.0, but they didn't define
     # this requirements in setup.py, so pip cannot figure out the correct set of dependencies.
     # See: https://github.com/snowflakedb/snowflake-sqlalchemy/issues/234