You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2021/12/18 15:15:19 UTC
[airflow] branch main updated: Limit Snowflake connector to< 2.7.2 (#20395)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 0050e44 Limit Snowflake connector to< 2.7.2 (#20395)
0050e44 is described below
commit 0050e44f473ad2802c882cf008846a32c83d009d
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Sat Dec 18 16:14:42 2021 +0100
Limit Snowflake connector to< 2.7.2 (#20395)
The Snowflake connector 2.7.2 requires pyarrow to be >=6.0.0
(but it has no "install_requires" for it - it checks it
dynamically and prints warning when imported.
We should limit the provider until apache-beam will remove the
pyarrow < 6.0.0 limitation.
---
setup.py | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/setup.py b/setup.py
index 90dd4e4..a6ad949 100644
--- a/setup.py
+++ b/setup.py
@@ -468,7 +468,9 @@ slack = [
'slack_sdk>=3.0.0,<4.0.0',
]
snowflake = [
- 'snowflake-connector-python>=2.4.1',
+ # Snowflake connector 2.7.2 requires pyarrow >=6.0.0 but apache-beam requires < 6.0.0
+ # We should remove the limitation when apache-beam upgrades pyarrow
+ 'snowflake-connector-python>=2.4.1,<2.7.2',
# The snowflake-alchemy 1.2.5 introduces a hard dependency on sqlalchemy>=1.4.0, but they didn't define
# this requirements in setup.py, so pip cannot figure out the correct set of dependencies.
# See: https://github.com/snowflakedb/snowflake-sqlalchemy/issues/234