You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "mpgreg (via GitHub)" <gi...@apache.org> on 2023/10/27 11:40:14 UTC

Re: [I] Add Snowpark Operator that allows execution of Snowflake Snowpark code [airflow]

mpgreg commented on issue #24456:
URL: https://github.com/apache/airflow/issues/24456#issuecomment-1782768323

   @ryaminal I have started a PR at https://github.com/mpgreg/airflow/tree/main/airflow/providers/snowflake
   
   @mik-laj @sfc-gh-madkins I also ran into the same cloudpickle dependency issues.  Anything you can do to help move https://github.com/snowflakedb/snowpark-python/pull/975 along?
   
   ```The conflict is caused by:
   10.65     apache-airflow[devel-ci] 2.8.0.dev0 depends on cloudpickle>=1.4.1
   10.65     apache-beam 2.51.0 depends on cloudpickle~=2.2.1
   10.65     dask 2023.4.1 depends on cloudpickle>=1.5.0
   10.65     distributed 2023.4.1 depends on cloudpickle>=1.5.0
   10.65     snowflake-snowpark-python 1.9.0 depends on cloudpickle<=2.0.0 and >=1.6.0; python_version < "3.11"
   10.65     apache-airflow[devel-ci] 2.8.0.dev0 depends on cloudpickle>=1.4.1
   10.65     apache-beam 2.51.0 depends on cloudpickle~=2.2.1
   10.65     dask 2023.4.1 depends on cloudpickle>=1.5.0
   10.65     distributed 2023.4.1 depends on cloudpickle>=1.5.0
   10.65     snowflake-snowpark-python 1.8.0 depends on cloudpickle<=2.0.0 and >=1.6.0
   10.65     apache-airflow[devel-ci] 2.8.0.dev0 depends on cloudpickle>=1.4.1
   10.65     apache-beam 2.51.0 depends on cloudpickle~=2.2.1
   10.65     dask 2023.4.1 depends on cloudpickle>=1.5.0
   10.65     distributed 2023.4.1 depends on cloudpickle>=1.5.0
   10.65     snowflake-snowpark-python 1.7.0 depends on cloudpickle<=2.0.0 and >=1.6.0
   10.65     The user requested (constraint) cloudpickle==2.2.1```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org