You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "rahul-madaan (via GitHub)" <gi...@apache.org> on 2025/02/24 11:58:54 UTC
[I] Snowflake CopyFromExternalStageToSnowflake OpenLineage support not working [airflow]
rahul-madaan opened a new issue, #47019:
URL: https://github.com/apache/airflow/issues/47019
### Apache Airflow Provider(s)
snowflake
### Versions of Apache Airflow Providers
apache_airflow_providers_snowflake-6.0.0
### Apache Airflow version
2.9.3
### Operating System
Mac OS Sequioa 15.3 (24D60)
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
I am using breeze, standard deployment
```
breeze start-airflow --integration openlineage -b postgres --use-airflow-version 2.9.3
```
### What happened
We are not getting inputs in OpenLineage COMPLETE event.
This is due to a check on `status` key in the result row from snowflake.
and we have a check on existance of `status` key, which is passing empty list in the parsing function.
### What you think should happen instead
Ideally we should be getting correct inputs in the openlineage COMPLETE event according to the implementation.
The function should check the status value before passing an empty list to the parsing function.
### How to reproduce
Use CopyFromExternalStageToSnowflake Operator in Airflow with OpenLineage events enabled, you will not get any inputs in the OL COMPLETE event.
### Anything else
_No response_
### Are you willing to submit PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Snowflake CopyFromExternalStageToSnowflake OpenLineage support not working [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #47019: Snowflake CopyFromExternalStageToSnowflake OpenLineage support not working
URL: https://github.com/apache/airflow/issues/47019
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Snowflake CopyFromExternalStageToSnowflake OpenLineage support not working [airflow]
Posted by "kacpermuda (via GitHub)" <gi...@apache.org>.
kacpermuda commented on issue #47019:
URL: https://github.com/apache/airflow/issues/47019#issuecomment-2684721331
Hey Rahul, thanks for the issue. As discussed on Slack [here](https://openlineage.slack.com/archives/C01CK9T7HKR/p1739826600770119), there might be some adjustments needed if the result from Snowflake has changed + some test to cover that. Let me know when you have some time to dig into that and prepare a PR, will be happy to review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Snowflake CopyFromExternalStageToSnowflake OpenLineage support not working [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #47019:
URL: https://github.com/apache/airflow/issues/47019#issuecomment-2683246292
cc @kacpermuda
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org