You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/02/07 23:12:13 UTC

[GitHub] [airflow] kazanzhy commented on issue #21388: Optionally raise an error if source file does not exist in GCSToGCSOperator

kazanzhy commented on issue #21388:
URL: https://github.com/apache/airflow/issues/21388#issuecomment-1032029707


   Sounds interesting. It's pretty similar to pandas functions parameter - `errors={'ignore', 'raise', 'coerce'}`. But I see that there are a lot of different operators and sensors in Airflow that help you build complex pipelines with very simple blocks.
   
   I also implemented similar logic to RDS Operators with optional errors in the first iteration but after I decided to keep Operators as straightforward and simple as possible without any logic under the hood. 
   In this case, `GCSObjectExistenceSensor` might be useful. If something goes wrong you see it in the UI.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org