You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/07/05 16:28:08 UTC

[GitHub] [airflow] royberkoweee commented on pull request #9667: Allow `replace` flag in gcs_to_gcs operator.

royberkoweee commented on pull request #9667:
URL: https://github.com/apache/airflow/pull/9667#issuecomment-653909062


   Hey! 
   
   This small request is about allowing a `replace` flag in gcs_to_gcs operator.
   
   I thought it would be nice to have a 'replace' flag when moving files from GCS to GCS. 
   replace meaning, ignore files that already exist in the destination and move all requested source files (True by default) 
   
   If we are not replacing, list all files in the Destination GCS bucket and only keep those files which are present in Source GCS bucket and not in Destination GCS bucket
   
   Cheers


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org