You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/02/18 13:24:59 UTC

[GitHub] [airflow] marksworn edited a comment on pull request #11284: Improve GCSToSFTPOperator paths handling

marksworn edited a comment on pull request #11284:
URL: https://github.com/apache/airflow/pull/11284#issuecomment-781331423


   This does not appear to be working for me - the documentation is unclear which should be used to exclude the GCS path structure from the destination path - True or False? I have tested with both and with both it is still adding elements of the GCS filepath that I do not want to include.
   
   This is a useful feature in some cases, but it feels like it should be default that the user controls definition of the source and destination paths without any unexpected behaviour.
   
   With `keep_directory_structure=False` and destination set to `/Activity/pending/`:
   
   `Executing copy of gs://<bucket>/Activity/2021/02/activity_20210217.csv to /Activity/pending/Activity/2021/02/activity_20210217.csv`
   
   With `keep_directory_structure=True`:
   
   `Executing copy of gs://<bucket>/Activity/2021/02/activity_20210217.csv to /Activity/pending/Activity/2021/02/activity_20210217.csv`
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org