[GitHub] [airflow] kaxil commented on issue #4619: [AIRFLOW- boyscout] Enforce delimiter for gcs_to_gcs operator using a flag, enforce_delimiter

[GitBox <gi...@apache.org>]

kaxil commented on issue #4619: [AIRFLOW- boyscout] Enforce delimiter for gcs_to_gcs operator using a flag, enforce_delimiter
URL: https://github.com/apache/airflow/pull/4619#issuecomment-482886137
 
 
   @icaroNZ @kurtqq I am not able to reproduce this with the code in master. Following is the test I conducted: 
   
   Files inside my test bucket:
   ```
   a.csv
   a.py
   a2.py
   ```
   
   **DAG**:
   ```
   GoogleCloudStorageToGoogleCloudStorageOperator(
       task_id='copy_files',
       source_bucket=TEST_BUCKET,
       source_object='a*.csv',
       destination_bucket=TEST_BUCKET2,
       destination_object='copied_objects/',
   )
   ```
   
   **Logs**:
   ```
   [2019-04-13 21:57:10,622] {gcs_hook.py:139} INFO - Total Bytes: 1034328 | Bytes Written: 1034328
   [2019-04-13 21:57:10,624] {gcs_hook.py:151} INFO - Object a.csv in bucket *** copied to object a.csv in bucket ***
   ```
   ______
   
   When I run change source_object to `a*.py`, I get the following:
   **Logs**:
   ```
   [2019-04-13 21:58:39,162] {gcs_hook.py:139} INFO - Total Bytes: 1034328 | Bytes Written: 1034328
   [2019-04-13 21:58:39,167] {gcs_hook.py:151} INFO - Object a.py in bucket *** copied to object a.py in bucket ***
   [2019-04-13 21:58:39,458] {gcs_hook.py:139} INFO - Total Bytes: 1034328 | Bytes Written: 1034328
   [2019-04-13 21:58:39,460] {gcs_hook.py:151} INFO -  Object a2.py in bucket *** copied to object a2.py in bucket ***
   ```
   
   Can you guys confirm if you can reproduce it with the code in master?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services