[jira] [Comment Edited] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

["Leah (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925859#comment-16925859 ] 

Leah edited comment on AIRFLOW-5418 at 9/9/19 3:57 PM:
-------------------------------------------------------

Hey [~kamil.bregula]! Good point - those rules do apply, but I actually see that the top part of those docs is kind of misleading. If you scroll down a little further to the [Object Naming Considerations|https://cloud.google.com/storage/docs/naming#object-considerations] it talks about the use of slashes. Objects can have slashes in the name, and in the UI they render as if they were subdirectories, though under the hood the object exists in the bucket and just has a name with slashes in it. 


was (Author: lcolium):
Hey [~kamil.bregula]! Yeah - that top part is kind of misleading. If you scroll down a little further to the [Object Naming Considerations|https://cloud.google.com/storage/docs/naming#object-considerations] it talks about the use of slashes. Objects can have slashes in the name, and in the UI they render as if they were subdirectories, though under the hood the object exists in the bucket and just has a name with slashes in it. 

> bucket names with a slash in them cause an error with the GCS Download Operator
> -------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-5418
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5418
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: operators
>    Affects Versions: 1.8.0, 1.8.1, 1.8.2, 1.9.0, 1.10.0, 1.10.1, 1.10.2, 1.10.3, 1.10.4, 1.10.5
>            Reporter: Leah
>            Priority: Minor
>
> If you try to use the GCS Downlaod Operator on a bucket that has a slash in the name, for example, my-bucket/dags, the operation results in a "Bad Request" error. I replicated this error consistently in Cloud Composer (GCP hosted managed Airflow) and was able to get it to work on a bucket name without a slash in it. I was not able to use a backslash to escape the slash when passing in the bucket name either. 
>  
>  
> {{[2019-09-05 23:51:53,951] \{models.py:1796} ERROR - <HttpError 400 when requesting https://www.googleapis.com/storage/v1/b/my-bucket/dags/o/gcs_download.py?alt=media returned "Bad Request">}}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)