You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Xiaodong DENG (JIRA)" <ji...@apache.org> on 2018/08/17 14:29:00 UTC

[jira] [Created] (AIRFLOW-2913) Check bucket_key and bucket_name combination in S3KeySensor()

Xiaodong DENG created AIRFLOW-2913:
--------------------------------------

             Summary: Check bucket_key and bucket_name combination in S3KeySensor()
                 Key: AIRFLOW-2913
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2913
             Project: Apache Airflow
          Issue Type: Improvement
          Components: operators
            Reporter: Xiaodong DENG
            Assignee: Xiaodong DENG


1. When *bucket_name* is provided, and *bucket_key* is also provided as a full S3:// url, the full_url obtained eventually will be wrong. It will be like "_s3://bucket_name/s3://bucket_name/object_key_". This should be avoided by adding checking and raise exception in such case.

2. Given the documentation is not clear enough, this may happen to new users of S3KeySensor() (like myself). I have improved the Documentation as well.

3. Unit tests are added for the bucket_key and bucket_name combination checking as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)