You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Jarek Potiuk (Jira)" <ji...@apache.org> on 2020/01/19 23:28:00 UTC

[jira] [Resolved] (AIRFLOW-3291) Update S3KeySensor to not need s3:GetObject permissions

     [ https://issues.apache.org/jira/browse/AIRFLOW-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Potiuk resolved AIRFLOW-3291.
-----------------------------------
    Resolution: Won't Fix

> Update S3KeySensor to not need s3:GetObject permissions
> -------------------------------------------------------
>
>                 Key: AIRFLOW-3291
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3291
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Ash Berlin-Taylor
>            Priority: Major
>
> The S3KeySensor/S3Hook as it is currently written requires {{s3:GetObject}} permissions on the bucket (as it does a HeadObject API call) - it would be nice if it could use ListBucket instead as for our use case we don't really want Airflow reading the files as EMR does that for us.
> This would be doable by changing the implemention of check_key_exists and check_wildcard_exists(?) to use list instead/only and not try to load the Key object.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)