You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Jarek Potiuk (Jira)" <ji...@apache.org> on 2020/01/19 23:28:00 UTC
[jira] [Resolved] (AIRFLOW-3291) Update S3KeySensor to not need
s3:GetObject permissions
[ https://issues.apache.org/jira/browse/AIRFLOW-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarek Potiuk resolved AIRFLOW-3291.
-----------------------------------
Resolution: Won't Fix
> Update S3KeySensor to not need s3:GetObject permissions
> -------------------------------------------------------
>
> Key: AIRFLOW-3291
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3291
> Project: Apache Airflow
> Issue Type: Improvement
> Reporter: Ash Berlin-Taylor
> Priority: Major
>
> The S3KeySensor/S3Hook as it is currently written requires {{s3:GetObject}} permissions on the bucket (as it does a HeadObject API call) - it would be nice if it could use ListBucket instead as for our use case we don't really want Airflow reading the files as EMR does that for us.
> This would be doable by changing the implemention of check_key_exists and check_wildcard_exists(?) to use list instead/only and not try to load the Key object.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)