You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (Jira)" <ji...@apache.org> on 2019/09/30 18:03:00 UTC
[jira] [Commented] (AIRFLOW-5231) S3Hook delete fails with over
1000 keys
[ https://issues.apache.org/jira/browse/AIRFLOW-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941199#comment-16941199 ]
jack commented on AIRFLOW-5231:
-------------------------------
In luigi it was solved with loop deleting 1000 files each time
[https://github.com/spotify/luigi/pull/2529]
[~feluelle] maybe you would be interested in this
> S3Hook delete fails with over 1000 keys
> ---------------------------------------
>
> Key: AIRFLOW-5231
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5231
> Project: Apache Airflow
> Issue Type: Bug
> Components: aws, hooks
> Affects Versions: 2.0.0
> Reporter: Silviu Tantos
> Priority: Major
>
> Error raised:
> {noformat}
> botocore.exceptions.ClientError: An error occurred (MalformedXML) when calling the DeleteObjects operation: The XML you provided was not well-formed or did not validate against our published schema{noformat}
> See also: https://github.com/spotify/luigi/issues/2511
--
This message was sent by Atlassian Jira
(v8.3.4#803005)