You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2018/12/11 08:20:01 UTC
[jira] [Commented] (AIRFLOW-1158) Multipart uploads to s3 cut off
at nearest division
[ https://issues.apache.org/jira/browse/AIRFLOW-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16716518#comment-16716518 ]
jack commented on AIRFLOW-1158:
-------------------------------
According to the pull request this is no longer needed because Airflow uses boto3 upload_file now instead of FileChunkIO.
This can be closed.
> Multipart uploads to s3 cut off at nearest division
> ---------------------------------------------------
>
> Key: AIRFLOW-1158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1158
> Project: Apache Airflow
> Issue Type: Bug
> Components: aws, hooks
> Reporter: Maksim Pecherskiy
> Assignee: Maksim Pecherskiy
> Priority: Minor
>
> When I try to upload a file of say 104MBs, using multipart uploads of 10MB chunks, I get 10 chunks of 10MBs and that's it. The 4MBs left over do not get uploaded.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)