You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/09 11:04:37 UTC

[GitHub] [airflow] eladkal commented on issue #18111: HeadObject error when trying to upload file to S3

eladkal commented on issue #18111:
URL: https://github.com/apache/airflow/issues/18111#issuecomment-915986024


   > AirFlow should try and upload the file, even if it already exists
   
   `load_file` has `replace` parameter (default False)
   https://github.com/apache/airflow/blob/43f595fe1b8cd6f325d8535c03ee219edbf4a559/airflow/providers/amazon/aws/hooks/s3.py#L499-L500 
   You don't set it in your example so it will not try to overwrite existed key.
   
   Is your suggestion only catch the error from the API and change it to an Airflow error?
   You are always welcome to open PR directly with your suggested code.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org