You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2018/10/16 13:37:00 UTC

[jira] [Commented] (AIRFLOW-1114) S3Hook doesn't support Minio

    [ https://issues.apache.org/jira/browse/AIRFLOW-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651707#comment-16651707 ] 

jack commented on AIRFLOW-1114:
-------------------------------

Is this still an issue? The S3Hook uses the AwsHook which uses boto3.

> S3Hook doesn't support Minio
> ----------------------------
>
>                 Key: AIRFLOW-1114
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1114
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: aws, hooks
>    Affects Versions: 1.8.0
>         Environment: I am running it from the following Docker image: https://github.com/puckel/docker-airflow
>            Reporter: Alessandro Cosentino
>            Priority: Major
>
> I want to mock an S3 bucket with Minio for local testing when using the S3Hook. If I specify a connection whose host url is {{localhost}}, the S3Hook fails to connect to the bucket because it can't infer the region.
> I suspect this is due to a bug in boto: https://github.com/boto/boto/issues/2624
> One solution would be to upgrade the S3Hook to boto3. If I get the green light, I will make a PR for that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)