You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2018/10/29 12:13:01 UTC

[jira] [Issue Comment Deleted] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

     [ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

jack updated AIRFLOW-2999:
--------------------------
    Comment: was deleted

(was: [~wileeam] I saw you assigned yourself on

[https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-2332]  which is duplicates of this ticket.

Are you working on this?

 

 )

> S3_hook  - add the ability to download file to local disk
> ---------------------------------------------------------
>
>                 Key: AIRFLOW-2999
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2999
>             Project: Apache Airflow
>          Issue Type: Task
>    Affects Versions: 1.10.0
>            Reporter: jack
>            Priority: Major
>
> The [S3_hook |https://github.com/apache/incubator-airflow/blob/master/airflow/hooks/S3_hook.py#L177] has get_key method that returns boto3.s3.Object it also has load_file method which loads file from local file system to S3.
>  
> What it doesn't have is a method to download a file from S3 to the local file system.
> Basicly it should be something very simple... an extention to the get_key method with parameter to the destination on local file system adding a code for taking the boto3.s3.Object and save it on the disk.  Note: that it can be more than 1 file if the user choose a folder in S3.
>  
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)