You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Iuliia Volkova (JIRA)" <ji...@apache.org> on 2018/08/23 20:37:00 UTC
[jira] [Commented] (AIRFLOW-2932) GoogleCloudStorageHook - allow
compression of file
[ https://issues.apache.org/jira/browse/AIRFLOW-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590781#comment-16590781 ]
Iuliia Volkova commented on AIRFLOW-2932:
-----------------------------------------
[~kaxilnaik] and [~tswast] what do you think about this task? I can implement it this flag - gzip=False by default and if it's True - when compress file before upload.
> GoogleCloudStorageHook - allow compression of file
> --------------------------------------------------
>
> Key: AIRFLOW-2932
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2932
> Project: Apache Airflow
> Issue Type: Improvement
> Reporter: jack
> Priority: Major
> Fix For: 1.10.1
>
>
> The *upload*{color:#555555}({color}_bucket_{color:#555555}, {color}_object_{color:#555555}, {color}_filename_{color:#555555}, {color}_mime_type='application/octet-stream'_{color:#555555}){color} function allows to upload file from local disk.
> The google cloud support GZIP and BigQuery can read GZIP files. So, most people upload compressed files in order to save space.
> It would be nice if the upload function would be able to make the compression on it's own (if asked by the user). This will save the trouble of having to compress the file by ourselves.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)