You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2018/09/06 10:52:00 UTC
[jira] [Commented] (AIRFLOW-2932) GoogleCloudStorageHook - allow
compression of file
[ https://issues.apache.org/jira/browse/AIRFLOW-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605628#comment-16605628 ]
jack commented on AIRFLOW-2932:
-------------------------------
[~xnuinside] [~kaxilnaik] This is exactly my intention :) I hope this tweak will made it to 1.10.1
> GoogleCloudStorageHook - allow compression of file
> --------------------------------------------------
>
> Key: AIRFLOW-2932
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2932
> Project: Apache Airflow
> Issue Type: Improvement
> Affects Versions: 1.10.0
> Reporter: jack
> Priority: Major
>
> The *upload*{color:#555555}({color}_bucket_{color:#555555}, {color}_object_{color:#555555}, {color}_filename_{color:#555555}, {color}_mime_type='application/octet-stream'_{color:#555555}){color} function allows to upload file from local disk.
> The google cloud support GZIP and BigQuery can read GZIP files. So, most people upload compressed files in order to save space.
> It would be nice if the upload function would be able to make the compression on it's own (if asked by the user). This will save the trouble of having to compress the file by ourselves.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)