You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2019/04/17 06:42:00 UTC

[jira] [Created] (AIRFLOW-4336) GoogleCloudStorageDownloadOperator allow not to save file to log

jack created AIRFLOW-4336:
-----------------------------

             Summary: GoogleCloudStorageDownloadOperator allow not to save file to log
                 Key: AIRFLOW-4336
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4336
             Project: Apache Airflow
          Issue Type: Wish
          Components: gcp, operators
            Reporter: jack
             Fix For: 1.10.4


The operator has 
{code:java}
store_to_xcom_key {code}
flag which allow the user to deiced if to store the file in Xcom or not but there is no flag to specify if the file should be saved to the task log.

Currently the operator auto save the file to the log.

We use the operator in production. It download enormousness amount of files of GBs which spam the log with millions of rows. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)