You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Ultrabug (JIRA)" <ji...@apache.org> on 2017/04/21 07:12:04 UTC

[jira] [Created] (AIRFLOW-1135) Clearing XCom data from previous executions

Ultrabug created AIRFLOW-1135:
---------------------------------

             Summary: Clearing XCom data from previous executions
                 Key: AIRFLOW-1135
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1135
             Project: Apache Airflow
          Issue Type: New Feature
          Components: db
            Reporter: Ultrabug


It looks like XCom data from previous executions of tasks are never cleared from database and that there's no easy way to do so.

Since XComs are created by execution_date of a task, when a task heavily uses XComs (like 20 000+) we can end up with a large xcom table on the database.

Is there something I'm missing about cleaning up those previous XComs from database (since they're not used anymore) ?

Would you accept the idea of having a new PR providing a helper to remove them ?

Thanks



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)