You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Kuai Yu (Jira)" <ji...@apache.org> on 2020/04/27 19:06:00 UTC

[jira] [Created] (GOBBLIN-1129) clean up staging table created by avro2orc pipeline

Kuai Yu created GOBBLIN-1129:
--------------------------------

             Summary: clean up staging table created by avro2orc pipeline
                 Key: GOBBLIN-1129
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1129
             Project: Apache Gobblin
          Issue Type: Improvement
            Reporter: Kuai Yu


During the avro2orc conversion, many staging tables are created, they are not cleaned up due to the pipeline failure, and next execution doesn't take care of the clean up, which caused the staging table taking many spaces in hive metastore.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)