You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "William Lo (Jira)" <ji...@apache.org> on 2023/01/27 00:58:00 UTC

[jira] [Created] (GOBBLIN-1771) Reduce logs in failed job states and cleanup

William Lo created GOBBLIN-1771:
-----------------------------------

             Summary: Reduce logs in failed job states and cleanup
                 Key: GOBBLIN-1771
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1771
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-core
            Reporter: William Lo
            Assignee: Abhishek Tiwari


Large datasets (multiple terabytes), depending on their jobs, can send a large number of repetitive logs for failing dataset states and cleaning up the dataset state.

We should make the logs more meaningful by reducing their number for these scenarios.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)