You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "William Lo (Jira)" <ji...@apache.org> on 2024/04/01 21:39:00 UTC

[jira] [Created] (GOBBLIN-2032) Support making log dir sink optional

William Lo created GOBBLIN-2032:
-----------------------------------

             Summary: Support making log dir sink optional
                 Key: GOBBLIN-2032
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-2032
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-cluster
            Reporter: William Lo
            Assignee: Hung Tran


In Gobblin cluster, there is a configuration to set the log sink in order to create a log copier service which copies logs to HDFS from Yarn cluster.

Since Yarn has a built in log aggregator, we should have a way to disable this log sink since it becomes redundant, so we should look into ways to make the log directory optional.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)