You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2020/11/10 02:21:00 UTC

[jira] [Created] (HDDS-4442) Disable the location information of audit logger to reduce overhead

Wei-Chiu Chuang created HDDS-4442:
-------------------------------------

             Summary: Disable the location information of audit logger to reduce overhead
                 Key: HDDS-4442
                 URL: https://issues.apache.org/jira/browse/HDDS-4442
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
          Components: OM
    Affects Versions: 1.0.0
            Reporter: Wei-Chiu Chuang


Log4j2 has substantial overhead with the default configuration. We found more than 20%~30% OM overhead in a microbenchmark (in which clients sends lookupFile calls)  was spent on audit logging, even though we use async audit logger.

Note that while the log4j2 documentation states the location information is disabled by default, we found that explicitly disabling location information has visible performance improvement.

Solution:
 add {{rootLogger.includeLocation=false}} to OM's audit logger property (om-audit-log4j2.properties file)

After this change, the audit logger overhead reduced to 7%

According to LOG4J2-2644, log4j2 2.12.1 and above improved this. So Ozone 1.1 should be in much better shape. File this Jira for future reference.

Credit: [~adoroszlai] for identifying the solution.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org