You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Alkis Evlogimenos (Jira)" <ji...@apache.org> on 2023/03/06 16:12:00 UTC

[jira] [Created] (SPARK-42686) TaskMemoryManager debug logging is expensive

Alkis Evlogimenos created SPARK-42686:
-----------------------------------------

             Summary: TaskMemoryManager debug logging is expensive
                 Key: SPARK-42686
                 URL: https://issues.apache.org/jira/browse/SPARK-42686
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.3.2
            Reporter: Alkis Evlogimenos


TaskMemoryManager debug logging is expensive mostly because formatting operations are done eagerly and some of them are quite expensive (i.e. humanized strings). This causes visible CPU usage in scan benchmarks for example.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org