You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2023/03/06 16:47:00 UTC

[jira] [Commented] (SPARK-42686) TaskMemoryManager debug logging is expensive

    [ https://issues.apache.org/jira/browse/SPARK-42686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17697032#comment-17697032 ] 

Apache Spark commented on SPARK-42686:
--------------------------------------

User 'alkis' has created a pull request for this issue:
https://github.com/apache/spark/pull/40302

> TaskMemoryManager debug logging is expensive
> --------------------------------------------
>
>                 Key: SPARK-42686
>                 URL: https://issues.apache.org/jira/browse/SPARK-42686
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.3.2
>            Reporter: Alkis Evlogimenos
>            Priority: Major
>
> TaskMemoryManager debug logging is expensive mostly because formatting operations are done eagerly and some of them are quite expensive (i.e. humanized strings). This causes visible CPU usage in scan benchmarks for example.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org