You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/14 06:35:00 UTC

[jira] [Created] (SPARK-37638) Make static and core configuration log less noisy when creating a Spark session

Hyukjin Kwon created SPARK-37638:
------------------------------------

             Summary: Make static and core configuration log less noisy when creating a Spark session
                 Key: SPARK-37638
                 URL: https://issues.apache.org/jira/browse/SPARK-37638
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.3.0
            Reporter: Hyukjin Kwon
            Assignee: Hyukjin Kwon


It is too noisy to show warnings every time when a Spark session is created. For example, if a user application depends on a logic that getOrCreate logic to perform operations every time, they get a hundreds of same warnings.

We should better lower then log level, and show which configurations are duplicate.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org