[jira] [Commented] (SPARK-39998) Can't set pyspark log level in log4j2.properties

["Mario Grgic (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-39998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576265#comment-17576265 ] 

Mario Grgic commented on SPARK-39998:
-------------------------------------

It turns out this is related to https://issues.apache.org/jira/browse/LOG4J2-1890

 

By removing spaces this works:

 

{{logger.pyspark.name=org.apache.spark.api.python.PythonGatewayServer}}
{{logger.pyspark.level=error}}

 

> Can't set pyspark log level in log4j2.properties
> ------------------------------------------------
>
>                 Key: SPARK-39998
>                 URL: https://issues.apache.org/jira/browse/SPARK-39998
>             Project: Spark
>          Issue Type: Question
>          Components: PySpark
>    Affects Versions: 3.3.0
>            Reporter: Mario Grgic
>            Priority: Trivial
>
> In previous versions of Apache Spark it was possible to configure pyspark log level by adding following line to log4j.properties:
>  
> {{log4j.logger.org.apache.spark.api.python.PythonGatewayServer=ERROR}}
>  
> With the move to log4j2.properties format, this no longer works. I have tried modifying the above line to:
> {{logger.pyspark.name = org.apache.spark.api.python.PythonGatewayServer}}
> {{logger.pyspark.level = error}}
>  
> but that does not work either. 
> I would appreciate any help with the correct syntax.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org