[jira] [Commented] (SPARK-2913) Spark's log4j.properties should always appear ahead of Hadoop's on classpath

["Josh Rosen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090087#comment-14090087 ] 

Josh Rosen commented on SPARK-2913:
-----------------------------------

Posted some workarounds on a StackOverflow question asking about this issue: http://stackoverflow.com/questions/25193488/how-to-turn-off-info-logging-in-pyspark

> Spark's log4j.properties should always appear ahead of Hadoop's on classpath
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-2913
>                 URL: https://issues.apache.org/jira/browse/SPARK-2913
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 1.0.0, 1.1.0, 1.0.2
>            Reporter: Josh Rosen
>            Assignee: Josh Rosen
>             Fix For: 1.1.0
>
>
> In the current {{compute-classpath}} scripts, the Hadoop conf directory may appear before Spark's conf directory in the computed classpath.  This leads to Hadoop's log4j.properties being used instead of Spark's, preventing users from easily changing Spark's logging settings.
> To fix this, we should add a new classpath entry for Spark's log4j.properties file.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org