[jira] [Created] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized

["Marcelo Vanzin (JIRA)" <ji...@apache.org>]

Marcelo Vanzin created SPARK-25546:
--------------------------------------

             Summary: RDDInfo uses SparkEnv before it may have been initialized
                 Key: SPARK-25546
                 URL: https://issues.apache.org/jira/browse/SPARK-25546
             Project: Spark
          Issue Type: Bug
          Components: Spark Core, Tests
    Affects Versions: 2.4.0
            Reporter: Marcelo Vanzin


This code:

{code}
private[spark] object RDDInfo {
  private val callsiteLongForm = SparkEnv.get.conf.get(EVENT_LOG_CALLSITE_LONG_FORM)
{code}

Has two problems:
- it keeps that value across different SparkEnv instances. So e.g. if you have two tests that rely on different values for that config, one of them will break.
- it assumes tests always initialize a SparkEnv. e.g. if you run "core/testOnly *.AppStatusListenerSuite", it will fail because {{SparkEnv.get}} returns null.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org