[jira] [Created] (SPARK-15773) Avoid creating local variable `sc` in examples

["Dongjoon Hyun (JIRA)" <ji...@apache.org>]

Dongjoon Hyun created SPARK-15773:
-------------------------------------

             Summary: Avoid creating local variable `sc` in examples
                 Key: SPARK-15773
                 URL: https://issues.apache.org/jira/browse/SPARK-15773
             Project: Spark
          Issue Type: Task
          Components: Examples
            Reporter: Dongjoon Hyun
            Priority: Minor


Instead of using local variable `sc` like the following example, this issue uses `spark.sparkContext`. This makes examples more concise, and also fixes some misleading, i.e., creating SparkContext from SparkSession.

{code}
-    println("Creating SparkContext")
-    val sc = spark.sparkContext
-
     println("Writing local file to DFS")
     val dfsFilename = dfsDirPath + "/dfs_read_write_test"
-    val fileRDD = sc.parallelize(fileContents)
+    val fileRDD = spark.sparkContext.parallelize(fileContents)
{code}

This will change 12 files (+30 lines, -52 lines).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org