[GitHub] spark pull request: SPARK-4170 [CORE] Closure problems when runnin...

[jongwook <gi...@git.apache.org>]

Github user jongwook commented on the pull request:

    https://github.com/apache/spark/pull/3497#issuecomment-73205703
  
    well, after some disappointment that I have to write `def main(args: Array[String])` and add an additional level of indentation to the whole file, I realized that the following works:
    
    ```scala
    object HowToBroadcast extends App {{
      val sc = ...
      val broadcast = sc.broadcast(List("Hello", "World"))
      sc.parallelize(1 to 10).map(x => broadcast.value).collect().foreach(println)
    }}
    ```
    
    Not a very good coding convention but it is a trick to avoid the discrepancy of the compile-time and runtime behavior of `DelayedInit`, and captured references get serialized correctly between hosts.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org