You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/09/12 23:20:34 UTC

[jira] [Created] (SPARK-3513) Provide a utility for running a function once on each executor

Patrick Wendell created SPARK-3513:
--------------------------------------

             Summary: Provide a utility for running a function once on each executor
                 Key: SPARK-3513
                 URL: https://issues.apache.org/jira/browse/SPARK-3513
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
            Reporter: Patrick Wendell
            Priority: Minor
             Fix For: 1.2.0


This is minor, but it would be nice to have a utility where you can pass a function and it will run some arbitrary function once on each each executor and return the result to you (e.g. you could perform a jstack from within the JVM). You could probably hack it together with custom locality preferences, accessing the list of live executors, and mapPartitions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org