You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Daniel Darabos (JIRA)" <ji...@apache.org> on 2014/06/10 13:09:01 UTC

[jira] [Created] (SPARK-2095) sc.getExecutorCPUCounts()

Daniel Darabos created SPARK-2095:
-------------------------------------

             Summary: sc.getExecutorCPUCounts()
                 Key: SPARK-2095
                 URL: https://issues.apache.org/jira/browse/SPARK-2095
             Project: Spark
          Issue Type: New Feature
          Components: Spark Core
            Reporter: Daniel Darabos
            Priority: Minor


We can get the amount of total and free memory (via getExecutorMemoryStatus) and blocks stored (via getExecutorStorageStatus) on the executors. I would also like to be able to query the available CPU per executor. This would be useful in dynamically deciding the number of partitions at the start of an operation. What do you think?



--
This message was sent by Atlassian JIRA
(v6.2#6252)