You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2021/08/05 02:16:00 UTC
[jira] [Resolved] (SPARK-36173) [CORE] Support getting CPU number
in TaskContext
[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mridul Muralidharan resolved SPARK-36173.
-----------------------------------------
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 33385
[https://github.com/apache/spark/pull/33385]
> [CORE] Support getting CPU number in TaskContext
> ------------------------------------------------
>
> Key: SPARK-36173
> URL: https://issues.apache.org/jira/browse/SPARK-36173
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.1.2
> Reporter: Xiaochang Wu
> Assignee: Xiaochang Wu
> Priority: Major
> Fix For: 3.3.0
>
>
> In stage-level resource scheduling, the allocated 3rd party resources can be obtained in TaskContext using resources() interface, however there is no API to get how many cpus are allocated for the task. Will add a cpus() interface to TaskContext in addition to resources().
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org