You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Cody Koeninger (JIRA)" <ji...@apache.org> on 2016/10/20 18:44:58 UTC

[jira] [Created] (SPARK-18033) Deprecate TaskContext.partitionId

Cody Koeninger created SPARK-18033:
--------------------------------------

             Summary: Deprecate TaskContext.partitionId
                 Key: SPARK-18033
                 URL: https://issues.apache.org/jira/browse/SPARK-18033
             Project: Spark
          Issue Type: Improvement
            Reporter: Cody Koeninger


Mark TaskContext.partitionId as deprecated, because it doesn't always reflect the physical index at the time the RDD is created.  Add a foreachPartitionWithIndex method to mirror the existing mapPartitionsWithIndex method.

For background, see

http://apache-spark-developers-list.1001551.n3.nabble.com/PSA-TaskContext-partitionId-the-actual-logical-partition-index-td19524.html





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org