You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ted Yu (JIRA)" <ji...@apache.org> on 2015/09/10 21:17:45 UTC

[jira] [Created] (SPARK-10546) Check partitionId's range in ExternalSorter#spill()

Ted Yu created SPARK-10546:
------------------------------

             Summary: Check partitionId's range in ExternalSorter#spill()
                 Key: SPARK-10546
                 URL: https://issues.apache.org/jira/browse/SPARK-10546
             Project: Spark
          Issue Type: Improvement
    Affects Versions: 1.4.1
            Reporter: Ted Yu
            Priority: Minor


See this thread for background:
http://search-hadoop.com/m/q3RTt0rWvIkHAE81

We should check the range of partition Id and provide meaningful message through exception.

Alternatively, we can use abs() and modulo to force the partition Id into legitimate range. However, expectation is that user should correct the logic error in his / her code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org