You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2017/06/11 00:34:18 UTC

[jira] [Created] (SPARK-21050) ml word2vec write has overflow issue in calculating numPartitions

Joseph K. Bradley created SPARK-21050:
-----------------------------------------

             Summary: ml word2vec write has overflow issue in calculating numPartitions
                 Key: SPARK-21050
                 URL: https://issues.apache.org/jira/browse/SPARK-21050
             Project: Spark
          Issue Type: Bug
          Components: ML
    Affects Versions: 2.2.0
            Reporter: Joseph K. Bradley
            Assignee: Joseph K. Bradley


The method calculateNumberOfPartitions() uses Int, not Long (unlike the MLlib version), so it is very easily to have an overflow in calculating the number of partitions for ML persistence.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org