You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:15:08 UTC

[jira] [Resolved] (SPARK-11502) Word2VecSuite needs appropriate checks

     [ https://issues.apache.org/jira/browse/SPARK-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-11502.
----------------------------------
    Resolution: Incomplete

> Word2VecSuite needs appropriate checks
> --------------------------------------
>
>                 Key: SPARK-11502
>                 URL: https://issues.apache.org/jira/browse/SPARK-11502
>             Project: Spark
>          Issue Type: Test
>          Components: ML
>    Affects Versions: 1.6.0
>            Reporter: Imran Rashid
>            Priority: Minor
>              Labels: bulk-closed
>
> When the random number generator was changed slightly in SPARK-10116, {{ml.feature.Word2VecSuite}} started failing.  The tests were updated to have "magic" values, to at least provide minimal characterization tests preventing more behavior changes.  However, the tests really need to be improved to have more sensible checks.
> Note that brute force search over seeds from 0 to 1000 failed to find one that worked -- the input data seems to be careful chosen for the previous random number generator / seed combo.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org