[jira] [Issue Comment Deleted] (SPARK-11502) Word2VecSuite needs appropriate checks

["Teng Peng (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Teng Peng updated SPARK-11502:
------------------------------
    Comment: was deleted

(was: I am interested in this one. My plan is to compare the test against 1. other ML tests 2. other Word2Vec library's tests.)

> Word2VecSuite needs appropriate checks
> --------------------------------------
>
>                 Key: SPARK-11502
>                 URL: https://issues.apache.org/jira/browse/SPARK-11502
>             Project: Spark
>          Issue Type: Test
>          Components: ML
>    Affects Versions: 1.6.0
>            Reporter: Imran Rashid
>            Priority: Minor
>
> When the random number generator was changed slightly in SPARK-10116, {{ml.feature.Word2VecSuite}} started failing.  The tests were updated to have "magic" values, to at least provide minimal characterization tests preventing more behavior changes.  However, the tests really need to be improved to have more sensible checks.
> Note that brute force search over seeds from 0 to 1000 failed to find one that worked -- the input data seems to be careful chosen for the previous random number generator / seed combo.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org