[jira] [Commented] (SPARK-20221) Port pyspark.mllib.linalg tests in pyspark/mllib/tests.py to pyspark.ml.linalg

["Daniel Imberman (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-20221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169502#comment-16169502 ] 

Daniel Imberman commented on SPARK-20221:
-----------------------------------------

Hi [~josephkb],

I would like to complete this ticket but have a few clarifying questions (to be certain that I am porting over the right work + don't miss anything).

1. I see that there are a few missing tests in ChiSquareTestTests, DimensionalityReductionTests, and MlUtilsTests, are there any other tests I should be porting over?

2. for VectorTests, it appears that all the tests are equivalent except for a few conversion mllib -> ml functions. I assume these would not be ported over?

3. Since there is no distributed "RowMatrix" class in spark/ml, would you want me to simply turn these into dataframes?

Thank you,

Daniel

> Port pyspark.mllib.linalg tests in pyspark/mllib/tests.py to pyspark.ml.linalg
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-20221
>                 URL: https://issues.apache.org/jira/browse/SPARK-20221
>             Project: Spark
>          Issue Type: Test
>          Components: ML, PySpark, Tests
>    Affects Versions: 2.2.0
>            Reporter: Joseph K. Bradley
>
> There are several linear algebra unit tests in pyspark/mllib/tests.py which should be ported over to pyspark/ml/tests.py.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org