You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Nick Pentreath (JIRA)" <ji...@apache.org> on 2016/04/30 09:48:12 UTC

[jira] [Commented] (SPARK-15027) ALS.train should use DataFrame instead of RDD

    [ https://issues.apache.org/jira/browse/SPARK-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265228#comment-15265228 ] 

Nick Pentreath commented on SPARK-15027:
----------------------------------------

[~mengxr] are you intending this to be a more "superficial" change (as in, change the signature of train to take a Dataset, but still operate on RDDs inside the method), or try to have the entire algorithm operate on Dataset?

> ALS.train should use DataFrame instead of RDD
> ---------------------------------------------
>
>                 Key: SPARK-15027
>                 URL: https://issues.apache.org/jira/browse/SPARK-15027
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML, PySpark
>    Affects Versions: 2.0.0
>            Reporter: Xiangrui Meng
>            Assignee: Xiangrui Meng
>
> This continue the work from SPARK-14412 to update `intermediateRDDStorageLevel` to `intermediateStorageLevel`, and `finalRDDStorageLevel` to `finalStoargeLevel`. We should also update `ALS.train` to use `Dataset` instead of `RDD`.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org