[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

["Yongjia Wang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940702#comment-14940702 ] 

Yongjia Wang commented on SPARK-5874:
-------------------------------------

The functionality about force save/load all pipeline components is very important. In the design doc, it says to do this in 1.4 for the new Transformer/Estimator framework under the .ml package. We are at 1.5.0 right now, nothing happened on that path. I wonder if there was some major conceptual changes or just workload/resource issue.


> How to improve the current ML pipeline API?
> -------------------------------------------
>
>                 Key: SPARK-5874
>                 URL: https://issues.apache.org/jira/browse/SPARK-5874
>             Project: Spark
>          Issue Type: Brainstorming
>          Components: ML
>            Reporter: Xiangrui Meng
>            Assignee: Xiangrui Meng
>            Priority: Critical
>
> I created this JIRA to collect feedbacks about the ML pipeline API we introduced in Spark 1.2. The target is to graduate this set of APIs in 1.4 with confidence, which requires valuable input from the community. I'll create sub-tasks for each major issue.
> Design doc (WIP): https://docs.google.com/a/databricks.com/document/d/1plFBPJY_PriPTuMiFYLSm7fQgD1FieP4wt3oMVKMGcc/edit#



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org