You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2015/04/28 03:22:06 UTC

[jira] [Assigned] (SPARK-5956) Transformer/Estimator should be copyable.

     [ https://issues.apache.org/jira/browse/SPARK-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiangrui Meng reassigned SPARK-5956:
------------------------------------

    Assignee: Xiangrui Meng

> Transformer/Estimator should be copyable.
> -----------------------------------------
>
>                 Key: SPARK-5956
>                 URL: https://issues.apache.org/jira/browse/SPARK-5956
>             Project: Spark
>          Issue Type: Sub-task
>          Components: ML
>    Affects Versions: 1.3.0
>            Reporter: Xiangrui Meng
>            Assignee: Xiangrui Meng
>
> In a pipeline, we don't save additional params specified in `fit()` to transformers, because we should not modify them. The current solution is to store training parameters in the pipeline model and apply those parameters at `transform()`. A better solution would be making transformers copyable. Calling `.copy` on a transformer produces a new transformer with a different UID but same parameters. Then we can use the copied transformers in the pipeline model, with additional params stored.
> `copy` may not be a good name because it is not an exact copy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org