[jira] [Commented] (SPARK-4589) ML add-ons to SchemaRDD

["Michael Armbrust (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254002#comment-14254002 ] 

Michael Armbrust commented on SPARK-4589:
-----------------------------------------

Can you elaborate what you are thinking about?  Is this something like:

{code}
def transformColumn[A,B](columnName: String, f: A => B)
{code}

Is there anything else?

> ML add-ons to SchemaRDD
> -----------------------
>
>                 Key: SPARK-4589
>                 URL: https://issues.apache.org/jira/browse/SPARK-4589
>             Project: Spark
>          Issue Type: New Feature
>          Components: ML, MLlib, SQL
>            Reporter: Xiangrui Meng
>
> One feedback we received from the Pipeline API (SPARK-3530) is about the boilerplate code in the implementation. We can add more Scala DSL to simplify the code for the operations we need in ML. Those operations could live under spark.ml via implicit, or be added to SchemaRDD directly if they are also useful for general purpose.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org