[jira] [Created] (SPARK-8345) Add an SQL node as a feature tranformer

["Xiangrui Meng (JIRA)" <ji...@apache.org>]

Xiangrui Meng created SPARK-8345:
------------------------------------

             Summary: Add an SQL node as a feature tranformer
                 Key: SPARK-8345
                 URL: https://issues.apache.org/jira/browse/SPARK-8345
             Project: Spark
          Issue Type: New Feature
          Components: ML
            Reporter: Xiangrui Meng


Some simple feature transformations can take leverage on SQL operators. Users do not need to create an ML transformer for each of them. We can have an SQL transformer that executes an SQL command which operates on the input dataframe.

{code}
val sql = new SQL()
  .setStatement("SELECT *, length(text) AS text_length FROM __THIS__")
{code}

where "__THIS__" will be replaced by a temp table that represents the DataFrame.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org