You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Rares Mirica (JIRA)" <ji...@apache.org> on 2016/02/09 11:36:18 UTC

[jira] [Commented] (SPARK-10413) Model should support prediction on single instance

    [ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138756#comment-15138756 ] 

Rares Mirica commented on SPARK-10413:
--------------------------------------

I don't know if I am reading this right but many times the processing pipelines contain a relatively large number of stages, supporting single instance on string types means that the pipeline will need to be split into the column-manipulation stages (run over a dataframe, eg: PolynomialExpansion creates a column that is then used as the feature for prediction) and the single-instance run (in this case the prediction on a model). 

Supporting single Row instance would open the way for local execution of an entire pipeline (presumably loaded from storage) which opens up applications in the low-latency space (online prediction with rest front-end for example)

> Model should support prediction on single instance
> --------------------------------------------------
>
>                 Key: SPARK-10413
>                 URL: https://issues.apache.org/jira/browse/SPARK-10413
>             Project: Spark
>          Issue Type: Umbrella
>          Components: ML
>            Reporter: Xiangrui Meng
>            Priority: Critical
>
> Currently models in the pipeline API only implement transform(DataFrame). It would be quite useful to support prediction on single instance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org