You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Rares Mirica (JIRA)" <ji...@apache.org> on 2016/02/09 11:36:18 UTC
[jira] [Commented] (SPARK-10413) Model should support prediction on
single instance
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138756#comment-15138756 ]
Rares Mirica commented on SPARK-10413:
--------------------------------------
I don't know if I am reading this right but many times the processing pipelines contain a relatively large number of stages, supporting single instance on string types means that the pipeline will need to be split into the column-manipulation stages (run over a dataframe, eg: PolynomialExpansion creates a column that is then used as the feature for prediction) and the single-instance run (in this case the prediction on a model).
Supporting single Row instance would open the way for local execution of an entire pipeline (presumably loaded from storage) which opens up applications in the low-latency space (online prediction with rest front-end for example)
> Model should support prediction on single instance
> --------------------------------------------------
>
> Key: SPARK-10413
> URL: https://issues.apache.org/jira/browse/SPARK-10413
> Project: Spark
> Issue Type: Umbrella
> Components: ML
> Reporter: Xiangrui Meng
> Priority: Critical
>
> Currently models in the pipeline API only implement transform(DataFrame). It would be quite useful to support prediction on single instance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org