You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yanbo Liang (JIRA)" <ji...@apache.org> on 2016/03/30 18:30:25 UTC

[jira] [Comment Edited] (SPARK-7424) spark.ml classification, regression abstractions should add metadata to output column

    [ https://issues.apache.org/jira/browse/SPARK-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218253#comment-15218253 ] 

Yanbo Liang edited comment on SPARK-7424 at 3/30/16 4:29 PM:
-------------------------------------------------------------

[~josephkb] We should copy metadata from the labelCol to the predictionCol. But we can not do it in PredictorParams.validateAndTransformSchema, because we did not use the return value of validateAndTransformSchema as the output DataFrame schema. The output DataFrame and its schema are generated at ClassificationModel.transform and PredictionModel.transform directly.


was (Author: yanboliang):
[~josephkb] We should copy metadata from the labelCol to the predictionCol. But we can not do it in PredictorParams.validateAndTransformSchema, because we did not use the return value of validateAndTransformSchema as the output DataFrame schema. The DataFrame and its schema are generated at ClassificationModel.transform and PredictionModel.transform directly.

> spark.ml classification, regression abstractions should add metadata to output column
> -------------------------------------------------------------------------------------
>
>                 Key: SPARK-7424
>                 URL: https://issues.apache.org/jira/browse/SPARK-7424
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML
>            Reporter: Joseph K. Bradley
>
> Update ClassificationModel, ProbabilisticClassificationModel prediction to include numClasses in output column metadata.
> Update RegressionModel to specify output column metadata as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org