You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2016/06/20 18:27:58 UTC

[jira] [Created] (SPARK-16074) Expose VectorUDT/MatrixUDT in a public API

Xiangrui Meng created SPARK-16074:
-------------------------------------

             Summary: Expose VectorUDT/MatrixUDT in a public API
                 Key: SPARK-16074
                 URL: https://issues.apache.org/jira/browse/SPARK-16074
             Project: Spark
          Issue Type: New Feature
          Components: MLilb
    Affects Versions: 2.0.0
            Reporter: Xiangrui Meng
            Priority: Critical


Both VectorUDT and MatrixUDT are private APIs, because UserDefinedType itself is private in Spark. However, in order to let developers implement their own transformers and estimators, we should expose both types in a public API to simply the implementation of transformSchema, transform, etc. Otherwise, they need to get the data types using reflection.

Note that this doesn't mean to expose VectorUDT/MatrixUDT classes. We can just have a method or a static value that returns VectorUDT/MatrixUDT instance with DataType as the return type.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org