You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:33:43 UTC

[jira] [Resolved] (SPARK-16075) Make VectorUDT/MatrixUDT singleton under spark.ml package

     [ https://issues.apache.org/jira/browse/SPARK-16075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-16075.
----------------------------------
    Resolution: Incomplete

> Make VectorUDT/MatrixUDT singleton under spark.ml package
> ---------------------------------------------------------
>
>                 Key: SPARK-16075
>                 URL: https://issues.apache.org/jira/browse/SPARK-16075
>             Project: Spark
>          Issue Type: Improvement
>          Components: MLlib
>    Affects Versions: 2.0.0
>            Reporter: Xiangrui Meng
>            Assignee: Xiangrui Meng
>            Priority: Major
>              Labels: bulk-closed
>
> Both VectorUDT and MatrixUDT are implemented as normal classes and their could be multiple instances of it, which makes the equality checking and pattern matching harder to implement. Even the APIs are private, switching to a singleton pattern could simplify the development.
> Required changes:
> * singleton VectorUDT/MatrixUDT (created by VectorUDT.getOrCreate)
> * update UDTRegistration
> * update code generation to support singleton UDTs
> * update existing code to use getOrCreate



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org