[jira] [Resolved] (SPARK-4791) Create SchemaRDD from case classes with multiple constructors

["Michael Armbrust (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust resolved SPARK-4791.
-------------------------------------
    Resolution: Fixed
      Assignee: Joseph K. Bradley

> Create SchemaRDD from case classes with multiple constructors
> -------------------------------------------------------------
>
>                 Key: SPARK-4791
>                 URL: https://issues.apache.org/jira/browse/SPARK-4791
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.3.0
>            Reporter: Joseph K. Bradley
>            Assignee: Joseph K. Bradley
>            Priority: Minor
>
> Issue: One can usually take an RDD of case classes and create a SchemaRDD, where Spark SQL infers the schema from the case class metadata.  However, if the case class has multiple constructors, then ScalaReflection.schemaFor gets confused.
> Motivation: In spark.ml, I would like to create a class with the following signature:
> ```
> case class LabeledPoint(label: Double, features: Vector, weight: Double) {
>   def this(label: Double, features: Vector) = this(label, features, 1.0)
> }
> ```
> Proposed fix: Change ScalaReflection.schemaFor so it checks for whether there are multiple constructors.  If there are multiple ones, it should take the primary constructor.  This will not change the behavior of existing code since it currently only supports case classes with 1 constructor.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org