You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2017/08/20 08:51:01 UTC

[jira] [Closed] (SPARK-17414) Set type is not supported for creating data frames

     [ https://issues.apache.org/jira/browse/SPARK-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Takeshi Yamamuro closed SPARK-17414.
------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.3.0

> Set type is not supported for creating data frames
> --------------------------------------------------
>
>                 Key: SPARK-17414
>                 URL: https://issues.apache.org/jira/browse/SPARK-17414
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Emre Colak
>            Priority: Minor
>             Fix For: 2.3.0
>
>
> For a case class that has a field of type Set, createDataFrame() method throws an exception saying "Schema for type Set is not supported". Exception is raised by the org.apache.spark.sql.catalyst.ScalaReflection class where Array, Seq and Map types are supported but Set is not. It would be nice to support Set here by default instead of having to write a custom Encoder.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org