You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Asif Hussain Shahid (JIRA)" <ji...@apache.org> on 2017/10/03 19:21:00 UTC

[jira] [Created] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

Asif Hussain Shahid created SPARK-22192:
-------------------------------------------

             Summary: An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API
                 Key: SPARK-22192
                 URL: https://issues.apache.org/jira/browse/SPARK-22192
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.2.0
         Environment: Independent of OS / platform
            Reporter: Asif Hussain Shahid
            Priority: Minor


If an RDD contains nested POJO objects, then SQLContext.createDataFrame(RDD, Class) api only handles the top level POJO object. It throws ScalaMatchError exception when handling the nested POJO object as the code does not recursively handle the nested POJOs.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org