[jira] [Created] (SPARK-12955) Spark-HiveSQL: It fail when is quering a nested structure

["Gerardo Villarroel (JIRA)" <ji...@apache.org>]

Gerardo Villarroel created SPARK-12955:
------------------------------------------

             Summary: Spark-HiveSQL: It fail when is quering a nested structure
                 Key: SPARK-12955
                 URL: https://issues.apache.org/jira/browse/SPARK-12955
             Project: Spark
          Issue Type: Bug
          Components: Spark Submit
    Affects Versions: 1.3.0
         Environment: CDH-5.4.7-1.cdh5.4.7
            Reporter: Gerardo Villarroel


If you create a hive table using a structure with a nested structure and spark query it, it get fail.
you'll test with a structure similar to:
{ a : { a { aa1: "subValue", aa2: 1 } } , b : "value" }

a extended example is bellow:


{
  "namespace": "AA", 
  "type": "record", 
  "name": "CreditRecord", 
  "fields": [
    {
      "doc": "string", 
      "type": "string", 
      "name": "aaa"
    }, 
    {
      "doc": "string", 
      "type": "string", 
      "name": "bbb"
    }, 
    {
      "doc": "string", 
      "type": "string", 
      "name": "l90"
    }, 
    {
      "doc": "boolean, ", 
      "type": ["boolean", "null"
      ], 
      "name": "isSubjectDeceased"
    }, 
    {
      "doc": "string", 
      "type": "string", 
      "name": "gender"
    }, 
    {
      "doc": "string", 
      "type": "string", 
      "name": "dateOfBirth"
    }, 
    {
      "doc": "array of Trade, ", 
      "type": [
        {
          "items": {
            "fields": [
              {
                "doc": "int, ", 
                "type": [
                  "int", 
                  "null"
                ], 
                "name": "sequenceNumber"
              }, 
              {
                "doc": "string", 
                "type": "string", 
                "name": "tradeKey"
              }, 
              {
                "doc": "PHR,", 
                "type": [
                  {
                    "fields": [
                      {
                        "doc": "string", 
                        "type": "string", 
                        "name": "rate"
                      }, 
                      {
                        "doc": "string", 
                        "type": "string", 
                        "name": "date"
                      }
                    ], 
                    "type": "record", 
                    "name": "PHR"
                  }, 
                  "null"
                ], 
                "name": "phrgt48DR"
              }
            ], 
            "type": "record", 
            "name": "Trade"
          }, 
          "type": "array"
        }, "null"
      ], 
      "name": "trades"
    }
  ]
}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org