You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Kunal Kapoor (JIRA)" <ji...@apache.org> on 2018/05/07 13:45:00 UTC

[jira] [Created] (CARBONDATA-2452) DataLoading failure when Struct with timesamp/date

Kunal Kapoor created CARBONDATA-2452:
----------------------------------------

             Summary: DataLoading failure when Struct with timesamp/date
                 Key: CARBONDATA-2452
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2452
             Project: CarbonData
          Issue Type: Bug
            Reporter: Kunal Kapoor
            Assignee: Kunal Kapoor


val myaSchema=
"""
| {
| "namespace": "com.apache.schema",
| "type": "record",
| "name": "StudentActivity",
| "fields": [
| {
| "name": "id",
| "type": "int"
| },
| {
| "name": "course_details",
| "type": {
| "name": "course_details",
| "type": "record",
| "fields": [
| {
| "name": "course_struct_course_time",
| "type": "string"
| }
| ]
| }
| }
| ]
|}
""".stripMargin

var json = """{
| "id": 101,
| "course_details": {
| "course_struct_course_time":"2014-01-05"
| }
|}""".stripMargin

val nn = new org.apache.avro.Schema.Parser().parse(myaSchema)
val converter = new JsonAvroConverter
var record = converter
.convertToGenericDataRecord(json.getBytes(CharEncoding.UTF_8), nn)


val fields = new Array[Field](2)
fields(0)=new Field("id", DataTypes.INT)
val fld_s = new java.util.ArrayList[StructField]
fld_s.add(new StructField("course_struct_course_time", DataTypes.DATE))
fields(1)=new Field("course_details", "struct",fld_s)

try {
val writer = CarbonWriter.builder.withSchema(new Schema(fields)).sortBy(Array("id"))
.outputPath("D:/Hadoop/carbon_1_3/sdk/carbon_bln_2").isTransactionalTable(false).buildWriterForAvroInput
writer.write(record)
writer.close()
}
catch {
case e: Exception => {
e.printStackTrace()
}
}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)