You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "archon gum (JIRA)" <ji...@apache.org> on 2019/07/15 01:27:00 UTC
[jira] [Updated] (NIFI-6435) ConvertAvroToORC Should support Date
and Timestamp type
[ https://issues.apache.org/jira/browse/NIFI-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
archon gum updated NIFI-6435:
-----------------------------
Description:
h1. From AVRO
data
{code:java}
{
"date_type": 17897, // 2019-01-01
"timestamp_type": 1546300800000 // 2019-01-01 00:00:00 +0000
}
{code}
schema
{code:java}
{
"name": "test_types",
"type": "record",
"fields": [
{
"name": "date_type",
"type": "int",
"logicalType": "date"
},
{
"name": "timestamp_type",
"type": "long",
"logicalType": "timestamp-millis" // or others
}
]
}
{code}
or schema
{code:java}
{
"name": "test_types",
"type": "record",
"fields": [
{
"name": "date_type",
"type": {
"type": "int",
"logicalType": "date"
}
},
{
"name": "timestamp_type",
"type": {
"type": "long",
"logicalType": "timestamp-millis" // or others
}
}
]
}
{code}
h1. To ORC
schema should be
{code:java}
struct<date_type:date, timestamp_type:timestamp>
{code}
was:
h1. From AVRO
data
{code:java}
{
"date_type": 17897, // 2019-01-01
"timestamp_type": 1546300800000 // 2019-01-01 00:00:00 +0000
}
{code}
schema
{code:java}
{
"name": "test_types",
"type": "record",
"fields": [
{
"name": "date_type",
"type": "int",
"logicalType": "date"
},
{
"name": "timestamp_type",
"type": "long",
"logicalType": "timestamp-millis" // or others
}
]
}
{code}
h1. To ORC
schema should be
{code:java}
struct<date_type:date, timestamp_type:timestamp>
{code}
> ConvertAvroToORC Should support Date and Timestamp type
> -------------------------------------------------------
>
> Key: NIFI-6435
> URL: https://issues.apache.org/jira/browse/NIFI-6435
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Reporter: archon gum
> Priority: Major
>
> h1. From AVRO
> data
>
> {code:java}
> {
> "date_type": 17897, // 2019-01-01
> "timestamp_type": 1546300800000 // 2019-01-01 00:00:00 +0000
> }
> {code}
>
> schema
>
> {code:java}
> {
> "name": "test_types",
> "type": "record",
> "fields": [
> {
> "name": "date_type",
> "type": "int",
> "logicalType": "date"
> },
> {
> "name": "timestamp_type",
> "type": "long",
> "logicalType": "timestamp-millis" // or others
> }
> ]
> }
> {code}
> or schema
>
> {code:java}
> {
> "name": "test_types",
> "type": "record",
> "fields": [
> {
> "name": "date_type",
> "type": {
> "type": "int",
> "logicalType": "date"
> }
> },
> {
> "name": "timestamp_type",
> "type": {
> "type": "long",
> "logicalType": "timestamp-millis" // or others
> }
> }
> ]
> }
> {code}
>
> h1. To ORC
> schema should be
> {code:java}
> struct<date_type:date, timestamp_type:timestamp>
> {code}
>
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)