You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Masayuki Takahashi (JIRA)" <ji...@apache.org> on 2018/04/29 09:18:00 UTC

[jira] [Created] (PARQUET-1285) [Java] SchemaConverter should not convert from TimeUnit.SECOND AND TimeUnit.NANOSECOND of Arrow

Masayuki Takahashi created PARQUET-1285:
-------------------------------------------

             Summary: [Java] SchemaConverter should not convert from TimeUnit.SECOND AND TimeUnit.NANOSECOND of Arrow
                 Key: PARQUET-1285
                 URL: https://issues.apache.org/jira/browse/PARQUET-1285
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
            Reporter: Masayuki Takahashi


Arrow's 'Time' definition is below:
{code:java}
{ "name" : "time", "unit" : "SECOND|MILLISECOND|MICROSECOND|NANOSECOND", "bitWidth": /* integer: 32 or 64 */ }{code}
[http://arrow.apache.org/docs/metadata.html]

 

But Parquet only supports 'TIME_MILLIS' and 'TIME_MICROS'.
 [https://github.com/Apache/parquet-format/blob/master/LogicalTypes.md]

Therefore SchemaConverter should not convert from TimeUnit.SECOND AND TimeUnit.NANOSECOND of Arrow to Parquet.
  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)