You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Abhishek Tiwari (JIRA)" <ji...@apache.org> on 2018/01/03 06:45:00 UTC
[jira] [Updated] (GOBBLIN-248) Converter for Json to Parquet
[ https://issues.apache.org/jira/browse/GOBBLIN-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Abhishek Tiwari updated GOBBLIN-248:
------------------------------------
Fix Version/s: 0.12
> Converter for Json to Parquet
> -----------------------------
>
> Key: GOBBLIN-248
> URL: https://issues.apache.org/jira/browse/GOBBLIN-248
> Project: Apache Gobblin
> Issue Type: New Feature
> Components: gobblin-core
> Reporter: Tilak Patidar
> Assignee: Abhishek Tiwari
> Priority: Minor
> Fix For: 0.12
>
>
> This PR adds support for converting JSON records from JSON sources into Parquet format. The user has to define the source.schema which will help in generating Parquet schema and conversion of JSON into Parquet. In future, a ParquetHdfsWriter could be implemented to write Parquet files.
> The following data types are supported for now:
> * STRING
> * INT
> * LONG
> * FLOAT
> * DOUBLE
> * BOOLEAN
> * ARRAY
> * ENUM
> * RECORD
> * MAP
> Nesting is not supported for now.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)