[jira] [Commented] (KYLIN-3070) Add a config property for flat table storage format

["Shaofeng SHI (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-3070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272688#comment-16272688 ] 

Shaofeng SHI commented on KYLIN-3070:
-------------------------------------

+1 Agree; 
Besides, using other format like Parquet, ORC may gain better compression and performance.

Please let me know if you want to contribute a patch; I can add you as the assignee for the JIRA.

> Add a config property for flat table storage format
> ---------------------------------------------------
>
>                 Key: KYLIN-3070
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3070
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v2.2.0
>         Environment: HDP 2.5.6, Kylin 2.2.0
>            Reporter: Vsevolod Ostapenko
>            Assignee: Dong Li
>            Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Flat table storage format is currently hard-coded as SEQUENCEFILE in the core-job/src/main/java/org/apache/kylin/job/JoinedFlatTable.java
> That prevents using Impala as a SQL engine while using beeline CLI (via custom JDBC URL), as Impala cannot write sequence files.
> Adding a parameter to kylin.properties to override the default setting would address the issue.
> Removing a hard-coded value for storage format might be good idea in and on itself.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)