You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@drill.apache.org by "mehran (JIRA)" <ji...@apache.org> on 2018/08/13 11:13:00 UTC

[jira] [Commented] (DRILL-5179) Dropping NULL Columns from putting in parquet files

    [ https://issues.apache.org/jira/browse/DRILL-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16578123#comment-16578123 ] 

mehran commented on DRILL-5179:
-------------------------------

It is convenient to have a  skip_null_columns in parquet.writer.

 

> Dropping NULL Columns from putting in parquet files
> ---------------------------------------------------
>
>                 Key: DRILL-5179
>                 URL: https://issues.apache.org/jira/browse/DRILL-5179
>             Project: Apache Drill
>          Issue Type: Improvement
>    Affects Versions: 1.9.0
>            Reporter: mehran
>            Priority: Major
>
> Due to schemaless nature of drill and parquet files. It is suitable that all NULL columns be dropped in "CREATE TABLE" command from json. This will enhance speed of header interpretation. I think this is a big enhancement.
>  This can be an option in configuration parameters.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)