You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Micah Kornfield (Jira)" <ji...@apache.org> on 2021/02/21 01:12:00 UTC

[jira] [Commented] (PARQUET-1987) Document how a schema can have columns splitted over different files

    [ https://issues.apache.org/jira/browse/PARQUET-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287833#comment-17287833 ] 

Micah Kornfield commented on PARQUET-1987:
------------------------------------------

CC [~raduteodorescu]

> Document how a schema can have columns splitted over different files 
> ---------------------------------------------------------------------
>
>                 Key: PARQUET-1987
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1987
>             Project: Parquet
>          Issue Type: Improvement
>            Reporter: Carlos Diogo
>            Priority: Minor
>
> In the design overview is stated that the format supports that columns of a given schema are splitted over several files . 
> To date ,other than the reference in the parquet homepage there are no other references to these feature , not even if it is actually implemented. 
> As it currently stands , I believe that for a given row group you cannot have some columns in one file and other column group in another file belonging to the same schema .
> If these feature was actually implemented it would open the door to faster data updates which affect a single column in very wide tables, which is typical on big data use cases .
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)