[jira] [Commented] (PHOENIX-2565) Store data for immutable tables in single KeyValue

["Ankit Singhal (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PHOENIX-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782480#comment-15782480 ] 

Ankit Singhal commented on PHOENIX-2565:
----------------------------------------

[~tdsilva]/[~jamestaylor], are we considering any other encoding for storing data in single keyValue apart from using VARBINARY array serialisation format?
Because in our case, when there are 100s of columns and each column is not null, then VARBINARY array serialisation is taking 2x space(as offset being stored along with data) when compared to RowKey format used for serialising all the columns in a single byte array. 

should we look into optimising the encoding here,  storing columns in byte array separated by delimiter like VAR array encoding but without offset, OR avro serialization or any other option? 

+[~ndimiduk]/[~enis]/[~sergey.soldatov]


> Store data for immutable tables in single KeyValue
> --------------------------------------------------
>
>                 Key: PHOENIX-2565
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-2565
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: James Taylor
>            Assignee: Thomas D'Silva
>         Attachments: PHOENIX-2565-v2.patch, PHOENIX-2565-wip.patch, PHOENIX-2565.patch
>
>
> Since an immutable table (i.e. declared with IMMUTABLE_ROWS=true) will never update a column value, it'd be more efficient to store all column values for a row in a single KeyValue. We could use the existing format we have for variable length arrays.
> For backward compatibility, we'd need to support the current mechanism. Also, you'd no longer be allowed to transition an existing table to/from being immutable. I think the best approach would be to introduce a new IMMUTABLE keyword and use it like this:
> {code}
> CREATE IMMUTABLE TABLE ...
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)