You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Jorge Leitão (Jira)" <ji...@apache.org> on 2020/10/06 09:09:00 UTC

[jira] [Commented] (ARROW-10128) [Rust] Dictionary-encoding is out of spec

    [ https://issues.apache.org/jira/browse/ARROW-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17208588#comment-17208588 ] 

Jorge Leitão commented on ARROW-10128:
--------------------------------------

fyo [~alamb], since you have been working with Dictionaries.

> [Rust] Dictionary-encoding is out of spec
> -----------------------------------------
>
>                 Key: ARROW-10128
>                 URL: https://issues.apache.org/jira/browse/ARROW-10128
>             Project: Apache Arrow
>          Issue Type: Task
>          Components: Rust
>            Reporter: Jorge Leitão
>            Priority: Major
>
> According to [the spec|https://arrow.apache.org/docs/format/Columnar.html#physical-memory-layout], every array can be dictionary-encoded, on which its values are encoded by a unique set of values.
> However, none of our arrays support this encoding and the physical memory layout of this encoding is not being fulfilled.
> We have a DictionaryArray, but, AFAIK, it does not respect the physical memory layout set out by the spec.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)