You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Andrew Lamb (Jira)" <ji...@apache.org> on 2020/10/06 12:26:00 UTC
[jira] [Updated] (ARROW-8464) [Rust] [DataFusion] Add better and
faster support for dictionary types
[ https://issues.apache.org/jira/browse/ARROW-8464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Lamb updated ARROW-8464:
-------------------------------
Summary: [Rust] [DataFusion] Add better and faster support for dictionary types (was: [Rust] [DataFusion] Add support for dictionary types)
> [Rust] [DataFusion] Add better and faster support for dictionary types
> ----------------------------------------------------------------------
>
> Key: ARROW-8464
> URL: https://issues.apache.org/jira/browse/ARROW-8464
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Rust - DataFusion
> Reporter: Andy Grove
> Priority: Major
>
> Usecases: Efficiently process large columns of low cardinality Strings
>
> * BatchIterator should accept both DictionaryBatch and RecordBatch
> * Type Coercion optimizer rule should inject expression for converting dictionary value types to index types (for equality expressions, and IN(values, ...)
> * Physical expression would lookup index for dictionary values referenced in the query so that at runtime, only indices are being compared per batch
--
This message was sent by Atlassian Jira
(v8.3.4#803005)