You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Rok Mihevc (Jira)" <ji...@apache.org> on 2023/01/11 07:20:02 UTC

[jira] [Updated] (ARROW-2144) [JS] Don't repeat dictionary lookups in DataFrame ops

     [ https://issues.apache.org/jira/browse/ARROW-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rok Mihevc updated ARROW-2144:
------------------------------
    External issue URL: https://github.com/apache/arrow/issues/18111

> [JS] Don't repeat dictionary lookups in DataFrame ops
> -----------------------------------------------------
>
>                 Key: ARROW-2144
>                 URL: https://issues.apache.org/jira/browse/ARROW-2144
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: JavaScript
>            Reporter: Brian Hulette
>            Assignee: Brian Hulette
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: JS-0.3.0
>
>
> Currently we repeat dictionary lookups every time we bind a new record batch when doing an equality check in a DataFrame op (https://github.com/apache/arrow/blob/master/js/src/predicate.ts#L143).
> In most cases the dictionary won't be changing between record batches, so we should remember these reverse dictionary lookups, either permanently, or at least for the duration of the current operation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)