You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Brian Hulette (JIRA)" <ji...@apache.org> on 2018/02/12 20:09:00 UTC

[jira] [Created] (ARROW-2144) [JS] Don't repeat dictionary lookups in DataFrame ops

Brian Hulette created ARROW-2144:
------------------------------------

             Summary: [JS] Don't repeat dictionary lookups in DataFrame ops
                 Key: ARROW-2144
                 URL: https://issues.apache.org/jira/browse/ARROW-2144
             Project: Apache Arrow
          Issue Type: Improvement
          Components: JavaScript
            Reporter: Brian Hulette


Currently we repeat dictionary lookups every time we bind a new record batch when doing an equality check in a DataFrame op (https://github.com/apache/arrow/blob/master/js/src/predicate.ts#L143).

In most cases the dictionary won't be changing between record batches, so we should remember these reverse dictionary lookups, either permanently, or at least for the duration of the current operation.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)