You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by "David Mollitor (Jira)" <ji...@apache.org> on 2021/07/02 19:24:00 UTC

[jira] [Created] (ORC-830) Do Not Copy String When Adding to StringHashTableDictionary

David Mollitor created ORC-830:
----------------------------------

             Summary: Do Not Copy String When Adding to StringHashTableDictionary
                 Key: ORC-830
                 URL: https://issues.apache.org/jira/browse/ORC-830
             Project: ORC
          Issue Type: Improvement
          Components: Java
            Reporter: David Mollitor
            Assignee: David Mollitor


{code:java|title=StringHashTableDictionary.java}
    Text tmpText = new Text();
    for (int i = 0; i < candidateArray.size(); i++) {
      getText(tmpText, candidateArray.get(i));
      if (tmpText.equals(newKey)) {
        return candidateArray.get(i);
      }
    }
{code}

When there is a collision adding a value into a {{StringHashTableDictionary}}, a temp {{Text}} object is created and then each value in the byte array is copied into the temp {{Text}}  until a match is found (or worst-case scenario, a match is not found and every value is loaded).

Instead of loading (copying) the values, just compare directly against the byte array without copying the data into a intermediate (temp) buffer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)