You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by "David Mollitor (Jira)" <ji...@apache.org> on 2021/07/15 14:49:00 UTC
[jira] [Created] (ORC-848) Recycle Internal Buffer in
StringHashTableDictionary
David Mollitor created ORC-848:
----------------------------------
Summary: Recycle Internal Buffer in StringHashTableDictionary
Key: ORC-848
URL: https://issues.apache.org/jira/browse/ORC-848
Project: ORC
Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor
{code:java|title=StringHashTableDictionary.java}
private void initHashBuckets(int capacity) {
DynamicIntArray[] buckets = new DynamicIntArray[capacity];
for (int i = 0; i < capacity; i++) {
// We don't need large bucket: If we have more than a handful of collisions,
// then the table is too small or the function isn't good.
buckets[i] = createBucket();
}
hashBuckets = buckets;
}
{code}
This code was highlighted for me in a JMH run of the perf test. The {{Dictionary}} is regularly cleared out and is reset back to its default state. I'm sure most of the time is spent generating {{capacity}} buckets (buffers), but we can save one buffer initialization by only creating {{buckets}} if the capacity is different than requested (which is not the case with a {{clear()}}}).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)