[jira] [Created] (GEODE-5534) With oql indexes and compression enabled, memory usage is greater after compression than before

["Barry Oglesby (JIRA)" <ji...@apache.org>]

Barry Oglesby created GEODE-5534:
------------------------------------

             Summary: With oql indexes and compression enabled, memory usage is greater after compression than before
                 Key: GEODE-5534
                 URL: https://issues.apache.org/jira/browse/GEODE-5534
             Project: Geode
          Issue Type: Bug
          Components: querying
            Reporter: Barry Oglesby


A test that shows the behavior is:

- xml configuration like:
{noformat}
<region name="order">
 <region-attributes scope="distributed-ack" data-policy="persistent-replicate" disk-store-name="orderDiskStore" disk-synchronous="false" cloning-enabled="true">
 <compressor>
 <class-name>org.apache.geode.compression.SnappyCompressor</class-name>
 </compressor>
 </region-attributes>
 <index name="order_clOrdID" from-clause="/order index_from" expression="index_from.clOrdID" type="range"/>
 <index name="order_externalOrderID" from-clause="/order index_from" expression="index_from.externalOrderID" type="range"/>
 <index name="order_externalOrderIDSource" from-clause="/order index_from" expression="index_from.externalOrderIDSource" type="range"/>
 <index name="order_orderID" from-clause="/order index_from" expression="index_from.orderID" type="range"/>
 <index name="order_parentOrderID" from-clause="/order index_from" expression="index_from.parentOrderID" type="range"/>
</region>
{noformat}

- an Order object defining string fields for clOrdID, externalOrderID, orderID and parentOrderID and an enum field for externalOrderIDSource

Here are some histograms showing the behavior:

With indexes and no compression:
{noformat}
 num #instances #bytes class name
----------------------------------------------
 1: 502136 562132008 [B
 2: 2000000 48000000 org.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node
 3: 499990 35999280 org.apache.geode.internal.cache.entries.VersionedThinDiskRegionEntryHeapStringKey2
 4: 500004 24000192 org.apache.geode.internal.cache.DiskId$PersistenceWithIntOffset
 5: 1503 15457776 [Lorg.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node;
 6: 501508 12036192 java.util.concurrent.ConcurrentSkipListMap$Node
 7: 501500 12036000 org.apache.geode.pdx.internal.PdxString
 8: 500000 8000000 org.apache.geode.internal.cache.PreferBytesCachedDeserializable
 9: 250680 6016320 java.util.concurrent.ConcurrentSkipListMap$Index
 10: 80 4196104 [Lorg.apache.geode.internal.util.concurrent.CustomEntryConcurrentHashMap$HashEntry;
Total 5474612 739440976
{noformat}
With indexes and compression
{noformat}
 num #instances #bytes class name
----------------------------------------------
 1: 1003644 643754184 [B
 2: 2000000 48000000 org.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node
 3: 499990 35999280 org.apache.geode.internal.cache.entries.VersionedThinDiskRegionEntryHeapStringKey2
 4: 500004 24000192 org.apache.geode.internal.cache.DiskId$PersistenceWithIntOffset
 5: 1503 15457776 [Lorg.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node;
 6: 501508 12036192 java.util.concurrent.ConcurrentSkipListMap$Node
 7: 501500 12036000 org.apache.geode.pdx.internal.PdxString
 8: 250889 6021336 java.util.concurrent.ConcurrentSkipListMap$Index
 9: 80 4196096 [Lorg.apache.geode.internal.util.concurrent.CustomEntryConcurrentHashMap$HashEntry;
 10: 34380 3261936 [C
Total 5476808 813096488
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)