You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@geode.apache.org by "nabarun (JIRA)" <ji...@apache.org> on 2018/10/03 21:38:24 UTC
[jira] [Closed] (GEODE-5534) With oql indexes and compression
enabled, memory usage is greater after compression than before
[ https://issues.apache.org/jira/browse/GEODE-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
nabarun closed GEODE-5534.
--------------------------
> With oql indexes and compression enabled, memory usage is greater after compression than before
> -----------------------------------------------------------------------------------------------
>
> Key: GEODE-5534
> URL: https://issues.apache.org/jira/browse/GEODE-5534
> Project: Geode
> Issue Type: Bug
> Components: querying
> Reporter: Barry Oglesby
> Assignee: Barry Oglesby
> Priority: Major
> Labels: pull-request-available, swat
> Fix For: 1.7.0
>
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> A test that shows the behavior is:
> - xml configuration like:
> {noformat}
> <region name="order">
> <region-attributes scope="distributed-ack" data-policy="persistent-replicate" disk-store-name="orderDiskStore" disk-synchronous="false" cloning-enabled="true">
> <compressor>
> <class-name>org.apache.geode.compression.SnappyCompressor</class-name>
> </compressor>
> </region-attributes>
> <index name="order_clOrdID" from-clause="/order index_from" expression="index_from.clOrdID" type="range"/>
> <index name="order_externalOrderID" from-clause="/order index_from" expression="index_from.externalOrderID" type="range"/>
> <index name="order_externalOrderIDSource" from-clause="/order index_from" expression="index_from.externalOrderIDSource" type="range"/>
> <index name="order_orderID" from-clause="/order index_from" expression="index_from.orderID" type="range"/>
> <index name="order_parentOrderID" from-clause="/order index_from" expression="index_from.parentOrderID" type="range"/>
> </region>
> {noformat}
> - an Order object defining string fields for clOrdID, externalOrderID, orderID and parentOrderID and an enum field for externalOrderIDSource
> Here are some histograms showing the behavior:
> With indexes and no compression:
> {noformat}
> num #instances #bytes class name
> ----------------------------------------------
> 1: 502136 562132008 [B
> 2: 2000000 48000000 org.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node
> 3: 499990 35999280 org.apache.geode.internal.cache.entries.VersionedThinDiskRegionEntryHeapStringKey2
> 4: 500004 24000192 org.apache.geode.internal.cache.DiskId$PersistenceWithIntOffset
> 5: 1503 15457776 [Lorg.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node;
> 6: 501508 12036192 java.util.concurrent.ConcurrentSkipListMap$Node
> 7: 501500 12036000 org.apache.geode.pdx.internal.PdxString
> 8: 500000 8000000 org.apache.geode.internal.cache.PreferBytesCachedDeserializable
> 9: 250680 6016320 java.util.concurrent.ConcurrentSkipListMap$Index
> 10: 80 4196104 [Lorg.apache.geode.internal.util.concurrent.CustomEntryConcurrentHashMap$HashEntry;
> Total 5474612 739440976
> {noformat}
> With indexes and compression
> {noformat}
> num #instances #bytes class name
> ----------------------------------------------
> 1: 1003644 643754184 [B
> 2: 2000000 48000000 org.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node
> 3: 499990 35999280 org.apache.geode.internal.cache.entries.VersionedThinDiskRegionEntryHeapStringKey2
> 4: 500004 24000192 org.apache.geode.internal.cache.DiskId$PersistenceWithIntOffset
> 5: 1503 15457776 [Lorg.apache.geode.internal.concurrent.CompactConcurrentHashSet2$Node;
> 6: 501508 12036192 java.util.concurrent.ConcurrentSkipListMap$Node
> 7: 501500 12036000 org.apache.geode.pdx.internal.PdxString
> 8: 250889 6021336 java.util.concurrent.ConcurrentSkipListMap$Index
> 9: 80 4196096 [Lorg.apache.geode.internal.util.concurrent.CustomEntryConcurrentHashMap$HashEntry;
> 10: 34380 3261936 [C
> Total 5476808 813096488
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)