You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@geode.apache.org by "Barry Oglesby (JIRA)" <ji...@apache.org> on 2019/04/30 21:00:00 UTC
[jira] [Resolved] (GEODE-6186) Reduce the number of
EntryNotFoundExceptions during AsyncEventQueue batch processing with
conflation enabled
[ https://issues.apache.org/jira/browse/GEODE-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Barry Oglesby resolved GEODE-6186.
----------------------------------
Resolution: Fixed
Fix Version/s: 1.9.0
> Reduce the number of EntryNotFoundExceptions during AsyncEventQueue batch processing with conflation enabled
> ------------------------------------------------------------------------------------------------------------
>
> Key: GEODE-6186
> URL: https://issues.apache.org/jira/browse/GEODE-6186
> Project: Geode
> Issue Type: Bug
> Components: wan
> Reporter: Barry Oglesby
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.9.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Reduce the number of EntryNotFoundExceptions during AsyncEventQueue batch processing with conflation enabled
> This test:
> 3000 iterations of putAlls with the same 1500 keys into a partitioned region attached to async-event-queue:
> <async-event-queue id="test" batch-size="100000" batch-time-interval="250" dispatcher-threads="1" parallel="true" enable-batch-conflation="true">
> Produces these numbers in the current code (4 different runs):
> {noformat}
> numBatches=645; numENFEs=8622196; totalPeekTime=178517; averagePeekTime=276; totalProcessBatchTime=38936; averageProcessBatchTime=60
> numBatches=660; numENFEs=8467986; totalPeekTime=182985; averagePeekTime=277; totalProcessBatchTime=34335; averageProcessBatchTime=52
> numBatches=646; numENFEs=8563364; totalPeekTime=179624; averagePeekTime=278; totalProcessBatchTime=37342; averageProcessBatchTime=57
> numBatches=632; numENFEs=8716942; totalPeekTime=175570; averagePeekTime=277; totalProcessBatchTime=39732; averageProcessBatchTime=62
> {noformat}
> After some changes mainly in BucketRegionQueue:
> {noformat}
> numBatches=782; numENFEs=3621039; totalPeekTime=195760; averagePeekTime=250; totalProcessBatchTime=18724; averageProcessBatchTime=23
> numBatches=791; numENFEs=3604933; totalPeekTime=197980; averagePeekTime=250; totalProcessBatchTime=18587; averageProcessBatchTime=23
> numBatches=790; numENFEs=3600038; totalPeekTime=197774; averagePeekTime=250; totalProcessBatchTime=18611; averageProcessBatchTime=23
> numBatches=795; numENFEs=3584490; totalPeekTime=199060; averagePeekTime=250; totalProcessBatchTime=18063; averageProcessBatchTime=22
> {noformat}
> numBatches is the number of batches peeked
> numENFEs is the number of EntryNotFoundExceptions thrown
> totalPeekTime is the total time to peek all batches
> averagePeekTime is the average time to peek a batch
> totalProcessBatchTime is the total time to process all batches
> averageProcessBatchTime is the average time to process a batch (includes listener callback and remove from queue)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)