You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2019/11/22 09:58:59 UTC
[GitHub] [accumulo] ctubbsii opened a new pull request #1441: Improve
Upgrader9to10 code
ctubbsii opened a new pull request #1441: Improve Upgrader9to10 code
URL: https://github.com/apache/accumulo/pull/1441
This changes the batching strategy for the Upgrader9to10 class.
The previous strategy was to fill a data structure until JVM memory was
sufficiently used up (50% of heap size), then process the upgrade for
those entries, and repeat until no more entries are left to upgrade.
This new strategy batches candidates for upgrade in batches of size 4
million characters (approx. 8MB batches), regardless of memory.
This stabilizes the testing, as it is much simpler to reproduce and test
fixed-size batches, than it is to manipulate the JVM heap size during
testing. As a result, many improvements to the GCUpgrade9to10TestIT were
made here. This also fixes that IT, which began failing with the use of
the G1GC instead of CMS (#1427), because G1GC didn't work well with a
master configured with a 16MB JVM heap and crashed frequently OOMEs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services