You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "cshannon (via GitHub)" <gi...@apache.org> on 2023/12/01 22:02:44 UTC

[I] Backport into main the max number of files limit that is checked by elasticity during merge operations [accumulo]

cshannon opened a new issue, #4009:
URL: https://github.com/apache/accumulo/issues/4009

   As part of #3934, merge in elasticity was updated with a new property called [TABLE_MERGE_FILE_MAX](https://github.com/apache/accumulo/blob/acc2a5c268b7cb5b194898450295c46b48d916d9/core/src/main/java/org/apache/accumulo/core/conf/Property.java#L956) which is used to limit the maximum number of files that a merge operation will process. This was done to prevent a massive number of files in a single tablet because we need a single tablets metadata to fit into memory at once or else problems will occur with scans and other operations. We should look at backporting this property and applying the same checks to no-chop merge in 3.1.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org