You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2020/05/08 17:43:50 UTC
[GitHub] [accumulo] milleruntime opened a new issue #1606: Ability to disable scan file limit in FileManager
milleruntime opened a new issue #1606:
URL: https://github.com/apache/accumulo/issues/1606
It seems the lock contention due to the file limit in FileManager is still an issue in 1.9. This problem has been around since https://issues.apache.org/jira/browse/ACCUMULO-416 which is a prerequisite for https://issues.apache.org/jira/browse/ACCUMULO-543. It would be worthwhile to revisit the first ticket and at the very least have a config option to disable the file limit lock.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] dlmarion commented on issue #1606: Ability to disable scan file limit in FileManager
Posted by GitBox <gi...@apache.org>.
dlmarion commented on issue #1606:
URL: https://github.com/apache/accumulo/issues/1606#issuecomment-747650183
@FineAndDandy - any updated information on the question in the comment above? Is this still an issue?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] milleruntime commented on issue #1606: Ability to disable scan file limit in FileManager
Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #1606:
URL: https://github.com/apache/accumulo/issues/1606#issuecomment-625949255
Saw an issue where short scans were locking at this file limit gate so the client was killed. The dead scans were stuck even after a client was killed and then new scans were waiting a long time at the semaphore for this file limit. This situation could worsen as a user not seeing scans available, will retry creating more scans that get held up at this gate. This is a situation where we want to prioritize scan availability over everything else, which is one of the trade offs @keith-turner mentions in https://issues.apache.org/jira/browse/ACCUMULO-416
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] milleruntime commented on issue #1606: Ability to disable scan file limit in FileManager
Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #1606:
URL: https://github.com/apache/accumulo/issues/1606#issuecomment-626649191
> Isn't the number of open files configurable? It seems like increasing that limit would mitigate this a bit.
Yes there is "tserver.scan.files.open.max". I suggested increasing this but now now sure why this wouldn't suffice. @FineAndDandy any idea why just increasing this limit wouldn't be enough to bypass this gate where necessary?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] ctubbsii commented on issue #1606: Ability to disable scan file limit in FileManager
Posted by GitBox <gi...@apache.org>.
ctubbsii commented on issue #1606:
URL: https://github.com/apache/accumulo/issues/1606#issuecomment-625999531
Isn't the number of open files configurable? It seems like increasing that limit would mitigate this a bit.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org