You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2021/05/10 21:17:32 UTC

[GitHub] [accumulo] keith-turner opened a new issue #2094: Use lower cardinality type for compaction priority

keith-turner opened a new issue #2094:
URL: https://github.com/apache/accumulo/issues/2094


   Compaction Jobs currently use a long for compaction priority.  For external compactions this could potentially cause problems in the compaction coordinator if millions or billions of distinct priorities were actually used.  Instead of telling people not do that, it would probably be better to change the type for priority from a 64 bit integer to an 8-bit or 16-bit integer.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [accumulo] dlmarion closed issue #2094: Use lower cardinality type for compaction priority

Posted by GitBox <gi...@apache.org>.
dlmarion closed issue #2094:
URL: https://github.com/apache/accumulo/issues/2094


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [accumulo] dlmarion commented on issue #2094: Use lower cardinality type for compaction priority

Posted by GitBox <gi...@apache.org>.
dlmarion commented on issue #2094:
URL: https://github.com/apache/accumulo/issues/2094#issuecomment-838399768


   @keith-turner removed priority from TExternalCompactionJob in 837ae7edc885cce0b35d3e2ba8a0c3e246914545.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [accumulo] dlmarion edited a comment on issue #2094: Use lower cardinality type for compaction priority

Posted by GitBox <gi...@apache.org>.
dlmarion edited a comment on issue #2094:
URL: https://github.com/apache/accumulo/issues/2094#issuecomment-838399768


   @keith-turner removed priority from TExternalCompactionJob in 837ae7edc885cce0b35d3e2ba8a0c3e246914545. Priority is still being sent from the TServer to the Coordinator in ExternalCompactionExecutor.summarize().


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [accumulo] dlmarion closed issue #2094: Use lower cardinality type for compaction priority

Posted by GitBox <gi...@apache.org>.
dlmarion closed issue #2094:
URL: https://github.com/apache/accumulo/issues/2094


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [accumulo] dlmarion edited a comment on issue #2094: Use lower cardinality type for compaction priority

Posted by GitBox <gi...@apache.org>.
dlmarion edited a comment on issue #2094:
URL: https://github.com/apache/accumulo/issues/2094#issuecomment-838399768


   @keith-turner removed priority from TExternalCompactionJob in 837ae7edc885cce0b35d3e2ba8a0c3e246914545, so the issue in the compaction coordinator is resolved I think. I believe it still makes sense to reduce the cardinality of priority in general.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [accumulo] keith-turner commented on issue #2094: Use lower cardinality type for compaction priority

Posted by GitBox <gi...@apache.org>.
keith-turner commented on issue #2094:
URL: https://github.com/apache/accumulo/issues/2094#issuecomment-838875258


   I moved it out of the the external compaction project to a 2.1.0 blocker because I think it can be done after external compactions are merged, but should be done before a 2.1.0 release as it would change SPIs that are new in 2.1.0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [accumulo] dlmarion commented on issue #2094: Use lower cardinality type for compaction priority

Posted by GitBox <gi...@apache.org>.
dlmarion commented on issue #2094:
URL: https://github.com/apache/accumulo/issues/2094#issuecomment-838412164


   @keith-turner - I think we can remove this from the External Compactions project.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org