You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by "Bryan Beaudreault (Jira)" <ji...@apache.org> on 2022/03/21 13:52:00 UTC

[jira] [Created] (HBASE-26874) VerifyReplication recompare async

Bryan Beaudreault created HBASE-26874:
-----------------------------------------

             Summary: VerifyReplication recompare async
                 Key: HBASE-26874
                 URL: https://issues.apache.org/jira/browse/HBASE-26874
             Project: HBase
          Issue Type: Improvement
            Reporter: Bryan Beaudreault


VerifyReplication includes an option "sleepMsBeforeReCompare". This is useful for helping work around replication lag. However, adding a sleep in a hadoop job can drastically slow that job down if there is anything more than a small number of invalid results.

We can mitigate this by doing the recompare in a separate thread. We can limit the thread pool and fallback to doing the recompare in the main thread if the thread pool is full. This way we offload some of the slowness but still retain the same validation guarantees.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)