You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@phoenix.apache.org by "Lars Hofhansl (Jira)" <ji...@apache.org> on 2021/03/15 16:10:00 UTC

[jira] [Created] (PHOENIX-6412) Consider batching uncovered column merge for local indexes

Lars Hofhansl created PHOENIX-6412:
--------------------------------------

             Summary: Consider batching uncovered column merge for local indexes
                 Key: PHOENIX-6412
                 URL: https://issues.apache.org/jira/browse/PHOENIX-6412
             Project: Phoenix
          Issue Type: Improvement
            Reporter: Lars Hofhansl
             Fix For: 5.2.0


Currently uncovered columns are merge row-by-row performing a Get to the data region for each matching row in the index region.

Each Get needs to seek all the store scanners, and doing this per row is quite expensive.

Instead we could batch inside the RegionScannerFactory.getWrappedScanner() -> RegionScanner.nextRaw() method. Collect N index rows and then execute a skip scan.

 

I might be able to get to that, but there's someone who is interested in taking this up I would not mind :)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)