[GitHub] [phoenix] kadirozde commented on pull request #1399: PHOENIX-6501 Use batching when joining data table rows with uncovered…

[GitBox <gi...@apache.org>]

kadirozde commented on pull request #1399:
URL: https://github.com/apache/phoenix/pull/1399#issuecomment-1059669953


   > Can we do this for local indexes as well? There is also a significant cost to seeking (even when done locally)
   > 
   > In fact the only difference might be how we get the a table reference.
   
   @lhofhansl, we can definitely do this for local indexes. There are some differences. The first is as you pointed out table vs region. For local indexes, both data and index are accessed via the local region while the global index is accessed remotely so we need to get the table for the global index and then get connections to access the table. The concern of which connection pool to use is not applicable to the local index.  The second difference is that there is one table region to retrieve data rows for the local index. However, for the global index, there can be many. So we discover the table region boundaries and access them in parallel for the global indexes using a thread pool, which is not necessary for the local index. The last difference is handling the row key offset for local indexes, which is not necessary for the global indexes. So, I thought instead of lumping local and global index batching together, we should handle them separately. I suggest having a separate Jira
  and PR for the local index.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@phoenix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org