[GitHub] [hudi] huberylee commented on pull request #5933: [HUDI-4293] Implement Create/Drop/Show/Refresh Index Command for Secondary Index

[GitBox <gi...@apache.org>]

huberylee commented on PR #5933:
URL: https://github.com/apache/hudi/pull/5933#issuecomment-1246457716

   > @huberylee - Sorry I may not have all the context here. How does the Spark optimizer know to use the lucene based index for expressions that may benefit? I dont see any tests from the spark read side that uses the index.
   > 
   > Can you point me to a plan on the index persistence and query processing usage plan for lucene based index? If we dont have one - we should write an RFC for it. I am confused to see code that persists index in hoodie.properties file.
   
   @prasannarajaperumal  This PR is mainly for handling  the persistency of secondary index metadata,  the SQL syntax of Create/Drop/Show/Refresh Secondary index have been introduced by [PR-5761](https://github.com/apache/hudi/pull/5761). We will introduce a new action type called build to generate the actual index data later, and then adapt query engine to use secondary index, related PRs are on the way.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org