You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "XiaoHongbo-Hope (via GitHub)" <gi...@apache.org> on 2026/08/03 12:06:05 UTC

Re: [PR] [core][flink][spark][python][vector] Support vector indexes on DV tables [paimon]

XiaoHongbo-Hope commented on PR #8930:
URL: https://github.com/apache/paimon/pull/8930#issuecomment-5166086054

   Thanks for the detailed review. Both requested changes are addressed in 6363ee86a6:
   
   1. Spark now records `plan.snapshot()`. PyPaimon vector plans carry the planned snapshot and thread it through DV live-row filtering, scalar-index filtering (indexed and raw paths), and raw fallback reads, with regression coverage for each path.
   2. `NativeVectorGlobalIndexerFactory` now opts in to DV support. The DV builder test covers `ivf-flat`, `ivf-pq`, `ivf-sq`, `ivf-rq`, and `diskann`, in addition to Lumina.
   
   Validation completed locally: PyPaimon vector/filter tests (67), Spark reader tests (4), native factory tests (17), Flink DV builder tests (5), Python flake8, and Java Spotless.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org