You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "Baunsgaard (via GitHub)" <gi...@apache.org> on 2026/05/20 08:26:48 UTC
[PR] Core: Arrow position delete reader V2 [iceberg]
Baunsgaard opened a new pull request, #16440:
URL: https://github.com/apache/iceberg/pull/16440
Add `VectorizedPositionDeleteReader`, an Arrow-vectorized reader for V2 position delete files. Reads `(file_path, pos)` directly from Arrow `VarChar` / `BigInt` buffers and feeds the shared `RangeAccumulator` from #16052, so consecutive positions become `PositionDeleteIndex.delete(start, end)` range inserts. No per-row Java allocation on the hot path.
Stacked on #16052, that PR adds the coalescing primitive in `iceberg-core`; this PR wires it into the Arrow read path.
`BaseDeleteLoader.readPosDeletes` now dispatches through a new `PositionDeleteIndexReader` SPI on `FormatModelRegistry`, so the Arrow path is picked up automatically when `iceberg-arrow` is on the classpath.
Like #16052, this primarily benefits Iceberg V2 tables; V3 DVs deserialize directly and bypass both paths.
Benchmark numbers will be posted as a follow-up comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Core: Arrow position delete reader V2 [iceberg]
Posted by "Baunsgaard (via GitHub)" <gi...@apache.org>.
Baunsgaard commented on PR #16440:
URL: https://github.com/apache/iceberg/pull/16440#issuecomment-4831749640
This PR needs further discussion like its parent PR. Therefore closing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Core: Arrow position delete reader V2 [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #16440:
URL: https://github.com/apache/iceberg/pull/16440#issuecomment-4828074258
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Core: Arrow position delete reader V2 [iceberg]
Posted by "Baunsgaard (via GitHub)" <gi...@apache.org>.
Baunsgaard closed pull request #16440: Core: Arrow position delete reader V2
URL: https://github.com/apache/iceberg/pull/16440
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org