You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/10/13 22:31:33 UTC
[PR] Spark 4.0, 4.2: Port MergingSortedRowDataReader to 4.0 and 4.2 [iceberg]
anuragmantri opened a new pull request, #18492:
URL: https://github.com/apache/iceberg/pull/18492
Ports `MergingSortedRowDataReader` from #14948 (Spark 4.1) to Spark 4.0 and 4.2. The reader is not wired into any scan yet, so behavior is unchanged until the wiring in #16750 is backported.
4.2 is a clean backport. 4.0 (499f6e757c6d7f6dee7a4c944d33f6e41408a8ba) differs only because its `RowDataReader` still takes a separate `tableSchema`, so the reader's constructor gains that parameter and the partition constructor passes `SnapshotUtil.schemaFor(table, branch)` and `expectedSchema()`.
3.5 is a much bigger change so I will do it in a separate PR.
---
**AI Disclosure**
- Model: Claude Sonnet 5.5
- Platform/Tool: Claude Code
- Human Oversight: Fully reviewed by me.
- Prompt Summary: Backport #14948 to Spark 4.0 and 4.2 after reading its review thread, adapting the 4.0 constructor to its `RowDataReader`, and building and testing each version.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark 4.0, 4.2: Port MergingSortedRowDataReader to 4.0 and 4.2 [iceberg]
Posted by "RussellSpitzer (via GitHub)" <gi...@apache.org>.
RussellSpitzer merged PR #18492:
URL: https://github.com/apache/iceberg/pull/18492
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark 4.0, 4.2: Port MergingSortedRowDataReader to 4.0 and 4.2 [iceberg]
Posted by "anuragmantri (via GitHub)" <gi...@apache.org>.
anuragmantri commented on PR #18492:
URL: https://github.com/apache/iceberg/pull/18492#issuecomment-6156659174
For your reviews @RussellSpitzer, @dramaticlly
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark 4.0, 4.2: Port MergingSortedRowDataReader to 4.0 and 4.2 [iceberg]
Posted by "uros-b (via GitHub)" <gi...@apache.org>.
uros-b commented on PR #18492:
URL: https://github.com/apache/iceberg/pull/18492#issuecomment-6213541894
+1, cc @huaxingao too
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org