You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "GGraziadei (via GitHub)" <gi...@apache.org> on 2026/09/12 16:56:03 UTC

[PR] Spark: Backport Z-order null boolean and case-insensitive column fixes to 3.5, 4.0 and 4.2 [iceberg]

GGraziadei opened a new pull request, #18077:
URL: https://github.com/apache/iceberg/pull/18077

   Backport of #17669 to Spark 3.5, 4.0 and 4.2, as noted in that PR.
   
   The main-source changes are identical to the 4.1 version:
   
   - `SparkZOrderUDF.booleanToOrderedBytesUDF()` returns `PRIMITIVE_EMPTY` for a null `Boolean` instead of throwing an NPE, matching the null-sorts-lowest convention already used by the other converters.
   - `SparkZOrderFileRewriteRunner.validZOrderColNames` stores the resolved field name rather than the caller's spelling, so a case-insensitive match no longer fails later in `zValue`.
   
   The three regression tests from #17669 (`zOrderUDFEncodesNullValuesAsZeroBytes`, `zOrderSortWithNullBooleanValues`, `zOrderSortWithMismatchedColumnCase`) are added to `TestRewriteDataFilesAction` for each version.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [PR] Spark: Backport Z-order null boolean and case-insensitive column fixes to 3.5, 4.0 and 4.2 [iceberg]

Posted by "nssalian (via GitHub)" <gi...@apache.org>.
nssalian commented on PR #18077:
URL: https://github.com/apache/iceberg/pull/18077#issuecomment-5647860237

   Thanks for the backport. Glad to see this complete


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [PR] Spark: Backport Z-order null boolean and case-insensitive column fixes to 3.5, 4.0 and 4.2 [iceberg]

Posted by "huaxingao (via GitHub)" <gi...@apache.org>.
huaxingao commented on PR #18077:
URL: https://github.com/apache/iceberg/pull/18077#issuecomment-5647616430

   Thanks @GGraziadei for the PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [PR] Spark: Backport Z-order null boolean and case-insensitive column fixes to 3.5, 4.0 and 4.2 [iceberg]

Posted by "GGraziadei (via GitHub)" <gi...@apache.org>.
GGraziadei commented on PR #18077:
URL: https://github.com/apache/iceberg/pull/18077#issuecomment-5647446746

   Hi @huaxingao, @nssalian happy to receive your review. This a simple backport of #17669


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [PR] Spark: Backport Z-order null boolean and case-insensitive column fixes to 3.5, 4.0 and 4.2 [iceberg]

Posted by "huaxingao (via GitHub)" <gi...@apache.org>.
huaxingao merged PR #18077:
URL: https://github.com/apache/iceberg/pull/18077


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org