You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/25 18:59:31 UTC
[PR] [SPARK-55502][PYTHON][4.1] Unify UDF and UDTF Arrow conversion error handling [spark]
Yicong-Huang opened a new pull request, #55011:
URL: https://github.com/apache/spark/pull/55011
### What changes were proposed in this pull request?
Backport SPARK-55502 to branch-4.1: unify error messages for UDF and UDTF Arrow conversion errors to match master.
**Key changes**:
- UDF path: updated error messages from `"Exception thrown when converting pandas.Series..."` to user-friendly `"Failed to convert..."` / `"Cannot convert..."` format
- UDTF path: replaced `UDTF_ARROW_TYPE_CAST_ERROR` error class with `"Exception thrown when converting pandas.Series..."` format (matching master's legacy path)
- Removed unused `UDTF_ARROW_TYPE_CAST_ERROR` error condition
- Updated test expectations to match new error messages
### Why are the changes needed?
The cross-version CI test (master-server + branch-4.1-client) fails because master updated the error messages in SPARK-55502, but branch-4.1 tests still expect the old format.
### Does this PR introduce _any_ user-facing change?
Yes, error messages change for UDF Arrow conversion errors (same changes as master).
### How was this patch tested?
Updated existing unit tests.
### Was this patch authored or co-authored using generative AI tooling?
No.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-55502][PYTHON][4.1] Unify UDF and UDTF Arrow conversion error handling [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #55011:
URL: https://github.com/apache/spark/pull/55011#issuecomment-4131918306
Merged to branch-4.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-55502][PYTHON][4.1] Unify UDF and UDTF Arrow conversion error handling [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon closed pull request #55011: [SPARK-55502][PYTHON][4.1] Unify UDF and UDTF Arrow conversion error handling
URL: https://github.com/apache/spark/pull/55011
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-55502][PYTHON][4.1] Unify UDF and UDTF Arrow conversion error handling [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on PR #55011:
URL: https://github.com/apache/spark/pull/55011#issuecomment-4129147581
Thank you, @Yicong-Huang .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org