You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@sedona.apache.org by "akashchamp (via GitHub)" <gi...@apache.org> on 2026/09/12 00:54:53 UTC
[PR] [GH-3351][Python] Preserve generated GeoArrow column names [sedona]
akashchamp opened a new pull request, #3354:
URL: https://github.com/apache/sedona/pull/3354
## Did you read the Contributor Guide?
Yes, I have read the [Contributor Rules](https://sedona.apache.org/latest/community/rule/) and [Contributor Development Guide](https://sedona.apache.org/latest/community/develop/).
## Is this PR related to a ticket?
Yes. Closes #3351.
## What changes were proposed in this PR?
`dataframe_to_arrow()` previously used `list(df)` to build its input expressions. Spark resolves a generated geometry name such as `st_point(1.0, 2.0)` as a dotted path, so conversion fails before GeoArrow encoding runs.
Build explicit, backtick-quoted Spark column expressions from the schema names, escaping embedded backticks, before applying `ST_AsEWKB`. The original field name is still restored with `alias`, so generated geometry expressions retain their expected Arrow column name.
## How was this patch tested?
- Added a regression using `SELECT ST_Point(1.0, 2.0)` without an alias.
- Manually reproduced the issue: the unchanged path raised Spark's dotted-name `AnalysisException`; with this patch the input and Arrow table both reported `['st_point(1.0, 2.0)']` and one row.
- `python/tests/utils/test_geoarrow.py`: 7 passed, 1 optional GeoArrow-types test skipped.
- Black formatting check, `compileall`, and `git diff --check` passed.
## Did this PR include necessary documentation updates?
No documentation changes are needed. This restores conversion for an existing DataFrame shape without changing the public API.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [GH-3351][Python] Preserve generated GeoArrow column names [sedona]
Posted by "jiayuasu (via GitHub)" <gi...@apache.org>.
jiayuasu merged PR #3354:
URL: https://github.com/apache/sedona/pull/3354
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org