You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@sedona.apache.org by "freamdx (via GitHub)" <gi...@apache.org> on 2025/05/27 07:44:21 UTC
[I] how to delete 'ColumnarToRow' node in some physical plan when using geospatial predicates? [sedona]
freamdx opened a new issue, #1960:
URL: https://github.com/apache/sedona/issues/1960
1. create three type geospatial tables firstly
- 'test' table using parquet
`create table test (h3 int, geom geometry) using parquet;`
- 'geo_test' table using geoparquet
`create table geo_test (h3 int, geom geometry) using geoparquet;`
- 'iceberg_test' table using iceberg
`create table iceberg_test (h3 int, geom geometry) using iceberg;`
create iceberg table with geometry column, refer patch: [https://github.com/freamdx/iceberg/commit/929dfae730d41516c77adf6801da99a01e410810](url)
2. then, explain spatial query sql 'select ... from ... where st_intersects(...)'
<img width="1434" alt="Image" src="https://github.com/user-attachments/assets/181c5fe6-3429-437b-b937-2612a58eeed0" />
3. how to delete 'ColumnarToRow' node in some physical plan?
when SpatialIndex is disabled and BatchScan is true, how to support columnar processing with predicates?
maybe some predicates should support vectorized computing...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@sedona.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] how to delete 'ColumnarToRow' node in some physical plan when using geospatial predicates? [sedona]
Posted by "freamdx (via GitHub)" <gi...@apache.org>.
freamdx closed issue #1960: how to delete 'ColumnarToRow' node in some physical plan when using geospatial predicates?
URL: https://github.com/apache/sedona/issues/1960
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] how to delete 'ColumnarToRow' node in some physical plan when using geospatial predicates? [sedona]
Posted by "jiayuasu (via GitHub)" <gi...@apache.org>.
jiayuasu commented on issue #1960:
URL: https://github.com/apache/sedona/issues/1960#issuecomment-2913952133
Spark is a row-based compute engine. The reason why you see `ColumnarToRow` is that Spark has vectorized `parquet` / `iceberg` reader. Once the vectorized reader finishes, Spark has to convert it back to row-based layout. The reason why you didn't see it in `geoparquet` reader, it is because Sedona's GeoParquet reader has not support vectorized read yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org