You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sedona.apache.org by "Kontinuation (via GitHub)" <gi...@apache.org> on 2024/07/15 07:28:40 UTC

[PR] [SEDONA-627] Write user specified column to the covering metadata of GeoParquet files [sedona]

Kontinuation opened a new pull request, #1522:
URL: https://github.com/apache/sedona/pull/1522

   ## Did you read the Contributor Guide?
   
   - Yes, I have read the [Contributor Rules](https://sedona.apache.org/latest-snapshot/community/rule/) and [Contributor Development Guide](https://sedona.apache.org/latest-snapshot/community/develop/)
   
   ## Is this PR related to a JIRA ticket?
   
   - Yes, the URL of the associated JIRA ticket is https://issues.apache.org/jira/browse/SEDONA-627. The PR name follows the format `[SEDONA-XXX] my subject`.
   
   ## What changes were proposed in this PR?
   
   This patch adds a new option `geoparquet.covering.<geometryColumnName>` to geoparquet format. If the DataFrame being written has a struct column named `bbox` which contains the bounding boxes (`xmin`, `ymin`, `xmax`, `ymax`) of geometries in `geometry` column, it can be saved as geoparquet as follows:
   
   ```scala
   df.write.format("geoparquet").option("geoparquet.covering.geometry", "bbox").save("/path/to/geoparquet")
   ```
   
   The column metadata of `geometry` column will have the following `covering` attribute:
   
   ```json
   "covering": {"bbox": {"xmin": ["bbox", "xmin"], "ymin": ["bbox", "ymin"], "xmax": ["bbox", "xmax"], "ymax": ["bbox", "ymax"]}}
   ```
   
   ## How was this patch tested?
   
   Passing new tests.
   
   ## Did this PR include necessary documentation updates?
   
   - Yes, I have updated the documentation.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@sedona.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [SEDONA-627] Write user specified column to the covering metadata of GeoParquet files [sedona]

Posted by "jiayuasu (via GitHub)" <gi...@apache.org>.
jiayuasu commented on PR #1522:
URL: https://github.com/apache/sedona/pull/1522#issuecomment-2229185031

   Right now, if the user wants to write the covering column, he needs to manually assemble the covering column, which is tedious.
   
   Does it make sense to automatically generate the covering column? I guess this might be hard given the optional Z axis?
   
   Can we at least in the doc explain how to generate the covering column manually (e.g., ST_XMin, ST_YMin, ...)?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@sedona.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [SEDONA-627] Write user specified column to the covering metadata of GeoParquet files [sedona]

Posted by "Kontinuation (via GitHub)" <gi...@apache.org>.
Kontinuation commented on PR #1522:
URL: https://github.com/apache/sedona/pull/1522#issuecomment-2229719251

   This is the first step to support covering column metadata for users already having covering columns in their dataframes and don't need to re-generate those covering columns on writing, we'll add automatic covering column generation support in further PRs.
   
   I've added example code to construct covering columns to the documentation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@sedona.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [SEDONA-627] Write user specified column to the covering metadata of GeoParquet files [sedona]

Posted by "jiayuasu (via GitHub)" <gi...@apache.org>.
jiayuasu merged PR #1522:
URL: https://github.com/apache/sedona/pull/1522


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@sedona.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org