You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sedona.apache.org by "Kontinuation (via GitHub)" <gi...@apache.org> on 2023/06/20 07:24:09 UTC
[GitHub] [sedona] Kontinuation opened a new pull request, #864: [SEDONA-306] Prepare release 1.4.1
Kontinuation opened a new pull request, #864:
URL: https://github.com/apache/sedona/pull/864
## Did you read the Contributor Guide?
- Yes, I have read [Contributor Rules](https://sedona.apache.org/latest-snapshot/community/rule/) and [Contributor Development Guide](https://sedona.apache.org/latest-snapshot/community/develop/)
## Is this PR related to a JIRA ticket?
- Yes, the URL of the associated JIRA ticket is https://issues.apache.org/jira/browse/SEDONA-306. The PR name follows the format `[SEDONA-XXX] my subject`.
## What changes were proposed in this PR?
Due to the changes made to the project structure since Sedona 1.4.0, the release process of Sedona 1.4.1 changed a lot. We'll update the docs and address all the issues introduced to the release process. Notable changes are:
1. Added an `enable-all-submodules` profile for `release:prepare` to substitute versions of all submodules.
2. Don't generate and publish scala docs when building `sedona-core`, `sedona-viz` and `sedona-flink`. We'll publish java docs for these modules. This also gets rid of conflicts caused by deploying javadocs.jar twice.
3. Don't run gpg-sign in the deploy phase. Now the signatures generated by gpg-sign in verify phase are all correct, and there's no need to fix signature issues manually.
We'll also submit release notes for 1.4.1 in the same pull request, as well as other trivial version changes. Experienced contributors can help check if these changes were made correctly.
## How was this patch tested?
We've setup a local nexus repository and tested the release process. The release process to actually publish artifacts to repository.apache.org may be a little bit differ.
## Did this PR include necessary documentation updates?
- Yes, I have updated the documentation update.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [sedona] Kontinuation commented on a diff in pull request #864: [SEDONA-306] Prepare release 1.4.1
Posted by "Kontinuation (via GitHub)" <gi...@apache.org>.
Kontinuation commented on code in PR #864:
URL: https://github.com/apache/sedona/pull/864#discussion_r1236024585
##########
docs/setup/release-notes.md:
##########
@@ -4,6 +4,117 @@
!!!danger
Sedona Python currently only works with Shapely 1.x. If you use GeoPandas, please use <= GeoPandas `0.11.1`. GeoPandas > 0.11.1 will automatically install Shapely 2.0. If you use Shapely, please use <= `1.8.4`.
+## Sedona 1.4.1
+
+Sedona 1.4.1 is compiled against, Spark 3.3 / Spark 3.4 / Flink 1.12, Java 8.
+
+### Highlights
+
+* [X] **Sedona Spark** More raster functions and bridge RasterUDT and Map Algebra operators. See [Raster based operators](../../api/sql/Raster-operators/#raster-based-operators) and [Raster to Map Algebra operators](../../api/sql/Raster-operators/#raster-to-map-algebra-operators).
+* [X] **Sedona Spark & Flink** Added geodesic / geography functions:
+ * ST_DistanceSphere
+ * ST_DistanceSpheroid
+ * ST_AreaSpheroid
+ * ST_LengthSpheroid
+* [X] **Sedona Spark & Flink** Introduced `SedonaContext` to unify Sedona entry points.
+* [X] **Sedona Spark** Support Spark 3.4.
+* [X] **Sedona Spark** Added a number of new ST functions.
+* [X] **Zeppelin** Zeppelin helium plugin supports ploting geometries like linestring, polygon.
+
+### API change
+
+* **Sedona Spark & Flink** Introduced a new entry point called SedonaContext to unify all Sedona entry points in different compute engines and deprecate old Sedona register entry points. Users no longer have to register Sedona kryo serializer and import many tedious Python classes.
+ * **Sedona Spark**:
+ * Scala:
+ ```scala
+ import org.apache.sedona.spark.SedonaContext
+ val sedona = SedonaContext.create(SedonaContext.builder().master("local[*]").getOrCreate())
+ sedona.sql("SELECT ST_GeomFromWKT(XXX) FROM")
+ ```
+ * Python:
+ ```python
+ from sedona.spark import *
+
+ config = SedonaContext.builder().\
+ config('spark.jars.packages',
+ 'org.apache.sedona:sedona-spark-shaded-3.0_2.12:1.4.1,'
+ 'org.datasyslab:geotools-wrapper:1.4.0-28.2'). \
+ getOrCreate()
+ sedona = SedonaContext.create(config)
+ sedona.sql("SELECT ST_GeomFromWKT(XXX) FROM")
+ ```
+ * **Sedona Flink**:
+ ```java
+ import org.apache.sedona.flink.SedonaContext
+ StreamTableEnvironment sedona = SedonaContext.create(env, tableEnv);
+ sedona.sqlQuery("SELECT ST_GeomFromWKT(XXX) FROM")
+ ```
+
+### Bug
+
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-266'>SEDONA-266</a>] - RS_Values throws UnsupportedOperationException for shuffled point arrays
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-267'>SEDONA-267</a>] - Cannot pip install apache-sedona 1.4.0 from source distribution
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-273'>SEDONA-273</a>] - Set a upper bound for Shapely, Pandas and GeoPandas
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-277'>SEDONA-277</a>] - Sedona spark artifacts for scala 2.13 do not have proper POMs
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-283'>SEDONA-283</a>] - Artifacts were deployed twice when running mvn clean deploy
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-284'>SEDONA-284</a>] - Property values in dependency deduced POMs for shaded modules were not substituted
+</li>
+</ul>
+
+### New Feature
+
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-196'>SEDONA-196</a>] - Add ST_Force3D to Sedona
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-239'>SEDONA-239</a>] - Implement ST_NumPoints
+</li>
Review Comment:
Addressed in https://github.com/apache/sedona/commit/b2db51abe7699f77ddf9cfbb5ca1fea7f4df6ccd
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [sedona] jiayuasu merged pull request #864: [SEDONA-306] Prepare release 1.4.1
Posted by "jiayuasu (via GitHub)" <gi...@apache.org>.
jiayuasu merged PR #864:
URL: https://github.com/apache/sedona/pull/864
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [sedona] iGN5117 commented on a diff in pull request #864: [SEDONA-306] Prepare release 1.4.1
Posted by "iGN5117 (via GitHub)" <gi...@apache.org>.
iGN5117 commented on code in PR #864:
URL: https://github.com/apache/sedona/pull/864#discussion_r1235970771
##########
docs/setup/release-notes.md:
##########
@@ -4,6 +4,117 @@
!!!danger
Sedona Python currently only works with Shapely 1.x. If you use GeoPandas, please use <= GeoPandas `0.11.1`. GeoPandas > 0.11.1 will automatically install Shapely 2.0. If you use Shapely, please use <= `1.8.4`.
+## Sedona 1.4.1
+
+Sedona 1.4.1 is compiled against, Spark 3.3 / Spark 3.4 / Flink 1.12, Java 8.
+
+### Highlights
+
+* [X] **Sedona Spark** More raster functions and bridge RasterUDT and Map Algebra operators. See [Raster based operators](../../api/sql/Raster-operators/#raster-based-operators) and [Raster to Map Algebra operators](../../api/sql/Raster-operators/#raster-to-map-algebra-operators).
+* [X] **Sedona Spark & Flink** Added geodesic / geography functions:
+ * ST_DistanceSphere
+ * ST_DistanceSpheroid
+ * ST_AreaSpheroid
+ * ST_LengthSpheroid
+* [X] **Sedona Spark & Flink** Introduced `SedonaContext` to unify Sedona entry points.
+* [X] **Sedona Spark** Support Spark 3.4.
+* [X] **Sedona Spark** Added a number of new ST functions.
+* [X] **Zeppelin** Zeppelin helium plugin supports ploting geometries like linestring, polygon.
+
+### API change
+
+* **Sedona Spark & Flink** Introduced a new entry point called SedonaContext to unify all Sedona entry points in different compute engines and deprecate old Sedona register entry points. Users no longer have to register Sedona kryo serializer and import many tedious Python classes.
+ * **Sedona Spark**:
+ * Scala:
+ ```scala
+ import org.apache.sedona.spark.SedonaContext
+ val sedona = SedonaContext.create(SedonaContext.builder().master("local[*]").getOrCreate())
+ sedona.sql("SELECT ST_GeomFromWKT(XXX) FROM")
+ ```
+ * Python:
+ ```python
+ from sedona.spark import *
+
+ config = SedonaContext.builder().\
+ config('spark.jars.packages',
+ 'org.apache.sedona:sedona-spark-shaded-3.0_2.12:1.4.1,'
+ 'org.datasyslab:geotools-wrapper:1.4.0-28.2'). \
+ getOrCreate()
+ sedona = SedonaContext.create(config)
+ sedona.sql("SELECT ST_GeomFromWKT(XXX) FROM")
+ ```
+ * **Sedona Flink**:
+ ```java
+ import org.apache.sedona.flink.SedonaContext
+ StreamTableEnvironment sedona = SedonaContext.create(env, tableEnv);
+ sedona.sqlQuery("SELECT ST_GeomFromWKT(XXX) FROM")
+ ```
+
+### Bug
+
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-266'>SEDONA-266</a>] - RS_Values throws UnsupportedOperationException for shuffled point arrays
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-267'>SEDONA-267</a>] - Cannot pip install apache-sedona 1.4.0 from source distribution
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-273'>SEDONA-273</a>] - Set a upper bound for Shapely, Pandas and GeoPandas
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-277'>SEDONA-277</a>] - Sedona spark artifacts for scala 2.13 do not have proper POMs
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-283'>SEDONA-283</a>] - Artifacts were deployed twice when running mvn clean deploy
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-284'>SEDONA-284</a>] - Property values in dependency deduced POMs for shaded modules were not substituted
+</li>
+</ul>
+
+### New Feature
+
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-196'>SEDONA-196</a>] - Add ST_Force3D to Sedona
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/SEDONA-239'>SEDONA-239</a>] - Implement ST_NumPoints
+</li>
Review Comment:
@jiayuasu @Kontinuation ST_Translate implementation has also been merged to master, and should be included in the release notes.
JIRA link: https://issues.apache.org/jira/browse/SEDONA-302
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@sedona.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org