[incubator-sedona] branch master updated: [SEDONA-59] Make pyspark dependency of sedona python optional (#537)

[ji...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

jiayu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-sedona.git


The following commit(s) were added to refs/heads/master by this push:
     new 59bc709  [SEDONA-59] Make pyspark dependency of sedona python optional (#537)
59bc709 is described below

commit 59bc7098baeb7791b745865c249e03eee16a71f9
Author: Sebastian Eckweiler <se...@gmail.com>
AuthorDate: Thu Aug 26 06:35:07 2021 +0200

    [SEDONA-59] Make pyspark dependency of sedona python optional (#537)
---
 docs/download/overview.md | 5 +++++
 python/Pipfile            | 2 +-
 python/setup.py           | 3 ++-
 3 files changed, 8 insertions(+), 2 deletions(-)

diff --git a/docs/download/overview.md b/docs/download/overview.md
index 1c1acd3..f63ff6e 100644
--- a/docs/download/overview.md
+++ b/docs/download/overview.md
@@ -56,6 +56,11 @@ You need to install necessary packages if your system does not have them install
 ```bash
 pip install apache-sedona
 ```
+* Since version 1.1.0 pyspark is an optional dependency since spark comes pre-installed on many spark platforms.
+  To install pyspark along with Sedona Python in one go, use the `spark` extra:
+```bash
+pip install apache-sedona[spark]
+```
 
 * Installing from Sedona Python source
 
diff --git a/python/Pipfile b/python/Pipfile
index 8e596d3..2295b6d 100644
--- a/python/Pipfile
+++ b/python/Pipfile
@@ -13,7 +13,7 @@ pytest-cov = "*"
 [packages]
 pandas="*"
 geopandas="==0.6.0"
-pyspark=">=2.4.0"
+pyspark=">=2.3.0"
 attrs="*"
 
 [requires]
diff --git a/python/setup.py b/python/setup.py
index ff10280..1764e74 100644
--- a/python/setup.py
+++ b/python/setup.py
@@ -36,7 +36,8 @@ setup(
     long_description=long_description,
     long_description_content_type="text/markdown",
     python_requires='>=3.6',
-    install_requires=['pyspark>=2.3.0', 'attrs', "shapely"],
+    install_requires=['attrs', "shapely"],
+    extras_require={"spark": ['pyspark>=2.3.0']},
     project_urls={
         'Documentation': 'https://sedona.apache.org',
         'Source code': 'https://github.com/apache/incubator-sedona',