You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ue...@apache.org on 2023/08/01 15:15:59 UTC
[spark] branch branch-3.5 updated: [SPARK-44614][PYTHON][CONNECT][3.5] Add missing packages in setup.py
This is an automated email from the ASF dual-hosted git repository.
ueshin pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 84f17e7dcd5 [SPARK-44614][PYTHON][CONNECT][3.5] Add missing packages in setup.py
84f17e7dcd5 is described below
commit 84f17e7dcd5e6fa71a1a35a58d0ea19170e897a5
Author: Takuya UESHIN <ue...@databricks.com>
AuthorDate: Tue Aug 1 08:15:45 2023 -0700
[SPARK-44614][PYTHON][CONNECT][3.5] Add missing packages in setup.py
### What changes were proposed in this pull request?
Adds missing packages in `setup.py`.
### Why are the changes needed?
The following packages are not listed in `setup.py`.
- `pyspark.sql.connect.avro`
- `pyspark.sql.connect.client`
- `pyspark.sql.connect.streaming`
- `pyspark.ml.connect`
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
The existing tests.
Closes #42257 from ueshin/issues/SPARK-44614/3.5/packages.
Authored-by: Takuya UESHIN <ue...@databricks.com>
Signed-off-by: Takuya UESHIN <ue...@databricks.com>
---
python/setup.py | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/python/setup.py b/python/setup.py
index a0297d4f9dc..4d14dfd3cb9 100755
--- a/python/setup.py
+++ b/python/setup.py
@@ -235,6 +235,7 @@ try:
"pyspark",
"pyspark.cloudpickle",
"pyspark.mllib",
+ "pyspark.ml.connect",
"pyspark.mllib.linalg",
"pyspark.mllib.stat",
"pyspark.ml",
@@ -245,7 +246,10 @@ try:
"pyspark.sql",
"pyspark.sql.avro",
"pyspark.sql.connect",
+ "pyspark.sql.connect.avro",
+ "pyspark.sql.connect.client",
"pyspark.sql.connect.proto",
+ "pyspark.sql.connect.streaming",
"pyspark.sql.pandas",
"pyspark.sql.protobuf",
"pyspark.sql.streaming",
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org