You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2024/04/08 08:06:45 UTC
(spark) branch master updated: [SPARK-47762][PYTHON][CONNECT] Add pyspark.sql.connect.protobuf into setup.py
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new f94d95d75886 [SPARK-47762][PYTHON][CONNECT] Add pyspark.sql.connect.protobuf into setup.py
f94d95d75886 is described below
commit f94d95d75886b1af3434cff0c50c99ea1e196092
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Mon Apr 8 17:06:33 2024 +0900
[SPARK-47762][PYTHON][CONNECT] Add pyspark.sql.connect.protobuf into setup.py
### What changes were proposed in this pull request?
This PR is a followup of https://github.com/apache/spark/pull/42563 (but using new JIRA as it's already released), which adds `pyspark.sql.connect.protobuf` into `setup.py`.
### Why are the changes needed?
So PyPI packaged PySpark can support protobuf function with Spark Connect on.
### Does this PR introduce _any_ user-facing change?
Yes. The new feature is now available with Spark Connect on if users install Spark Connect by `pip`.
### How was this patch tested?
Being tested in https://github.com/apache/spark/pull/45870
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #45924 from HyukjinKwon/SPARK-47762.
Authored-by: Hyukjin Kwon <gu...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
python/packaging/classic/setup.py | 1 +
python/packaging/connect/setup.py | 1 +
2 files changed, 2 insertions(+)
diff --git a/python/packaging/classic/setup.py b/python/packaging/classic/setup.py
index 8844d225d1b8..ddd2448e1c18 100755
--- a/python/packaging/classic/setup.py
+++ b/python/packaging/classic/setup.py
@@ -275,6 +275,7 @@ try:
"pyspark.sql.connect.client",
"pyspark.sql.connect.functions",
"pyspark.sql.connect.proto",
+ "pyspark.sql.connect.protobuf",
"pyspark.sql.connect.shell",
"pyspark.sql.connect.streaming",
"pyspark.sql.connect.streaming.worker",
diff --git a/python/packaging/connect/setup.py b/python/packaging/connect/setup.py
index 157bc86c192e..01c5518d4451 100755
--- a/python/packaging/connect/setup.py
+++ b/python/packaging/connect/setup.py
@@ -103,6 +103,7 @@ try:
"pyspark.sql.connect.client",
"pyspark.sql.connect.functions",
"pyspark.sql.connect.proto",
+ "pyspark.sql.connect.protobuf",
"pyspark.sql.connect.shell",
"pyspark.sql.connect.streaming",
"pyspark.sql.connect.streaming.worker",
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org