You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2026/10/11 16:47:14 UTC
(spark) branch master updated: [SPARK-60122][PYTHON] Remove non-existent `avro` Maven profile from Avro doctest skip messages
This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 4def9666e4f8 [SPARK-60122][PYTHON] Remove non-existent `avro` Maven profile from Avro doctest skip messages
4def9666e4f8 is described below
commit 4def9666e4f857ff4aa7531e06e118e0a938662f
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Sun Oct 11 17:47:03 2026 +0100
[SPARK-60122][PYTHON] Remove non-existent `avro` Maven profile from Avro doctest skip messages
### What changes were proposed in this pull request?
This PR aims to remove a non-existent Maven profile, `-Pavro`, from the skip messages of the Avro doctests in the following files.
- `python/pyspark/sql/avro/functions.py`
- `python/pyspark/sql/connect/avro/functions.py`
### Why are the changes needed?
There is no `avro` profile in any `pom.xml`, and there never has been. `connector/avro` has been a default module of the root `pom.xml` since SPARK-24768, so `build/sbt package` and `build/mvn package` already build `spark-avro`. The current message suggests a profile that Maven ignores, with a warning like the following.
```
[WARNING] The requested profile "avro" could not be activated because it does not exist.
```
The message seems to have come from the Kinesis test message when SPARK-26856 added it. The Kinesis message uses `-Pkinesis-asl` because the Kinesis module is built only with that profile. After this PR, the Avro messages are the same as the existing Protobuf messages, which already suggest `build/sbt package` and `build/mvn package` without any profile.
- `python/pyspark/sql/protobuf/functions.py`
- `python/pyspark/sql/connect/protobuf/functions.py`
### Does this PR introduce _any_ user-facing change?
No. This only changes a test skip message.
### How was this patch tested?
Manual review. `git grep -- '-Pavro'` returns no results after this change.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Opus 5.5
Closes #59337 from dongjoon-hyun/SPARK-60122.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
python/pyspark/sql/avro/functions.py | 4 ++--
python/pyspark/sql/connect/avro/functions.py | 4 ++--
2 files changed, 4 insertions(+), 4 deletions(-)
diff --git a/python/pyspark/sql/avro/functions.py b/python/pyspark/sql/avro/functions.py
index f547f17a676c..0f40cad465b6 100644
--- a/python/pyspark/sql/avro/functions.py
+++ b/python/pyspark/sql/avro/functions.py
@@ -194,8 +194,8 @@ def _test() -> None:
print(
"Skipping all Avro Python tests as the optional Avro project was "
"not compiled into a JAR. To run these tests, "
- "you need to build Spark with 'build/sbt -Pavro package' or "
- "'build/mvn -Pavro package' before running this test."
+ "you need to build Spark with 'build/sbt package' or "
+ "'build/mvn package' before running this test."
)
sys.exit(0)
else:
diff --git a/python/pyspark/sql/connect/avro/functions.py b/python/pyspark/sql/connect/avro/functions.py
index 69b91d261926..1136d44ea1f3 100644
--- a/python/pyspark/sql/connect/avro/functions.py
+++ b/python/pyspark/sql/connect/avro/functions.py
@@ -98,8 +98,8 @@ def _test() -> None:
print(
"Skipping all Avro Python tests as the optional Avro project was "
"not compiled into a JAR. To run these tests, "
- "you need to build Spark with 'build/sbt -Pavro package' or "
- "'build/mvn -Pavro package' before running this test."
+ "you need to build Spark with 'build/sbt package' or "
+ "'build/mvn package' before running this test."
)
sys.exit(0)
else:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org