You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2023/05/10 12:17:53 UTC
[spark] branch master updated: [SPARK-43434][CONNECT][PYTHON][TESTS] Disable flaky doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 70eef5df94d [SPARK-43434][CONNECT][PYTHON][TESTS] Disable flaky doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`
70eef5df94d is described below
commit 70eef5df94d741eb4aca3a0ce647f180397fd474
Author: Ruifeng Zheng <ru...@apache.org>
AuthorDate: Wed May 10 21:17:36 2023 +0900
[SPARK-43434][CONNECT][PYTHON][TESTS] Disable flaky doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`
### What changes were proposed in this pull request?
Disable flaky doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`
### Why are the changes needed?
This test is unstable, see https://github.com/apache/spark/pull/40586#issuecomment-1524690074 and https://github.com/apache/spark/pull/40586#discussion_r1182411427
### Does this PR introduce _any_ user-facing change?
No, dev-only
### How was this patch tested?
updated UT
Closes #41114 from zhengruifeng/connect_test_write_stream.
Authored-by: Ruifeng Zheng <ru...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
python/pyspark/sql/connect/dataframe.py | 3 +++
1 file changed, 3 insertions(+)
diff --git a/python/pyspark/sql/connect/dataframe.py b/python/pyspark/sql/connect/dataframe.py
index 87f061f139e..ffd52cf0cec 100644
--- a/python/pyspark/sql/connect/dataframe.py
+++ b/python/pyspark/sql/connect/dataframe.py
@@ -2171,6 +2171,9 @@ def _test() -> None:
# TODO(SPARK-41888): Support StreamingQueryListener for DataFrame.observe
del pyspark.sql.connect.dataframe.DataFrame.observe.__doc__
+ # TODO(SPARK-43435): should reenable this test
+ del pyspark.sql.connect.dataframe.DataFrame.writeStream.__doc__
+
globs["spark"] = (
PySparkSession.builder.appName("sql.connect.dataframe tests")
.remote("local[4]")
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org