You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2021/07/30 13:29:40 UTC
[spark] branch branch-3.2 updated: [SPARK-36254][PYTHON][FOLLOW-UP]
Skip mlflow related tests in pandas on Spark
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push:
new 9cd3708 [SPARK-36254][PYTHON][FOLLOW-UP] Skip mlflow related tests in pandas on Spark
9cd3708 is described below
commit 9cd370894baafb59d76d269595f6fdbaf94c76b8
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Fri Jul 30 22:28:19 2021 +0900
[SPARK-36254][PYTHON][FOLLOW-UP] Skip mlflow related tests in pandas on Spark
### What changes were proposed in this pull request?
This PR is a partial revert of https://github.com/apache/spark/pull/33567 that keeps the logic to skip mlflow related tests if that's not installed.
### Why are the changes needed?
It's consistent with other libraries, e.g) PyArrow.
It also fixes up the potential dev breakage (see also https://github.com/apache/spark/pull/33567#issuecomment-889841829)
### Does this PR introduce _any_ user-facing change?
No, dev-only.
### How was this patch tested?
This is a partial revert. CI should test it out too.
Closes #33589 from HyukjinKwon/SPARK-36254.
Authored-by: Hyukjin Kwon <gu...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit dd2ca0aee25f6da1a1cf36ea8c7e0095420b7c00)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
python/pyspark/pandas/mlflow.py | 8 +++++++-
1 file changed, 7 insertions(+), 1 deletion(-)
diff --git a/python/pyspark/pandas/mlflow.py b/python/pyspark/pandas/mlflow.py
index 4e48369..719db40 100644
--- a/python/pyspark/pandas/mlflow.py
+++ b/python/pyspark/pandas/mlflow.py
@@ -229,4 +229,10 @@ def _test() -> None:
if __name__ == "__main__":
- _test()
+ try:
+ import mlflow # noqa: F401
+ import sklearn # noqa: F401
+
+ _test()
+ except ImportError:
+ pass
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org