You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/08/28 02:56:00 UTC
[jira] [Resolved] (SPARK-44963) Make PySpark (pyspark-ml module) tests passing without any optional dependency
[ https://issues.apache.org/jira/browse/SPARK-44963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-44963.
----------------------------------
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42678
[https://github.com/apache/spark/pull/42678]
> Make PySpark (pyspark-ml module) tests passing without any optional dependency
> ------------------------------------------------------------------------------
>
> Key: SPARK-44963
> URL: https://issues.apache.org/jira/browse/SPARK-44963
> Project: Spark
> Issue Type: Improvement
> Components: PySpark, Tests
> Affects Versions: 4.0.0
> Reporter: Hyukjin Kwon
> Assignee: Hyukjin Kwon
> Priority: Major
> Fix For: 4.0.0
>
>
> {code}
> ./python/run-tests --python-executables=python3 --modules=pyspark-ml
> ...
> Starting test(python3): pyspark.ml.tests.test_model_cache (temp output: /Users/hyukjin.kwon/workspace/forked/spark/python/target/f6f88c1e-0cb2-43e6-980e-47f1cdb9b463/python3__pyspark.ml.tests.test_model_cache__zij05l1u.log)
> Traceback (most recent call last):
> File "/Users/hyukjin.kwon/miniconda3/envs/vanilla-3.10/lib/python3.10/runpy.py", line 196, in _run_module_as_main
> return _run_code(code, main_globals, None,
> File "/Users/hyukjin.kwon/miniconda3/envs/vanilla-3.10/lib/python3.10/runpy.py", line 86, in _run_code
> exec(code, run_globals)
> File "/Users/hyukjin.kwon/workspace/forked/spark/python/pyspark/ml/tests/test_functions.py", line 18, in <module>
> import pandas as pd
> ModuleNotFoundError: No module named 'pandas'
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org