You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2024/03/07 01:29:00 UTC

[jira] [Updated] (SPARK-47311) Surpress Python exceptions where PySpark is not in the Python path

     [ https://issues.apache.org/jira/browse/SPARK-47311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-47311:
---------------------------------
    Priority: Minor  (was: Major)

> Surpress Python exceptions where PySpark is not in the Python path
> ------------------------------------------------------------------
>
>                 Key: SPARK-47311
>                 URL: https://issues.apache.org/jira/browse/SPARK-47311
>             Project: Spark
>          Issue Type: Test
>          Components: PySpark, SQL
>    Affects Versions: 4.0.0
>            Reporter: Hyukjin Kwon
>            Priority: Minor
>
> {code}
> scala> sql("create table t(i int) using json")
> 24/03/06 16:09:44 WARN DataSourceManager: Skipping the lookup of Python Data Sources due to the failure.
> org.apache.spark.SparkException:
> Error from python worker:
>   /opt/homebrew/Caskroom/miniconda/base/bin/python3: Error while finding module specification for 'pyspark.daemon' (ModuleNotFoundError: No module named 'pyspark')
> {code}
> This is too much.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org