You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/01/21 01:08:00 UTC
[jira] [Resolved] (SPARK-26670) worker.py uses resource python
library, which is not available for windows
[ https://issues.apache.org/jira/browse/SPARK-26670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-26670.
----------------------------------
Resolution: Duplicate
It duplicates SPARK-26080. Please take a look for resolved JIRAs first next time.
> worker.py uses resource python library, which is not available for windows
> --------------------------------------------------------------------------
>
> Key: SPARK-26670
> URL: https://issues.apache.org/jira/browse/SPARK-26670
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 2.4.0
> Reporter: René Buffat
> Priority: Major
>
> worker.py in spark 2.4.0 uses the resource python library, which is only available for unix.
>
> I'm trying out to run sample code for pyspark on Windows. It fails with an import error in worker.py for "resource". Thus, the sample code does not work on windows with spark 2.4.0. However, the same code works with spark 2.3.2 (which lacks the "resource" dependency).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org