You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2020/07/14 10:21:00 UTC
[jira] [Updated] (SPARK-32303) Remove leftover from editable mode
installation in PIP test
[ https://issues.apache.org/jira/browse/SPARK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-32303:
---------------------------------
Affects Version/s: 2.4.6
3.0.0
> Remove leftover from editable mode installation in PIP test
> -----------------------------------------------------------
>
> Key: SPARK-32303
> URL: https://issues.apache.org/jira/browse/SPARK-32303
> Project: Spark
> Issue Type: Test
> Components: PySpark
> Affects Versions: 2.4.6, 3.0.0, 3.1.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> Jenkins fails as below:
> {code}
> Installing dist into virtual env
> Processing ./python/dist/pyspark-3.1.0.dev0.tar.gz
> Collecting py4j==0.10.9 (from pyspark==3.1.0.dev0)
> Downloading https://files.pythonhosted.org/packages/9e/b6/6a4fb90cd235dc8e265a6a2067f2a2c99f0d91787f06aca4bcf7c23f3f80/py4j-0.10.9-py2.py3-none-any.whl (198kB)
> Installing collected packages: py4j, pyspark
> Found existing installation: py4j 0.10.9
> Uninstalling py4j-0.10.9:
> Successfully uninstalled py4j-0.10.9
> Found existing installation: pyspark 3.1.0.dev0
> Exception:
> Traceback (most recent call last):
> File "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/cli/base_command.py", line 179, in main
> status = self.run(options, args)
> File "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/commands/install.py", line 393, in run
> use_user_site=options.use_user_site,
> File "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/req/__init__.py", line 50, in install_given_reqs
> auto_confirm=True
> File "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/req/req_install.py", line 816, in uninstall
> uninstalled_pathset = UninstallPathSet.from_dist(dist)
> File "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/req/req_uninstall.py", line 505, in from_dist
> '(at %s)' % (link_pointer, dist.project_name, dist.location)
> AssertionError: Egg-link /home/jenkins/workspace/SparkPullRequestBuilder@3/python does not match installed
> {code}
> Seems like the editable mode from other installations affect. We should better remove the symbolic link.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org