You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Phil Walker (Jira)" <ji...@apache.org> on 2022/10/10 20:35:00 UTC
[jira] [Created] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session
Phil Walker created SPARK-40739:
-----------------------------------
Summary: "sbt packageBin" fails in cygwin or other windows bash session
Key: SPARK-40739
URL: https://issues.apache.org/jira/browse/SPARK-40739
Project: Spark
Issue Type: Bug
Components: Build, Windows
Affects Versions: 3.3.0
Environment: The problem occurs in Windows if *_sbt_* is started from a (non-WSL) bash session.
See the spark PR link for detailed symptoms.
Reporter: Phil Walker
In a Windows _*SHELL*_ environment, such as _*cygwin*_ or {_}*msys2/mingw64*{_}, etc, _*Core.settings*_ in _*project/SparkBuild.scala*_ calls the wrong _*bash.exe*_ if WSL bash is present (typically at {_}*C:\Windows*{_}), causing a build failure. This occurs even though the proper *bash.exe* is in the _*PATH*_ ahead of _*WSL*_ bash.exe.
This is fixed by [spark PR 38167|https://github.com/apache/spark/pull/38167]
There are 3 parts to the fix, implemented in _*project/SparkBuild.scala*_ :
* determine the absolute path of the first bash.exe in the command line.
* determine the build environment (e.g., Linux, Darwin, CYGWIN, MSYS2, etc.)
* For Windows SHELL environments, the first argument to the spawned Process is changed from "bash" to the absolute path.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org