You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Phil Walker (Jira)" <ji...@apache.org> on 2022/10/12 21:13:00 UTC
[jira] [Updated] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phil Walker updated SPARK-40739:
--------------------------------
External issue ID: 38228 (was: 38167)
Description:
In a Windows _*SHELL*_ environment, such as _*cygwin*_ or {_}*msys2/mingw64*{_}, etc, _*Core.settings*_ in _*project/SparkBuild.scala*_ calls the wrong _*bash.exe*_ if WSL bash is present (typically at {_}*C:\Windows*{_}), causing a build failure. This occurs even though the proper *bash.exe* is in the _*PATH*_ ahead of _*WSL*_ bash.exe.
This is fixed by [spark PR 38228|https://github.com/apache/spark/pull/38167]
There are 3 parts to the fix, implemented in _*project/SparkBuild.scala*_ :
* determine the absolute path of the first bash.exe in the command line.
* determine the build environment (e.g., Linux, Darwin, CYGWIN, MSYS2, etc.)
* For Windows SHELL environments, the first argument to the spawned Process is changed from "bash" to the absolute path.
was:
In a Windows _*SHELL*_ environment, such as _*cygwin*_ or {_}*msys2/mingw64*{_}, etc, _*Core.settings*_ in _*project/SparkBuild.scala*_ calls the wrong _*bash.exe*_ if WSL bash is present (typically at {_}*C:\Windows*{_}), causing a build failure. This occurs even though the proper *bash.exe* is in the _*PATH*_ ahead of _*WSL*_ bash.exe.
This is fixed by [spark PR 38167|https://github.com/apache/spark/pull/38167]
There are 3 parts to the fix, implemented in _*project/SparkBuild.scala*_ :
* determine the absolute path of the first bash.exe in the command line.
* determine the build environment (e.g., Linux, Darwin, CYGWIN, MSYS2, etc.)
* For Windows SHELL environments, the first argument to the spawned Process is changed from "bash" to the absolute path.
> "sbt packageBin" fails in cygwin or other windows bash session
> --------------------------------------------------------------
>
> Key: SPARK-40739
> URL: https://issues.apache.org/jira/browse/SPARK-40739
> Project: Spark
> Issue Type: Bug
> Components: Build, Windows
> Affects Versions: 3.3.0
> Environment: The problem occurs in Windows if *_sbt_* is started from a (non-WSL) bash session.
> See the spark PR link for detailed symptoms.
> Reporter: Phil Walker
> Priority: Major
> Labels: bash, cygwin, mingw, msys2,, windows
> Original Estimate: 0h
> Remaining Estimate: 0h
>
> In a Windows _*SHELL*_ environment, such as _*cygwin*_ or {_}*msys2/mingw64*{_}, etc, _*Core.settings*_ in _*project/SparkBuild.scala*_ calls the wrong _*bash.exe*_ if WSL bash is present (typically at {_}*C:\Windows*{_}), causing a build failure. This occurs even though the proper *bash.exe* is in the _*PATH*_ ahead of _*WSL*_ bash.exe.
> This is fixed by [spark PR 38228|https://github.com/apache/spark/pull/38167]
> There are 3 parts to the fix, implemented in _*project/SparkBuild.scala*_ :
> * determine the absolute path of the first bash.exe in the command line.
> * determine the build environment (e.g., Linux, Darwin, CYGWIN, MSYS2, etc.)
> * For Windows SHELL environments, the first argument to the spawned Process is changed from "bash" to the absolute path.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org