You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Phil Walker (Jira)" <ji...@apache.org> on 2022/10/10 20:35:00 UTC

[jira] [Created] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

Phil Walker created SPARK-40739:
-----------------------------------

             Summary: "sbt packageBin" fails in cygwin or other windows bash session
                 Key: SPARK-40739
                 URL: https://issues.apache.org/jira/browse/SPARK-40739
             Project: Spark
          Issue Type: Bug
          Components: Build, Windows
    Affects Versions: 3.3.0
         Environment: The problem occurs in Windows if *_sbt_* is started from a (non-WSL) bash session.

See the spark PR link for detailed symptoms.
            Reporter: Phil Walker


 In a Windows _*SHELL*_ environment, such as _*cygwin*_ or {_}*msys2/mingw64*{_}, etc,  _*Core.settings*_ in _*project/SparkBuild.scala*_ calls the wrong _*bash.exe*_ if WSL bash is present (typically at {_}*C:\Windows*{_}), causing a build failure.  This occurs even though the proper *bash.exe* is in the _*PATH*_ ahead of _*WSL*_ bash.exe.

This is fixed by [spark PR 38167|https://github.com/apache/spark/pull/38167]

There are 3 parts to the fix, implemented in _*project/SparkBuild.scala*_ :
 * determine the absolute path of the first bash.exe in the command line. 
 * determine the build environment (e.g., Linux, Darwin, CYGWIN, MSYS2, etc.)
 * For Windows SHELL environments, the first argument to the spawned Process is changed from "bash" to the absolute path.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org