You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by ck...@sina.cn on 2023/03/07 07:42:27 UTC
Build SPARK from source with SBT failed
Hello,
I have tried to build SPARK source codes with SBT in my local dev environment (MacOS 13.2.1). But it reported following error:[error] java.io.IOException: Cannot run program "/Library/Java/JavaVirtualMachines/zulu-11.jdk/Contents/bin/javac" (in directory "/Users/username/spark-remotemaster"): error=2, No such file or directory
[error] at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1128)
[error] at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071)
[error] at scala.sys.process.ProcessBuilderImpl$Simple.run(ProcessBuilderImpl.scala:75)
[error] at scala.sys.process.ProcessBuilderImpl$AbstractBuilder.run(ProcessBuilderImpl.scala:106)
I need to export JAVA_HOME to let it run successfully. But if I use maven then I don't need to export JAVA_HOME. I have also tried to build SPARK with SBT in Ubuntu X86_64 environment. It reported similar error. The official SPARK documentation haven't mentioned export JAVA_HOME operation. So I think this is a bug which needs documentation or scripts change. Please correct me if I am wrong.
Thanks
Liang
Re: Build SPARK from source with SBT failed
Posted by Sean Owen <sr...@gmail.com>.
This says you don't have the java compiler installed. Did you install the
Apple Developer Tools package?
On Tue, Mar 7, 2023 at 1:42 AM <ck...@sina.cn> wrote:
> Hello,
>
> I have tried to build SPARK source codes with SBT in my local dev
> environment (MacOS 13.2.1). But it reported following error:
> [error] java.io.IOException: Cannot run program
> "/Library/Java/JavaVirtualMachines/zulu-11.jdk/Contents/bin/javac" (in
> directory "/Users/username/spark-remotemaster"): error=2, No such file or
> directory
>
> [error] at
> java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1128)
>
> [error] at
> java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071)
>
> [error] at
> scala.sys.process.ProcessBuilderImpl$Simple.run(ProcessBuilderImpl.scala:75)
> [error] at
> scala.sys.process.ProcessBuilderImpl$AbstractBuilder.run(ProcessBuilderImpl.scala:106)
>
> I need to export JAVA_HOME to let it run successfully. But if I use maven
> then I don't need to export JAVA_HOME. I have also tried to build SPARK
> with SBT in Ubuntu X86_64 environment. It reported similar error.
>
> The official SPARK
> documentation haven't mentioned export JAVA_HOME operation. So I think
> this is a bug which needs documentation or scripts change. Please correct
> me if I am wrong.
>
> Thanks
>
> Liang
>
>