You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/02/03 07:55:00 UTC
[jira] [Updated] (SPARK-34341) ./build/mvn error output on aarch64
[ https://issues.apache.org/jira/browse/SPARK-34341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yikun Jiang updated SPARK-34341:
--------------------------------
Description:
You can see the below error ouput in every spark arm jenkins job [1]:
{quote}/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error
{quote}
And you can also reproduce this error output using the simple cmd: `build/mvn -v` on aarch64:
{quote}root@yikun-arm:~/dev/spark# uname -a
Linux yikun-arm 4.15.0-70-generic #79-Ubuntu SMP Tue Nov 12 10:36:10 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
root@yikun-arm:~/dev/spark# uname -m
aarch64
root@yikun-arm:~/dev/spark# build/mvn -v
*/root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
*/root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
Using `mvn` from path: /root/dev/spark/build/apache-maven-3.6.3/bin/mvn
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
Maven home: /root/dev/spark/build/apache-maven-3.6.3
Java version: 1.8.0_222, vendor: Private Build, runtime: /usr/lib/jvm/java-8-openjdk-arm64/jre
Default locale: en, platform encoding: UTF-8
OS name: "linux", version: "4.15.0-70-generic", arch: "aarch64", family: "unix"
*/root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
{quote}
The reason of this error output is that the zinc is not supported well on aarch64, unfortunately, the stand alone zinc is deprecated now[2], so that we have no chance to support it on aarch64 in stand alone verison.
Looks like we should skip the zinc related command on aarch64 platform first, and then upgrade the sbt/zinc[3] in future.
[1] [https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/547/consoleFull]
[2] [https://github.com/typesafehub/zinc]
[3] [https://github.com/sbt/zinc]
was:
You can see the below error ouput in every spark arm jenkins job [1]:
{quote}/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error
{quote}
And you can also reproduce this error output using the simple cmd: `build/mvn -v` on aarch64:
{quote}root@yikun-arm:~/dev/spark# uname -a
Linux yikun-arm 4.15.0-70-generic #79-Ubuntu SMP Tue Nov 12 10:36:10 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
root@yikun-arm:~/dev/spark# uname -m
aarch64
root@yikun-arm:~/dev/spark# build/mvn -v
*/root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
*/root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
Using `mvn` from path: /root/dev/spark/build/apache-maven-3.6.3/bin/mvn
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
Maven home: /root/dev/spark/build/apache-maven-3.6.3
Java version: 1.8.0_222, vendor: Private Build, runtime: /usr/lib/jvm/java-8-openjdk-arm64/jre
Default locale: en, platform encoding: UTF-8
OS name: "linux", version: "4.15.0-70-generic", arch: "aarch64", family: "unix"
*/root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
{quote}
The reason of this error output is that the zinc is not supported well on aarch64, unfortunately, the stand alone zinc is deprecated now, so that we have no chance to support it on aarch64 in stand alone verison.
Looks like we should skip the zinc related command on aarch64 platform first, and then upgrade the sbt/zinc in future.
[1] [https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/547/consoleFull]
[2] https://github.com/typesafehub/zinc
[3] https://github.com/sbt/zinc
> ./build/mvn error output on aarch64
> -----------------------------------
>
> Key: SPARK-34341
> URL: https://issues.apache.org/jira/browse/SPARK-34341
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 3.1.2
> Reporter: Yikun Jiang
> Priority: Minor
>
> You can see the below error ouput in every spark arm jenkins job [1]:
> {quote}/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error
> {quote}
> And you can also reproduce this error output using the simple cmd: `build/mvn -v` on aarch64:
> {quote}root@yikun-arm:~/dev/spark# uname -a
> Linux yikun-arm 4.15.0-70-generic #79-Ubuntu SMP Tue Nov 12 10:36:10 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
> root@yikun-arm:~/dev/spark# uname -m
> aarch64
> root@yikun-arm:~/dev/spark# build/mvn -v
> */root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
> */root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
> Using `mvn` from path: /root/dev/spark/build/apache-maven-3.6.3/bin/mvn
> Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
> Maven home: /root/dev/spark/build/apache-maven-3.6.3
> Java version: 1.8.0_222, vendor: Private Build, runtime: /usr/lib/jvm/java-8-openjdk-arm64/jre
> Default locale: en, platform encoding: UTF-8
> OS name: "linux", version: "4.15.0-70-generic", arch: "aarch64", family: "unix"
> */root/dev/spark/build/zinc-0.3.15/bin/nailgun: line 50: /root/dev/spark/build/zinc-0.3.15/bin/ng/linux32/ng: cannot execute binary file: Exec format error*
> {quote}
> The reason of this error output is that the zinc is not supported well on aarch64, unfortunately, the stand alone zinc is deprecated now[2], so that we have no chance to support it on aarch64 in stand alone verison.
> Looks like we should skip the zinc related command on aarch64 platform first, and then upgrade the sbt/zinc[3] in future.
>
> [1] [https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/547/consoleFull]
> [2] [https://github.com/typesafehub/zinc]
> [3] [https://github.com/sbt/zinc]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org