You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Armand BERGES (Jira)" <ji...@apache.org> on 2021/09/08 11:55:00 UTC
[jira] [Updated] (SPARK-36694) Unable to build Spark on Azure
DevOps with ubuntu-latest
[ https://issues.apache.org/jira/browse/SPARK-36694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Armand BERGES updated SPARK-36694:
----------------------------------
Description:
Hello
With my team we're currently triying to set up some test environment by using Spark on kubernetes.
For this purpose, we're following your (great) documentation to [build spark|https://spark.apache.org/docs/2.4.8/building-spark.html] and [build spark docker images|https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images].
To make our build, we're using Azure DevOps.
I don't know if it's a known bug or requirements I didn't see but I found that I couldn't build spark on the Azure agent *ubuntu-latest* which I trust to be *ubuntu-20.04*. The exact same build works on *ubuntu-18.04*.
My maven build always failed on building *spark-unsafe_2.11* with the following error :
{code:java}
[error] warning: [options] bootstrap class path not set in conjunction with -source 8
[error] /home/vsts/work/1/s/spark/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:25: error: cannot find symbol [error] import sun.misc.Cleaner;
[error] ^
[error] symbol: class Cleaner
[error] location: package sun.misc
[error] /home/vsts/work/1/s/spark/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172: error: cannot find symbol
[error] Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
[error] ^
[error] symbol: class Cleaner [error] location: class Platform
[error] /home/vsts/work/1/s/spark/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172: error: cannot find symbol
[error] Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
[error] ^
[error] symbol: variable Cleaner
[error] location: class Platform
[error] 3 errors
[error] 1 warning
[error] Compile failed at Sep 8, 2021 10:37:02 AM [1.126s]{code}
Please tell me if I miss anything,
Best regards
was:
Hello
With my team we're currently triying to set up some test environment by using Spark on kubernetes.
For this purpose, we're following your (great) documentation to [build spark|https://spark.apache.org/docs/2.4.8/building-spark.html] and [build spark docker images|https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images].
To make our build, we're using Azure DevOps.
I don't know if it's a known bug or requirements I didn't see but I found that I couldn't build spark on the Azure agent *ubuntu-latest* which I trust to be *ubuntu-20.04*. The exact same build works on *ubuntu-18.04*.
Please tell me if I miss anything,
Best regards
> Unable to build Spark on Azure DevOps with ubuntu-latest
> --------------------------------------------------------
>
> Key: SPARK-36694
> URL: https://issues.apache.org/jira/browse/SPARK-36694
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 2.4.8
> Reporter: Armand BERGES
> Priority: Minor
>
> Hello
> With my team we're currently triying to set up some test environment by using Spark on kubernetes.
> For this purpose, we're following your (great) documentation to [build spark|https://spark.apache.org/docs/2.4.8/building-spark.html] and [build spark docker images|https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images].
> To make our build, we're using Azure DevOps.
> I don't know if it's a known bug or requirements I didn't see but I found that I couldn't build spark on the Azure agent *ubuntu-latest* which I trust to be *ubuntu-20.04*. The exact same build works on *ubuntu-18.04*.
> My maven build always failed on building *spark-unsafe_2.11* with the following error :
> {code:java}
> [error] warning: [options] bootstrap class path not set in conjunction with -source 8
> [error] /home/vsts/work/1/s/spark/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:25: error: cannot find symbol [error] import sun.misc.Cleaner;
> [error] ^
> [error] symbol: class Cleaner
> [error] location: package sun.misc
> [error] /home/vsts/work/1/s/spark/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172: error: cannot find symbol
> [error] Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
> [error] ^
> [error] symbol: class Cleaner [error] location: class Platform
> [error] /home/vsts/work/1/s/spark/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172: error: cannot find symbol
> [error] Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
> [error] ^
> [error] symbol: variable Cleaner
> [error] location: class Platform
> [error] 3 errors
> [error] 1 warning
> [error] Compile failed at Sep 8, 2021 10:37:02 AM [1.126s]{code}
>
> Please tell me if I miss anything,
> Best regards
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org