WARN: netlib.BLAS

[陈刚 <cg...@scu.edu.cn>]

Dear export,




I'm using spark-3.1.1 mllib, and I got this on CentOS 7.6:




22/08/01 09:42:34 WARN netlib.BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS
22/08/01 09:42:34 WARN netlib.BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeRefBLAS





I used 

yum -y install openblas*

yum -y install blas 

to install blas

and added 




// https://mvnrepository.com/artifact/com.github.fommil.netlib/all
libraryDependencies += "com.github.fommil.netlib" % "all" % "1.1.2" pomOnly()


in the sbt file.




But I still got the WARN.




Please help me!




Best




Gang Chen

Re: WARN: netlib.BLAS

[Sean Owen <sr...@gmail.com>]

Hm, I think the problem is either that you need to build the
spark-ganglia-lgpl module in your Spark distro, or the pomOnly() part of
your build. You need the code in your app.
Yes you need openblas too.

On Mon, Aug 1, 2022 at 7:36 AM 陈刚 <cg...@scu.edu.cn> wrote:

> Dear export,
>
>
> I'm using spark-3.1.1 mllib, and I got this on CentOS 7.6:
>
>
> 22/08/01 09:42:34 WARN netlib.BLAS: Failed to load implementation from:
> com.github.fommil.netlib.NativeSystemBLAS
> 22/08/01 09:42:34 WARN netlib.BLAS: Failed to load implementation from:
> com.github.fommil.netlib.NativeRefBLAS
>
>
> I used
>
> yum -y install openblas*
>
> yum -y install blas
>
> to install blas
>
> and added
>
>
> // https://mvnrepository.com/artifact/com.github.fommil.netlib/all
> libraryDependencies += "com.github.fommil.netlib" % "all" % "1.1.2"
> pomOnly()
>
> in the sbt file.
>
>
> But I still got the WARN.
>
>
> Please help me!
>
>
> Best
>
>
> Gang Chen
>