[jira] [Closed] (SPARK-19744) Find a better alternative to netlib-java

["Demi Marie Obenour (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-19744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Demi Marie Obenour closed SPARK-19744.
--------------------------------------

This report is bogus.  I reported it out of frustration.  Adding {{com.github.fommil:jniloader:1.1}} (along with {{com.github.fommil.netlib:all:1.1.2}}) as dependencies does make the {{NativeSystemBLAS}}, {{NativeSystemLAPACK}}, and {{NativeSystemARPACK}} implementations visible, so this bug is invalid.  I will file a bug about the missing dependency.

> Find a better alternative to netlib-java
> ----------------------------------------
>
>                 Key: SPARK-19744
>                 URL: https://issues.apache.org/jira/browse/SPARK-19744
>             Project: Spark
>          Issue Type: New Feature
>          Components: Build, ML, MLlib
>    Affects Versions: 2.1.0
>         Environment: Fedora 25 Linux on x86-64
>            Reporter: Demi Marie Obenour
>
> netlib-java is, by the author's own admission, [hard to build with native BLAS and LAPACK support|https://github.com/fommil/netlib-java/issues/83#issuecomment-114014185].  For licensing reasons, Spark cannot build with native BLAS and LAPACK support by default.  This means that MLlib is very slow.
> A better solution would be to fork netlib-java (and make it easier to build) or to create an alternative that is easier to build.  Ideally, the native component should be as easy to build as {{./configure && make && make install}}, and the Java component should be a standard Maven build.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org