You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yan Facai (颜发才 JIRA)" <ji...@apache.org> on 2017/07/07 05:21:00 UTC
[jira] [Commented] (SPARK-21331) java.lang.NullPointerException for
certain methods in classes of MLlib
[ https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077605#comment-16077605 ]
Yan Facai (颜发才) commented on SPARK-21331:
-----------------------------------------
Hi, I run the code in description on mac, spark-2.1.1. It works out successfully without any exception.
{block}
scala> val svd: SingularValueDecomposition[RowMatrix, Matrix] = mat.computeSVD(2, computeU = true)
17/07/07 13:17:12 WARN netlib.BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS
17/07/07 13:17:12 WARN netlib.BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeRefBLAS
17/07/07 13:17:12 WARN netlib.LAPACK: Failed to load implementation from: com.github.fommil.netlib.NativeSystemLAPACK
17/07/07 13:17:12 WARN netlib.LAPACK: Failed to load implementation from: com.github.fommil.netlib.NativeRefLAPACK
svd: org.apache.spark.mllib.linalg.SingularValueDecomposition[org.apache.spark.mllib.linalg.distributed.RowMatrix,org.apache.spark.mllib.linalg.Matrix] =
SingularValueDecomposition(org.apache.spark.mllib.linalg.distributed.RowMatrix@5a4f7911,[13.029275535600473,5.368578733451684],-0.31278534337232633 0.3116713569157832
-0.029801450130953977 -0.17133211263608739
-0.12207248163673157 0.15256470925290191
-0.7184789931874109 -0.6809628499946365
-0.6084105917199364 0.6217072292290715 )
{block}
> java.lang.NullPointerException for certain methods in classes of MLlib
> ----------------------------------------------------------------------
>
> Key: SPARK-21331
> URL: https://issues.apache.org/jira/browse/SPARK-21331
> Project: Spark
> Issue Type: Bug
> Components: Build, MLlib
> Affects Versions: 2.1.0
> Environment: Spark running locally on OSX at spark://127.0.0.1:7077.
> Reporter: Anirban Das
>
> I am trying to run the following code using sbt package and sbt run. I am getting a runtime error that seems to be a bug since the same code works great on spark-shell with Scala. The error occurs when executing the computeSVD line. If this line is commented out, the program works fine. I am having similar issues for other methods for classes in MLlib as well. This looks like a bug to me.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org