You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 15:32:00 UTC
[jira] [Commented] (SPARK-24740) PySpark tests do not pass with
NumPy 0.14.x+
[ https://issues.apache.org/jira/browse/SPARK-24740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532884#comment-16532884 ]
Hyukjin Kwon commented on SPARK-24740:
--------------------------------------
I am working on this
> PySpark tests do not pass with NumPy 0.14.x+
> --------------------------------------------
>
> Key: SPARK-24740
> URL: https://issues.apache.org/jira/browse/SPARK-24740
> Project: Spark
> Issue Type: Test
> Components: ML, PySpark
> Affects Versions: 2.4.0
> Reporter: Hyukjin Kwon
> Assignee: Hyukjin Kwon
> Priority: Minor
>
> For example, running PySpark tests failed as below:
> {code}
> **********************************************************************
> File "/.../spark/python/pyspark/ml/clustering.py", line 592, in __main__.BisectingKMeans
> Failed example:
> model.clusterCenters()[0] == model2.clusterCenters()[0]
> Expected:
> array([ True, True], dtype=bool)
> Got:
> array([ True, True])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/clustering.py", line 594, in __main__.BisectingKMeans
> Failed example:
> model.clusterCenters()[1] == model2.clusterCenters()[1]
> Expected:
> array([ True, True], dtype=bool)
> Got:
> array([ True, True])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/clustering.py", line 392, in __main__.KMeans
> Failed example:
> model.clusterCenters()[0] == model2.clusterCenters()[0]
> Expected:
> array([ True, True], dtype=bool)
> Got:
> array([ True, True])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/clustering.py", line 394, in __main__.KMeans
> Failed example:
> model.clusterCenters()[1] == model2.clusterCenters()[1]
> Expected:
> array([ True, True], dtype=bool)
> Got:
> array([ True, True])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 895, in __main__.DenseMatrix.__str__
> Failed example:
> print(dm)
> Expected:
> DenseMatrix([[ 0., 2.],
> [ 1., 3.]])
> Got:
> DenseMatrix([[0., 2.],
> [1., 3.]])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 899, in __main__.DenseMatrix.__str__
> Failed example:
> print(dm)
> Expected:
> DenseMatrix([[ 0., 1.],
> [ 2., 3.]])
> Got:
> DenseMatrix([[0., 1.],
> [2., 3.]])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 939, in __main__.DenseMatrix.toArray
> Failed example:
> m.toArray()
> Expected:
> array([[ 0., 2.],
> [ 1., 3.]])
> Got:
> array([[0., 2.],
> [1., 3.]])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 324, in __main__.DenseVector.dot
> Failed example:
> dense.dot(np.reshape([1., 2., 3., 4.], (2, 2), order='F'))
> Expected:
> array([ 5., 11.])
> Got:
> array([ 5., 11.])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 567, in __main__.SparseVector.dot
> Failed example:
> a.dot(np.array([[1, 1], [2, 2], [3, 3], [4, 4]]))
> Expected:
> array([ 22., 22.])
> Got:
> array([22., 22.])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 895, in __main__.DenseMatrix.__str__
> Failed example:
> print(dm)
> Expected:
> DenseMatrix([[ 0., 2.],
> [ 1., 3.]])
> Got:
> DenseMatrix([[0., 2.],
> [1., 3.]])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 899, in __main__.DenseMatrix.__str__
> Failed example:
> print(dm)
> Expected:
> DenseMatrix([[ 0., 1.],
> [ 2., 3.]])
> Got:
> DenseMatrix([[0., 1.],
> [2., 3.]])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 939, in __main__.DenseMatrix.toArray
> Failed example:
> m.toArray()
> Expected:
> array([[ 0., 2.],
> [ 1., 3.]])
> Got:
> array([[0., 2.],
> [1., 3.]])
> **********************************************************************
> File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 567, in __main__.SparseVector.dot
> Failed example:
> a.dot(np.array([[1, 1], [2, 2], [3, 3], [4, 4]]))
> Expected:
> array([ 22., 22.])
> Got:
> array([22., 22.])
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org