You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 15:31:00 UTC

[jira] [Created] (SPARK-24740) PySpark tests do not pass with NumPy 0.14.x+

Hyukjin Kwon created SPARK-24740:
------------------------------------

             Summary: PySpark tests do not pass with NumPy 0.14.x+
                 Key: SPARK-24740
                 URL: https://issues.apache.org/jira/browse/SPARK-24740
             Project: Spark
          Issue Type: Test
          Components: ML, PySpark
    Affects Versions: 2.4.0
            Reporter: Hyukjin Kwon
            Assignee: Hyukjin Kwon


For example, running PySpark tests failed as below:

{code}
**********************************************************************
File "/.../spark/python/pyspark/ml/clustering.py", line 592, in __main__.BisectingKMeans
Failed example:
    model.clusterCenters()[0] == model2.clusterCenters()[0]
Expected:
    array([ True,  True], dtype=bool)
Got:
    array([ True,  True])
**********************************************************************
File "/.../spark/python/pyspark/ml/clustering.py", line 594, in __main__.BisectingKMeans
Failed example:
    model.clusterCenters()[1] == model2.clusterCenters()[1]
Expected:
    array([ True,  True], dtype=bool)
Got:
    array([ True,  True])
**********************************************************************
File "/.../spark/python/pyspark/ml/clustering.py", line 392, in __main__.KMeans
Failed example:
    model.clusterCenters()[0] == model2.clusterCenters()[0]
Expected:
    array([ True,  True], dtype=bool)
Got:
    array([ True,  True])
**********************************************************************
File "/.../spark/python/pyspark/ml/clustering.py", line 394, in __main__.KMeans
Failed example:
    model.clusterCenters()[1] == model2.clusterCenters()[1]
Expected:
    array([ True,  True], dtype=bool)
Got:
    array([ True,  True])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 895, in __main__.DenseMatrix.__str__
Failed example:
    print(dm)
Expected:
    DenseMatrix([[ 0.,  2.],
                 [ 1.,  3.]])
Got:
    DenseMatrix([[0., 2.],
                 [1., 3.]])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 899, in __main__.DenseMatrix.__str__
Failed example:
    print(dm)
Expected:
    DenseMatrix([[ 0.,  1.],
                 [ 2.,  3.]])
Got:
    DenseMatrix([[0., 1.],
                 [2., 3.]])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 939, in __main__.DenseMatrix.toArray
Failed example:
    m.toArray()
Expected:
    array([[ 0.,  2.],
           [ 1.,  3.]])
Got:
    array([[0., 2.],
           [1., 3.]])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 324, in __main__.DenseVector.dot
Failed example:
    dense.dot(np.reshape([1., 2., 3., 4.], (2, 2), order='F'))
Expected:
    array([  5.,  11.])
Got:
    array([ 5., 11.])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 567, in __main__.SparseVector.dot
Failed example:
    a.dot(np.array([[1, 1], [2, 2], [3, 3], [4, 4]]))
Expected:
    array([ 22.,  22.])
Got:
    array([22., 22.])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 895, in __main__.DenseMatrix.__str__
Failed example:
    print(dm)
Expected:
    DenseMatrix([[ 0.,  2.],
                 [ 1.,  3.]])
Got:
    DenseMatrix([[0., 2.],
                 [1., 3.]])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 899, in __main__.DenseMatrix.__str__
Failed example:
    print(dm)
Expected:
    DenseMatrix([[ 0.,  1.],
                 [ 2.,  3.]])
Got:
    DenseMatrix([[0., 1.],
                 [2., 3.]])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 939, in __main__.DenseMatrix.toArray
Failed example:
    m.toArray()
Expected:
    array([[ 0.,  2.],
           [ 1.,  3.]])
Got:
    array([[0., 2.],
           [1., 3.]])
**********************************************************************
File "/.../spark/python/pyspark/ml/linalg/__init__.py", line 567, in __main__.SparseVector.dot
Failed example:
    a.dot(np.array([[1, 1], [2, 2], [3, 3], [4, 4]]))
Expected:
    array([ 22.,  22.])
Got:
    array([22., 22.])
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org