You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2019/01/07 09:35:00 UTC

[jira] [Created] (SPARK-26559) ML image can't work with numpy versions prior to 1.9

Liang-Chi Hsieh created SPARK-26559:
---------------------------------------

             Summary: ML image can't work with numpy versions prior to 1.9
                 Key: SPARK-26559
                 URL: https://issues.apache.org/jira/browse/SPARK-26559
             Project: Spark
          Issue Type: Bug
          Components: ML, PySpark
    Affects Versions: 3.0.0
            Reporter: Liang-Chi Hsieh


ML image can't work with numpy version prior to 1.9 now.

Current pyspark test can show it:
{code:java}
test_read_images (pyspark.ml.tests.test_image.ImageReaderTest) ... ERROR                                                                              
test_read_images_multiple_times (pyspark.ml.tests.test_image.ImageReaderTest2) ... ok                                                                 
                                                                                                                                                      
======================================================================                                                                                
ERROR: test_read_images (pyspark.ml.tests.test_image.ImageReaderTest)                                                                                 
----------------------------------------------------------------------                                                                                
Traceback (most recent call last):
  File "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/tests/test_image.py", line 36, in test_read_images                                   
    self.assertEqual(ImageSchema.toImage(array, origin=first_row[0]), first_row)                                                                      
  File "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/image.py", line 193, in toImage                                                      
    data = bytearray(array.astype(dtype=np.uint8).ravel().tobytes())                                                                                  
AttributeError: 'numpy.ndarray' object has no attribute 'tobytes'                                                                                     
                                                                                                                                                      
----------------------------------------------------------------------
Ran 2 tests in 29.040s                                                                                                                                
                                                                                                                                                      
FAILED (errors=1)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)