You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2019/01/07 09:35:00 UTC
[jira] [Created] (SPARK-26559) ML image can't work with numpy
versions prior to 1.9
Liang-Chi Hsieh created SPARK-26559:
---------------------------------------
Summary: ML image can't work with numpy versions prior to 1.9
Key: SPARK-26559
URL: https://issues.apache.org/jira/browse/SPARK-26559
Project: Spark
Issue Type: Bug
Components: ML, PySpark
Affects Versions: 3.0.0
Reporter: Liang-Chi Hsieh
ML image can't work with numpy version prior to 1.9 now.
Current pyspark test can show it:
{code:java}
test_read_images (pyspark.ml.tests.test_image.ImageReaderTest) ... ERROR
test_read_images_multiple_times (pyspark.ml.tests.test_image.ImageReaderTest2) ... ok
======================================================================
ERROR: test_read_images (pyspark.ml.tests.test_image.ImageReaderTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/tests/test_image.py", line 36, in test_read_images
self.assertEqual(ImageSchema.toImage(array, origin=first_row[0]), first_row)
File "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/image.py", line 193, in toImage
data = bytearray(array.astype(dtype=np.uint8).ravel().tobytes())
AttributeError: 'numpy.ndarray' object has no attribute 'tobytes'
----------------------------------------------------------------------
Ran 2 tests in 29.040s
FAILED (errors=1)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)