You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2019/01/07 09:47:00 UTC
[jira] [Assigned] (SPARK-26559) ML image can't work with numpy
versions prior to 1.9
[ https://issues.apache.org/jira/browse/SPARK-26559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-26559:
------------------------------------
Assignee: Apache Spark
> ML image can't work with numpy versions prior to 1.9
> ----------------------------------------------------
>
> Key: SPARK-26559
> URL: https://issues.apache.org/jira/browse/SPARK-26559
> Project: Spark
> Issue Type: Bug
> Components: ML, PySpark
> Affects Versions: 3.0.0
> Reporter: Liang-Chi Hsieh
> Assignee: Apache Spark
> Priority: Major
>
> ML image can't work with numpy version prior to 1.9 now.
> Current pyspark test can show it:
> {code:java}
> test_read_images (pyspark.ml.tests.test_image.ImageReaderTest) ... ERROR
> test_read_images_multiple_times (pyspark.ml.tests.test_image.ImageReaderTest2) ... ok
>
> ======================================================================
> ERROR: test_read_images (pyspark.ml.tests.test_image.ImageReaderTest)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/tests/test_image.py", line 36, in test_read_images
> self.assertEqual(ImageSchema.toImage(array, origin=first_row[0]), first_row)
> File "/Users/viirya/docker_tmp/repos/spark-1/python/pyspark/ml/image.py", line 193, in toImage
> data = bytearray(array.astype(dtype=np.uint8).ravel().tobytes())
> AttributeError: 'numpy.ndarray' object has no attribute 'tobytes'
>
> ----------------------------------------------------------------------
> Ran 2 tests in 29.040s
>
> FAILED (errors=1)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)