You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2025/06/08 22:58:00 UTC
[jira] [Updated] (SPARK-52419) Make Python Connect tests work with NumPy 2.3.0
[ https://issues.apache.org/jira/browse/SPARK-52419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-52419:
---------------------------------
Description:
{code}
======================================================================
FAIL [0.006s]: test_as_spark_type_pandas_on_spark_dtype (pyspark.pandas.tests.connect.test_parity_typedef.TypeHintParityTests.test_as_spark_type_pandas_on_spark_dtype)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/opt/hostedtoolcache/Python/3.11.12/x64/lib/python3.11/site-packages/pyspark/pandas/tests/test_typedef.py", line 353, in test_as_spark_type_pandas_on_spark_dtype
self.assertEqual(pandas_on_spark_type(numpy_or_python_type), (dtype, spark_type))
AssertionError: Tuples differ: (dtype('O'), BinaryType()) != (<class 'numpy.character'>, BinaryType())
First differing element 0:
dtype('O')
<class 'numpy.character'>
- (dtype('O'), BinaryType())
+ (<class 'numpy.character'>, BinaryType())
{code}
> Make Python Connect tests work with NumPy 2.3.0
> -----------------------------------------------
>
> Key: SPARK-52419
> URL: https://issues.apache.org/jira/browse/SPARK-52419
> Project: Spark
> Issue Type: Test
> Components: PySpark, Tests
> Affects Versions: 4.1.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> {code}
> ======================================================================
> FAIL [0.006s]: test_as_spark_type_pandas_on_spark_dtype (pyspark.pandas.tests.connect.test_parity_typedef.TypeHintParityTests.test_as_spark_type_pandas_on_spark_dtype)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/opt/hostedtoolcache/Python/3.11.12/x64/lib/python3.11/site-packages/pyspark/pandas/tests/test_typedef.py", line 353, in test_as_spark_type_pandas_on_spark_dtype
> self.assertEqual(pandas_on_spark_type(numpy_or_python_type), (dtype, spark_type))
> AssertionError: Tuples differ: (dtype('O'), BinaryType()) != (<class 'numpy.character'>, BinaryType())
> First differing element 0:
> dtype('O')
> <class 'numpy.character'>
> - (dtype('O'), BinaryType())
> + (<class 'numpy.character'>, BinaryType())
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org