[jira] [Created] (SPARK-48710) Incompatibilities with NumPy 2.0

["Patrick Marx (Jira)" <ji...@apache.org>]

Patrick Marx created SPARK-48710:
------------------------------------

             Summary: Incompatibilities with NumPy 2.0
                 Key: SPARK-48710
                 URL: https://issues.apache.org/jira/browse/SPARK-48710
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 4.0.0
            Reporter: Patrick Marx


PySpark references some code which was removed with NumPy 2.0.

 {{python/pyspark/pandas/strings.py}}:
 * {{np.NaN}} was removed, should be replaced with {{np.nan}}

{{python/pyspark/pandas/typedef/typehints.py}}
 * {{np.string_}} was removed, [is an alias for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3134] {{np.bytes_}}
 * {{np.float_}} was removed, [is defined the same as|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3042-3043] {{np.double}}
 * {{np.unicode_}} was removed, [is an alias for|https://github.com/numpy/numpy/blob/v1.26.5/numpy/__init__.pyi#L3148] {{np.str_}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org