Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.5.1, 4.0.0
Description
PySpark references some code which was removed with NumPy 2.0.
python/pyspark/pandas/strings.py:
- np.NaN was removed, should be replaced with np.nan
python/pyspark/pandas/typedef/typehints.py
- np.string_ was removed, is an alias for np.bytes_
- np.float_ was removed, is defined the same as np.double
- np.unicode_ was removed, is an alias for np.str_
Attachments
Issue Links
- is related to
-
SPARK-49882 Handle or document `NumPy 2.1` difference in Python 3.13
-
- Resolved
-
- links to