You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ue...@apache.org on 2021/05/20 02:47:36 UTC
[spark] branch master updated (7eaabf4 -> a970f85)
This is an automated email from the ASF dual-hosted git repository.
ueshin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 7eaabf4 [SPARK-35408][PYTHON][FOLLOW-UP] Avoid unnecessary f-string format
add a970f85 [SPARK-35338][PYTHON] Separate arithmetic operations into data type based structures
No new revisions were added by this update.
Summary of changes:
dev/sparktestsupport/modules.py | 6 +
python/pyspark/pandas/base.py | 268 ++-------------
.../tests => pandas/data_type_ops}/__init__.py | 0
python/pyspark/pandas/data_type_ops/base.py | 120 +++++++
python/pyspark/pandas/data_type_ops/boolean_ops.py | 28 ++
.../pandas/data_type_ops/categorical_ops.py | 28 ++
python/pyspark/pandas/data_type_ops/date_ops.py | 71 ++++
.../pyspark/pandas/data_type_ops/datetime_ops.py | 72 ++++
python/pyspark/pandas/data_type_ops/num_ops.py | 378 +++++++++++++++++++++
python/pyspark/pandas/data_type_ops/string_ops.py | 104 ++++++
.../tests/data_type_ops}/__init__.py | 0
.../pandas/tests/data_type_ops/test_boolean_ops.py | 150 ++++++++
.../tests/data_type_ops/test_categorical_ops.py | 128 +++++++
.../pandas/tests/data_type_ops/test_date_ops.py | 158 +++++++++
.../tests/data_type_ops/test_datetime_ops.py | 160 +++++++++
.../pandas/tests/data_type_ops/test_num_ops.py | 195 +++++++++++
.../pandas/tests/data_type_ops/test_string_ops.py | 140 ++++++++
.../pandas/tests/data_type_ops/testing_utils.py | 75 ++++
.../pyspark/pandas/tests/indexes/test_datetime.py | 10 +-
python/pyspark/pandas/tests/test_dataframe.py | 4 +-
.../pyspark/pandas/tests/test_series_datetime.py | 10 +-
python/pyspark/testing/pandasutils.py | 2 +-
python/setup.py | 1 +
23 files changed, 1849 insertions(+), 259 deletions(-)
copy python/pyspark/{streaming/tests => pandas/data_type_ops}/__init__.py (100%)
create mode 100644 python/pyspark/pandas/data_type_ops/base.py
create mode 100644 python/pyspark/pandas/data_type_ops/boolean_ops.py
create mode 100644 python/pyspark/pandas/data_type_ops/categorical_ops.py
create mode 100644 python/pyspark/pandas/data_type_ops/date_ops.py
create mode 100644 python/pyspark/pandas/data_type_ops/datetime_ops.py
create mode 100644 python/pyspark/pandas/data_type_ops/num_ops.py
create mode 100644 python/pyspark/pandas/data_type_ops/string_ops.py
copy python/pyspark/{streaming/tests => pandas/tests/data_type_ops}/__init__.py (100%)
create mode 100644 python/pyspark/pandas/tests/data_type_ops/test_boolean_ops.py
create mode 100644 python/pyspark/pandas/tests/data_type_ops/test_categorical_ops.py
create mode 100644 python/pyspark/pandas/tests/data_type_ops/test_date_ops.py
create mode 100644 python/pyspark/pandas/tests/data_type_ops/test_datetime_ops.py
create mode 100644 python/pyspark/pandas/tests/data_type_ops/test_num_ops.py
create mode 100644 python/pyspark/pandas/tests/data_type_ops/test_string_ops.py
create mode 100644 python/pyspark/pandas/tests/data_type_ops/testing_utils.py
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org