You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/05/28 21:17:00 UTC
[jira] [Updated] (SPARK-35341) Introduce BooleanExtensionOps
[ https://issues.apache.org/jira/browse/SPARK-35341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xinrong Meng updated SPARK-35341:
---------------------------------
Description:
{{Now ___and____, __or____,_ ___rand____, and __ror___ are not data type based.}}
So we would like to introduce these operators for Boolean spark type IndexOps.
These bitwise operators should be able to apply to other data types classes. However, this is not the goal of this PR.
extension_dtypes process these operators differently from the rest of the types, so BooleanExtensionOps is introduced.
was:
{{Now ___and____, __or____,_ ___rand____, and __ror___ are not data type based.}}
So we would like to introduce these operators to the DataTypeOps class.
extension_dtypes process these operators differently from the rest of the types.
So we would also introduce ExtentionDtypeOps.
ExtentionDtypeOps would be helpful for other data-type-based operations, for example, to/from pandas conversion as well.
Summary: Introduce BooleanExtensionOps (was: Introduce ExtentionDtypeOps)
> Introduce BooleanExtensionOps
> -----------------------------
>
> Key: SPARK-35341
> URL: https://issues.apache.org/jira/browse/SPARK-35341
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 3.2.0
> Reporter: Xinrong Meng
> Priority: Major
>
> {{Now ___and____, __or____,_ ___rand____, and __ror___ are not data type based.}}
> So we would like to introduce these operators for Boolean spark type IndexOps.
> These bitwise operators should be able to apply to other data types classes. However, this is not the goal of this PR.
> extension_dtypes process these operators differently from the rest of the types, so BooleanExtensionOps is introduced.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org