You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:37:55 UTC
[jira] [Resolved] (SPARK-12067) Fix usage of isnan, isnull,
isnotnull of Column
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-12067.
----------------------------------
Resolution: Incomplete
> Fix usage of isnan, isnull, isnotnull of Column
> -----------------------------------------------
>
> Key: SPARK-12067
> URL: https://issues.apache.org/jira/browse/SPARK-12067
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Yanbo Liang
> Priority: Major
> Labels: bulk-closed
>
> * -SPARK-11947 has deprecated DataFrame.isNaN, DataFrame.isNull and replaced by DataFrame.isnan, DataFrame.isnull, this PR changed Column.isNaN to Column.isnan, Column.isNull to Column.isnull, Column.isNotNull to Column.isnotnull.-
> * -Add Column.notnull as alias of Column.isnotnull following the pandas naming convention.-
> * -Add DataFrame.isnotnull and DataFrame.notnull.-
> * Add Column.isNaN to PySpark.
> * Add isnull, notnull, isnan as alias at Python side in order to be compatible with pandas.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org