You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2015/04/21 17:42:58 UTC
[jira] [Commented] (SPARK-6959) Support for datetime comparisions
in filter for dataframes in pyspark
[ https://issues.apache.org/jira/browse/SPARK-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505135#comment-14505135 ]
Liang-Chi Hsieh commented on SPARK-6959:
----------------------------------------
I think this issue is solved by the [PR 5570|https://github.com/apache/spark/pull/5570]?
> Support for datetime comparisions in filter for dataframes in pyspark
> ---------------------------------------------------------------------
>
> Key: SPARK-6959
> URL: https://issues.apache.org/jira/browse/SPARK-6959
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: cynepia
>
> Currently, in filter strings can be passed for comparision with a "date" type column. But this does not address the case where dates may be passed in different formats. We should have support for datetime.date or some standard format for comparision with "date" type columns.
> Currently,
> df.filter(df.Datecol > datetime.date(2015,1,1)).show()
> is not supported.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org