You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/08/01 18:36:20 UTC

[jira] [Assigned] (SPARK-16837) TimeWindow incorrectly drops slideDuration in constructors

     [ https://issues.apache.org/jira/browse/SPARK-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-16837:
------------------------------------

    Assignee: Apache Spark

> TimeWindow incorrectly drops slideDuration in constructors
> ----------------------------------------------------------
>
>                 Key: SPARK-16837
>                 URL: https://issues.apache.org/jira/browse/SPARK-16837
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Tom Magrino
>            Assignee: Apache Spark
>
> Right now, the constructors for the TimeWindow expression in Catalyst incorrectly uses the windowDuration in place of the slideDuration.  This will cause incorrect windowing semantics the after time window expressions are analyzed by Catalyst.
> Relevant code is here: https://github.com/apache/spark/blob/branch-2.0/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala#L29-L54



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org