You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tom Magrino (JIRA)" <ji...@apache.org> on 2016/08/01 17:27:20 UTC

[jira] [Created] (SPARK-16837) TimeWindow incorrectly drops slideDuration in constructors

Tom Magrino created SPARK-16837:
-----------------------------------

             Summary: TimeWindow incorrectly drops slideDuration in constructors
                 Key: SPARK-16837
                 URL: https://issues.apache.org/jira/browse/SPARK-16837
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.0
            Reporter: Tom Magrino


Right now, the constructors for the TimeWindow expression in Catalyst incorrectly uses the windowDuration in place of the slideDuration.  This will cause incorrect windowing semantics the after time window expressions are analyzed by Catalyst.

Relevant code is here: https://github.com/apache/spark/blob/branch-2.0/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala#L29-L54



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org