You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Anton Kedin (JIRA)" <ji...@apache.org> on 2017/12/20 21:48:00 UTC

[jira] [Assigned] (BEAM-3360) [SQL] Do not assign triggers for HOP/TUMBLE

     [ https://issues.apache.org/jira/browse/BEAM-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anton Kedin reassigned BEAM-3360:
---------------------------------

    Assignee: Anton Kedin

> [SQL] Do not assign triggers for HOP/TUMBLE
> -------------------------------------------
>
>                 Key: BEAM-3360
>                 URL: https://issues.apache.org/jira/browse/BEAM-3360
>             Project: Beam
>          Issue Type: Task
>          Components: dsl-sql
>            Reporter: Anton Kedin
>            Assignee: Anton Kedin
>
> Currently when parsing HOP/TUMBLE/SESSION expressions we create a repeating trigger for the defined windows, see:
> {code:java|title=BeamAggregationRule.java}
>   private Trigger createTriggerWithDelay(GregorianCalendar delayTime) {
>     return Repeatedly.forever(AfterWatermark.pastEndOfWindow().withLateFirings(AfterProcessingTime
>         .pastFirstElementInPane().plusDelayOf(Duration.millis(delayTime.getTimeInMillis()))));
>   }
> {code}
> This will not work correctly with joins, as joins with multiple trigger firings are currently broken: https://issues.apache.org/jira/browse/BEAM-3190 .
> Even if joins with multiple firings worked correctly, SQL parsing stage is still probably an incorrect place to infer them.
> Better alternatives:
>  - inherit the user-defined triggers for the input pcollection without modification;
>  - triggering at sinks ( https://s.apache.org/beam-sink-triggers ) might define a way to backpropagate triggers with correct semantics;



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)