You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/22 14:57:48 UTC

[GitHub] [beam] damccorm opened a new issue, #21995: Timers with same family ids in same stage (but different transforms) are buffered together

damccorm opened a new issue, #21995:
URL: https://github.com/apache/beam/issues/21995

   The following test case does not work properly:
   
    
   ```
   
   def test_dynamic_timer_clear_then_set_timer(self):
   
     class EmitTwoEvents(DoFn):
       EMIT_CLEAR_SET_TIMER
   = TimerSpec('emitclear', TimeDomain.WATERMARK)
   
       def process(self, element, emit=DoFn.TimerParam(EMIT_CLEAR_SET_TIMER)):
   
        yield ('1', 'set')
         emit.set(1)
   
       @on_timer(EMIT_CLEAR_SET_TIMER)
       def emit_clear(self):
   
        yield ('1', 'clear')
   
     class DynamicTimerDoFn(DoFn):
       EMIT_TIMER_FAMILY = TimerSpec('emit',
   TimeDomain.WATERMARK)
   
       def process(self, element, emit=DoFn.TimerParam(EMIT_TIMER_FAMILY)):
   
        if element[1] == 'set':
           emit.set(10, dynamic_timer_tag='emit1')
           emit.set(20,
   dynamic_timer_tag='emit2')
         if element[1] == 'clear':
           emit.set(30, dynamic_timer_tag='emit3')
   
          emit.clear(dynamic_timer_tag='emit3')
           emit.set(40, dynamic_timer_tag='emit3')
       
    return []
   
       @on_timer(EMIT_TIMER_FAMILY)
       def emit_callback(
           self, ts=DoFn.TimestampParam,
   tag=DoFn.DynamicTimerTagParam):
         yield (tag, ts)
   
     with TestPipeline() as p:
       res = (
   
          p
           | beam.Create([('1', 'impulse')])
           | beam.ParDo(EmitTwoEvents())
          
   | beam.ParDo(DynamicTimerDoFn()))
       assert_that(res, equal_to([('emit1', 10), ('emit2', 20), ('emit3',
   40)]) 
   ```
   
   
   Imported from Jira [BEAM-14127](https://issues.apache.org/jira/browse/BEAM-14127). Original Jira may contain additional context.
   Reported by: pabloem.
   Subtask of issue #21987


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] github-actions[bot] closed issue #21995: Timers with same family ids in same stage (but different transforms) are buffered together

Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #21995: Timers with same family ids in same stage (but different transforms) are buffered together
URL: https://github.com/apache/beam/issues/21995


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org