[jira] [Created] (STORM-1873) Reemit late tuples in windowed mode

["Balazs Kossovics (JIRA)" <ji...@apache.org>]

Balazs Kossovics created STORM-1873:
---------------------------------------

             Summary: Reemit late tuples in windowed mode
                 Key: STORM-1873
                 URL: https://issues.apache.org/jira/browse/STORM-1873
             Project: Apache Storm
          Issue Type: Improvement
          Components: storm-core
            Reporter: Balazs Kossovics


Currently late tuples are just logged (and acknowledged in the coming 1.0.2), but in our  use-case it would be desirable to emit them on a different stream than the default.

I implemented a first version, where every windowed bolt are going to have a '_late' stream by default, and component-specific parameter (Config.TOPOLOGY_BOLTS_EMIT_LATE_TUPLE) the definer of the bolt could turn on or off the emission of the late tuples on this stream. 

One could turn on the emission of late tuples with a builder method like this:

                new MyWindowedBolt()
                        .withTimestampField("timestamp")
                        .withLateTupleEmission(true)
                        .withWindow(
                                new BaseWindowedBolt.Duration(1, TimeUnit.MINUTES),
                                new BaseWindowedBolt.Duration(1, TimeUnit.SECONDS)
                        );

What do you think about it?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)