You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Balazs Kossovics (JIRA)" <ji...@apache.org> on 2016/05/31 12:35:12 UTC
[jira] [Updated] (STORM-1873) Reemit late tuples in windowed mode
[ https://issues.apache.org/jira/browse/STORM-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Balazs Kossovics updated STORM-1873:
------------------------------------
Description:
Currently late tuples are just logged (and acknowledged in the coming 1.0.2), but in our use-case it would be desirable to emit them on a different stream than the default.
I implemented a first version, where every windowed bolt are going to have a '_late' stream by default, and component-specific parameter (Config.TOPOLOGY_BOLTS_EMIT_LATE_TUPLE) the definer of the bolt could turn on or off the emission of the late tuples on this stream.
One could turn on the emission of late tuples with a builder method like this:
{code:title=MyWindowedBolt.java|borderStyle=solid}
new MyWindowedBolt()
.withTimestampField("timestamp")
.withLateTupleEmission(true)
.withWindow(
new BaseWindowedBolt.Duration(1, TimeUnit.MINUTES),
new BaseWindowedBolt.Duration(1, TimeUnit.SECONDS)
);
{code}
What do you think about it?
was:
Currently late tuples are just logged (and acknowledged in the coming 1.0.2), but in our use-case it would be desirable to emit them on a different stream than the default.
I implemented a first version, where every windowed bolt are going to have a '_late' stream by default, and component-specific parameter (Config.TOPOLOGY_BOLTS_EMIT_LATE_TUPLE) the definer of the bolt could turn on or off the emission of the late tuples on this stream.
One could turn on the emission of late tuples with a builder method like this:
new MyWindowedBolt()
.withTimestampField("timestamp")
.withLateTupleEmission(true)
.withWindow(
new BaseWindowedBolt.Duration(1, TimeUnit.MINUTES),
new BaseWindowedBolt.Duration(1, TimeUnit.SECONDS)
);
What do you think about it?
> Reemit late tuples in windowed mode
> -----------------------------------
>
> Key: STORM-1873
> URL: https://issues.apache.org/jira/browse/STORM-1873
> Project: Apache Storm
> Issue Type: Improvement
> Components: storm-core
> Reporter: Balazs Kossovics
>
> Currently late tuples are just logged (and acknowledged in the coming 1.0.2), but in our use-case it would be desirable to emit them on a different stream than the default.
> I implemented a first version, where every windowed bolt are going to have a '_late' stream by default, and component-specific parameter (Config.TOPOLOGY_BOLTS_EMIT_LATE_TUPLE) the definer of the bolt could turn on or off the emission of the late tuples on this stream.
> One could turn on the emission of late tuples with a builder method like this:
> {code:title=MyWindowedBolt.java|borderStyle=solid}
> new MyWindowedBolt()
> .withTimestampField("timestamp")
> .withLateTupleEmission(true)
> .withWindow(
> new BaseWindowedBolt.Duration(1, TimeUnit.MINUTES),
> new BaseWindowedBolt.Duration(1, TimeUnit.SECONDS)
> );
> {code}
> What do you think about it?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)