You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "wangkui (JIRA)" <ji...@apache.org> on 2017/04/24 03:24:04 UTC
[jira] [Updated] (STORM-2489) Overlap and data loss on WindowedBolt
based on Duration
[ https://issues.apache.org/jira/browse/STORM-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
wangkui updated STORM-2489:
---------------------------
Description:
The attachment is my test script, one of my test results is:
```
expired=1...55
get=56...4024
new=56...4024
Recived=3969,RecivedTotal=3969
expired=56...4020
get=4021...8191
new=4025...8191
Recived=4171,RecivedTotal=8140
SendTotal=12175
expired=4021...8188
get=8189...12175
new=8192...12175
Recived=3987,RecivedTotal=12127
```
This test result shows that some tuples appear in the expired list directly, we lost these data if we just use get() to get tuples, this is the first bug.
The second: the tuples of get() has overlap, the getNew() seems alright.
The problem not happen definitely, may need to try several times.
To be honest, I'm newbie about storm, so I'm not sure this is a bug indeed, or, I use it in wrong way?
was:
The attachment is my test script, one of my test results is:
```
expired=1...55
get=56...4024
new=56...4024
Recived=3969,RecivedTotal=3969
expired=56...4020
get=4021...8191
new=4025...8191
Recived=4171,RecivedTotal=8140
SendTotal=12175
expired=4021...8188
get=8189...12175
new=8192...12175
Recived=3987,RecivedTotal=12127
```
This test result shows that some tuples appear in the expired list directly, we lost these data if we just use get() to get tuples, this is the first bug.
The second: the tuples of get() has overlap, the getNew() seems alright.
The problem not happen definitely, may need to try several times.
> Overlap and data loss on WindowedBolt based on Duration
> -------------------------------------------------------
>
> Key: STORM-2489
> URL: https://issues.apache.org/jira/browse/STORM-2489
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-core
> Affects Versions: 1.0.2
> Environment: windows 10, eclipse, jdk1.7
> Reporter: wangkui
> Attachments: TumblingWindowIssue.java
>
>
> The attachment is my test script, one of my test results is:
> ```
> expired=1...55
> get=56...4024
> new=56...4024
> Recived=3969,RecivedTotal=3969
> expired=56...4020
> get=4021...8191
> new=4025...8191
> Recived=4171,RecivedTotal=8140
> SendTotal=12175
> expired=4021...8188
> get=8189...12175
> new=8192...12175
> Recived=3987,RecivedTotal=12127
> ```
> This test result shows that some tuples appear in the expired list directly, we lost these data if we just use get() to get tuples, this is the first bug.
> The second: the tuples of get() has overlap, the getNew() seems alright.
> The problem not happen definitely, may need to try several times.
> To be honest, I'm newbie about storm, so I'm not sure this is a bug indeed, or, I use it in wrong way?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)