Re: [Streams] TimeWindows ignores gracePeriodMs in windowsFor(timestamp)

[Jose Lopez <jo...@gmail.com>]

Hi John,

Thank you for your reply. Indeed, your explanation makes sense to me. Thank
you again for taking the time to reply.

Regards,
Jose

On Tue, 30 Apr 2019 at 22:22, John Roesler <jo...@confluent.io> wrote:

> Hi Ashok,
>
> I think some people may be able to give you advice, but please start a new
> thread instead of replying to an existing message. This just helps keep all
> the messages organized.
>
> Thanks!
> -John
>
> On Thu, Apr 25, 2019 at 6:12 AM ASHOK MACHERLA <iA...@outlook.com>
> wrote:
>
> > Hii,
> >
> > what I asking
> >
> > I want to know about kafka partitions
> >
> >
> > we have getting data about 200GB+ from sources to kafka for daily .
> >
> > I need to know how many partitions are required to pull data from source
> > without pileup.
> >
> > please suggest us to fix this issue.
> >
> > is there any mathematical rules to create specific no.of partitions for
> > Topic.???
> >
> >
> > please help me....
> >
> > Sent from Outlook<http://aka.ms/weboutlook>
> > ________________________________
> > From: Jose Lopez <jo...@gmail.com>
> > Sent: 25 April 2019 16:34
> > To: users@kafka.apache.org
> > Subject: [Streams] TimeWindows ignores gracePeriodMs in
> > windowsFor(timestamp)
> >
> > Hi all,
> >
> > Given that gradePeriodMs is "the time to admit late-arriving events after
> > the end of the window", I'd expect it is taken into account in
> > windowsFor(timestamp). E.g.:
> >
> > sizeMs = 5
> > gracePeriodMs = 2
> > advanceMs = 3
> > timestamp = 6
> >
> > | window | windowStart | windowEnd | windowsEnd + gracePeriod |
> > | 1           | 0                   | 5                 | 7
> >                            |
> > | 2           | 5                   | 10               | 12
> >                          |
> > ...
> >
> > Current output:
> > windowsFor(timestamp) returns window 2 only.
> >
> > Expected output:
> > windowsFor(timestamp) returns both window 1 and window 2
> >
> > Do you agree with the expected output? Am I missing something?
> >
> > Regards,
> > Jose
> >
>