You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Rui Tang <ta...@gmail.com> on 2017/07/12 13:57:38 UTC
Question about Window
According to the windowing (
http://samza.apache.org/learn/documentation/0.13/container/windowing.html)
documentation, I know that I can specify a fixed duration window, like
8640000ms (one day). That means if the window starts at 9:00 AM, then it
will end at 9:00 AM the next day.
But I need a kind of window that overlaps some calendar day, that means
whenever the window starts, it will end at the end of the day. How can I do
this using Samza windowing system? Do I need to create my own window and
trigger implementation?
Thank you!
Re: Question about Window
Posted by Jagadish Venkatraman <ja...@gmail.com>.
You can find the feature preview here:
https://samza.apache.org/startup/preview/
Please let us know if you had further questions!
- Jag
On Wed, Jul 12, 2017 at 7:06 PM Rui Tang <ta...@gmail.com> wrote:
> Thank you Jagadish.
>
> It is a very simple workaround.
>
> Looking forward for the high level api to support windowing and triggers.
>
> On Thu, Jul 13, 2017 at 1:33 AM Jagadish Venkatraman <
> jagadish1989@gmail.com>
> wrote:
>
> > Hi Rui,
> >
> > Are you using the low-level API or the high-level API? The high-level
> API (
> > *StreamApplication*) that offers built-in support for windows/triggers is
> > currently in preview stage, and we are working to make it production
> ready
> > with the next release.
> >
> > It looks like you are referring to the low-level *WindowableTask* API. In
> > this API, you are guaranteed a periodic callback after every
> > *windowMs* milliseconds.
> > It should be possible (with minimal effort) to implement Calendar
> windowing
> > on top of this - you can set a low value for *task.window.ms
> > <http://task.window.ms> *and periodically evaluate inside *window *if
> > results should be emitted based on Calendar time.
> >
> > Please do let us know if you had further questions.
> >
> > Best,
> > Jagadish
> >
> >
> >
> > On Wed, Jul 12, 2017 at 6:57 AM, Rui Tang <ta...@gmail.com> wrote:
> >
> > > According to the windowing (
> > >
> >
> http://samza.apache.org/learn/documentation/0.13/container/windowing.html)
> > > documentation, I know that I can specify a fixed duration window, like
> > > 8640000ms (one day). That means if the window starts at 9:00 AM, then
> it
> > > will end at 9:00 AM the next day.
> > >
> > > But I need a kind of window that overlaps some calendar day, that means
> > > whenever the window starts, it will end at the end of the day. How can
> I
> > do
> > > this using Samza windowing system? Do I need to create my own window
> and
> > > trigger implementation?
> > >
> > > Thank you!
> > >
> >
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
> >
>
--
Sent from my iphone.
Re: Question about Window
Posted by Rui Tang <ta...@gmail.com>.
Thank you Jagadish.
It is a very simple workaround.
Looking forward for the high level api to support windowing and triggers.
On Thu, Jul 13, 2017 at 1:33 AM Jagadish Venkatraman <ja...@gmail.com>
wrote:
> Hi Rui,
>
> Are you using the low-level API or the high-level API? The high-level API (
> *StreamApplication*) that offers built-in support for windows/triggers is
> currently in preview stage, and we are working to make it production ready
> with the next release.
>
> It looks like you are referring to the low-level *WindowableTask* API. In
> this API, you are guaranteed a periodic callback after every
> *windowMs* milliseconds.
> It should be possible (with minimal effort) to implement Calendar windowing
> on top of this - you can set a low value for *task.window.ms
> <http://task.window.ms> *and periodically evaluate inside *window *if
> results should be emitted based on Calendar time.
>
> Please do let us know if you had further questions.
>
> Best,
> Jagadish
>
>
>
> On Wed, Jul 12, 2017 at 6:57 AM, Rui Tang <ta...@gmail.com> wrote:
>
> > According to the windowing (
> >
> http://samza.apache.org/learn/documentation/0.13/container/windowing.html)
> > documentation, I know that I can specify a fixed duration window, like
> > 8640000ms (one day). That means if the window starts at 9:00 AM, then it
> > will end at 9:00 AM the next day.
> >
> > But I need a kind of window that overlaps some calendar day, that means
> > whenever the window starts, it will end at the end of the day. How can I
> do
> > this using Samza windowing system? Do I need to create my own window and
> > trigger implementation?
> >
> > Thank you!
> >
>
>
>
> --
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University
>
Re: Question about Window
Posted by Jagadish Venkatraman <ja...@gmail.com>.
Hi Rui,
Are you using the low-level API or the high-level API? The high-level API (
*StreamApplication*) that offers built-in support for windows/triggers is
currently in preview stage, and we are working to make it production ready
with the next release.
It looks like you are referring to the low-level *WindowableTask* API. In
this API, you are guaranteed a periodic callback after every
*windowMs* milliseconds.
It should be possible (with minimal effort) to implement Calendar windowing
on top of this - you can set a low value for *task.window.ms
<http://task.window.ms> *and periodically evaluate inside *window *if
results should be emitted based on Calendar time.
Please do let us know if you had further questions.
Best,
Jagadish
On Wed, Jul 12, 2017 at 6:57 AM, Rui Tang <ta...@gmail.com> wrote:
> According to the windowing (
> http://samza.apache.org/learn/documentation/0.13/container/windowing.html)
> documentation, I know that I can specify a fixed duration window, like
> 8640000ms (one day). That means if the window starts at 9:00 AM, then it
> will end at 9:00 AM the next day.
>
> But I need a kind of window that overlaps some calendar day, that means
> whenever the window starts, it will end at the end of the day. How can I do
> this using Samza windowing system? Do I need to create my own window and
> trigger implementation?
>
> Thank you!
>
--
Jagadish V,
Graduate Student,
Department of Computer Science,
Stanford University