Re: Trident topology: sliding window aggregation?

[Krzysztof Zarzycki <k....@gmail.com>]

I bump the thread as I'm also looking for the answer to this question. If
anyone has any ideas to share, that would be great!

Thanks,
- Zarzyk


2014-07-23 19:30 GMT+02:00 A.M. <co...@yahoo.com>:

> While looking into storm Trident, how could we achieve sliding window
> functions with Trident topology as demoed in Spark Streaking:
>
> *val tagCounts* = *hashTags*.*window*(*Minutes*(10), *Seconds*(*1*
> )).countByValue()
>
> I've read about the regular storm topology using tick tuples to do the
> sliding window. In trident, how could we do the same?
>
> Thanks.
>
> -Costco
>
>

Re: Trident topology: sliding window aggregation?

[Corey Nolet <cj...@gmail.com>]

I've been working on a project to use sliding windows more effectively in
Storm with a similar higher level builder like Trident.

https://github.com/calrissian/flowmix

Unfortunately, it does not directly translate to Trident but it could give
you an idea of what it would take to implement sliding/tumbling windows and
various different things you can do with them.




On Mon, Aug 18, 2014 at 3:15 AM, Krzysztof Zarzycki <k....@gmail.com>
wrote:

> I bump the thread as I'm also looking for the answer to this question. If
> anyone has any ideas to share, that would be great!
>
> Thanks,
> - Zarzyk
>
>
> 2014-07-23 19:30 GMT+02:00 A.M. <co...@yahoo.com>:
>
> While looking into storm Trident, how could we achieve sliding window
>> functions with Trident topology as demoed in Spark Streaking:
>>
>> *val tagCounts* = *hashTags*.*window*(*Minutes*(10), *Seconds*(*1*
>> )).countByValue()
>>
>> I've read about the regular storm topology using tick tuples to do the
>> sliding window. In trident, how could we do the same?
>>
>> Thanks.
>>
>> -Costco
>>
>>
>