You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by "McCullough, Alex" <Al...@capitalone.com> on 2016/08/25 21:03:52 UTC

FileOutputOperator Rolling Windows Based on Time

Hey Everyone,

I am trying to set up my file output operator so that the files roll every hour.

My thought is that in the operator if I know the Streaming Window Size and the Application Window Count, I can easily enough calculate the value I should set for RotationWindows property.

I’ve been able to get all the attributes in to my operator, but it’s pretty ugly, pull them from the conf in App class and pass them to the operator, and things like this but it doesn’t feel like the proper pattern. I can get the App window count from the operator context if I set it as a property but I can’t get the streaming window millis and if I don’t set the app window count then I can’t get that either. Is there a recommended pattern to get application attributes inside of an operator?

Thanks,
Alex
________________________________________________________

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.