[jira] [Updated] (APEXMALHAR-2027) Add Timer Scheduler

["Timothy Farkas (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/APEXMALHAR-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Timothy Farkas updated APEXMALHAR-2027:
---------------------------------------
    Description: 
The Timer Scheduler can schedule tasks to be executed at a future time. State is spooled to a key value store. This is required for several use cases.

1 - Many users aggregate streaming data and write the result of the aggregation out to a file or a database. Typically users want their aggregated data written out only when the aggregation is complete. In order to accomplish this the key for an aggregation can be assigned an expiration time. Once the expiration time has passed a registered call back can be called to write the aggregation out to a database or file.

2 - Many key value stores provide the ability to expire a key after a certain period of time. In order to add this ability to an APEX native key value store a Timer Scheduler can be used to assign an expiration time for a key . When the key expires a callback can be called to remove the key from the store.

3 - This timer scheduler could be applied to a deduplication operator. Deduplication can be applied to a piece a data with a certain key for a period of time, and an expiration time can be assigned to the key. Once the expiration time has passed for that key the deduplication operator can allow a tuple with that key to pass.

  was:The Timer Scheduler can schedule tasks to be executed at a future time. State is spooled to a key value store.


> Add Timer Scheduler
> -------------------
>
>                 Key: APEXMALHAR-2027
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2027
>             Project: Apache Apex Malhar
>          Issue Type: New Feature
>            Reporter: Timothy Farkas
>
> The Timer Scheduler can schedule tasks to be executed at a future time. State is spooled to a key value store. This is required for several use cases.
> 1 - Many users aggregate streaming data and write the result of the aggregation out to a file or a database. Typically users want their aggregated data written out only when the aggregation is complete. In order to accomplish this the key for an aggregation can be assigned an expiration time. Once the expiration time has passed a registered call back can be called to write the aggregation out to a database or file.
> 2 - Many key value stores provide the ability to expire a key after a certain period of time. In order to add this ability to an APEX native key value store a Timer Scheduler can be used to assign an expiration time for a key . When the key expires a callback can be called to remove the key from the store.
> 3 - This timer scheduler could be applied to a deduplication operator. Deduplication can be applied to a piece a data with a certain key for a period of time, and an expiration time can be assigned to the key. Once the expiration time has passed for that key the deduplication operator can allow a tuple with that key to pass.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)