[jira] [Commented] (APEXMALHAR-2049) Managed State - add support for distributing buckets to partition

["Timothy Farkas (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15231710#comment-15231710 ] 

Timothy Farkas commented on APEXMALHAR-2049:
--------------------------------------------

The way in which this will be done is the following:

A predefined number of buckets will be allocated. Those buckets are then evenly distributed among each partition by a partitioner. a getBuckets method will be added to managed state. The method will return all the buckets that a partition is responsible for. When the partitioner distributes buckets among partitions it also sets the partition mask and partition key in the following way. When the partitioner preallocates N buckets each bucket will have a bucket id from 0 to N - 1. The partition mask has log_2(N) bits. Each partition's partition keys are the same as the assigned bucket id's.



> Managed State - add support for distributing buckets to partition
> -----------------------------------------------------------------
>
>                 Key: APEXMALHAR-2049
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2049
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Timothy Farkas
>            Assignee: Timothy Farkas
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)