[jira] [Work started] (KAFKA-3914) Global discovery of state stores

["Damian Guy (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on KAFKA-3914 started by Damian Guy.
-----------------------------------------
> Global discovery of state stores
> --------------------------------
>
>                 Key: KAFKA-3914
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3914
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: streams
>    Affects Versions: 0.10.1.0
>            Reporter: Damian Guy
>            Assignee: Damian Guy
>             Fix For: 0.10.1.0
>
>
> - Update group membership data to include discovery endpoints
> - Enable discovery
> We need to attach some host and port information to {{org.apache.kafka.streams.processor.internals.assignment.SubscriptionInfo}}
> This can then be used in {{org.apache.kafka.streams.processor.internals.StreamPartitionAssignor}} to build a {{Map<HostState, Set<TopicPartition>>}} that should be added to
> {{org.apache.kafka.streams.processor.internals.assignment.AssignmentInfo}} during the {{assign}} call.
> When {{StreamPartitionAssignor.onAssignment}} is called we should hold on to a copy of the {{Map<HostState, Set<TopicPartition>>}} for use by the discovery methods
> To enable discovery, implement the below methods on {{KafkaStreams}}
> {code}
> /**
>  * @return metadata about all tasks
>  */
> Map<HostState, Set<TaskMetadata>> getAllTasks();
> /**
>  * @param storeName requested store name
>  * @return metadata about all tasks that include
>  * storeName in this KStreams instance
>  */
> Map<HostState, Set<TaskMetadata>> getAllTasksWithStore(String storeName);
> /**
>  * @param key requested key
>  * @param storeName requested store name
>  * @return metadata about all tasks that include
>  * storeName and key in this KStreams instance
>  */
> <K> Map<HostState, Set<TaskMetadata>> getAllTasksWithKey(String storeName, K key);
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)