You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Shanthoosh Venkataraman (JIRA)" <ji...@apache.org> on 2019/05/17 19:24:00 UTC

[jira] [Resolved] (SAMZA-2179) Move the StartpointVisitor abstraction to SystemAdmin interface.

     [ https://issues.apache.org/jira/browse/SAMZA-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shanthoosh Venkataraman resolved SAMZA-2179.
--------------------------------------------
    Resolution: Fixed

> Move the StartpointVisitor abstraction to SystemAdmin interface.
> ----------------------------------------------------------------
>
>                 Key: SAMZA-2179
>                 URL: https://issues.apache.org/jira/browse/SAMZA-2179
>             Project: Samza
>          Issue Type: Improvement
>            Reporter: Shanthoosh Venkataraman
>            Assignee: Shanthoosh Venkataraman
>            Priority: Major
>             Fix For: 1.2
>
>          Time Spent: 8.5h
>  Remaining Estimate: 0h
>
> This patch is comprised of the following changes:
> * Migrates the `StartpointVisitor` abstraction from `SystemConsumer` to `SystemAdmin`. Currently, startpoints are acted upon at the `SystemConsumer` layer. This patch enables resolving startpoint to the offset before starting off the downstream components of SamzaContainer. This provides easier integration path for Startpoint by not mandating that every component of SamzaContainer from OffsetManager, SystemConsumer, SystemConsumers etc to support startpoint semantics and avoids proliferation of Samza public API with startpoints.
> * Moves the `KafkaStartpointVisitor` implementation from `KafkaSystemConsumer` to `KafkaSystemAdmin`. Reverts back the refactor done in `KafkaSystemConsumer` for startpoints. 
> * Moved the startpoint tests from `KafkaSystemConsumer` to `KafkaSystemAdmin`.
> * Removes the `StartpointCustom`, which is not required for supporting any type of seek-back for I/O connectors.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)