You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/01/16 22:31:00 UTC

[jira] [Commented] (SAMZA-2074) Read configuration from coordinator stream in checkpoint tool.

    [ https://issues.apache.org/jira/browse/SAMZA-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744504#comment-16744504 ] 

ASF GitHub Bot commented on SAMZA-2074:
---------------------------------------

GitHub user shanthoosh opened a pull request:

    https://github.com/apache/samza/pull/886

    SAMZA-2074: Read configuration from coordinator stream in checkpoint tool.

     Currently, each run of a `CheckpointTool` requires the `TaskModel` from the `JobModel` for updating the checkpoints. `JobModel` generation involves reading the `SystemStreamMetadata`, `SystemStreamPartitionMetadata` of the input streams of the job. Post samza 1.0, this would require the entire configuration bag stored in coordinator stream. 
    
    As a followup to `SAMZA-2059`, this PR changes the `CheckpointTool` read the configuration from the coordinator stream and use it to generate `JobModel`.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/shanthoosh/samza read_config_from_coordinator_stream_for_checkpoint_tool

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/886.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #886
    
----
commit 910cfacac4278376b9c4ceb3c43407e19298a8b4
Author: Shanthoosh Venkataraman <sp...@...>
Date:   2019-01-15T18:04:31Z

    Read configuration from coordinator stream in checkpoint tool.

----


> Read configuration from coordinator stream in checkpoint tool.
> --------------------------------------------------------------
>
>                 Key: SAMZA-2074
>                 URL: https://issues.apache.org/jira/browse/SAMZA-2074
>             Project: Samza
>          Issue Type: Improvement
>            Reporter: Shanthoosh Venkataraman
>            Assignee: Shanthoosh Venkataraman
>            Priority: Major
>
> As a followup to SAMZA-2059, this JIRA tracks the effort required to make the Checkpoint tool work with samza 1.0. Essentially entails reading the configuration from the coordinator stream in the checkpoint tool. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)