You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/01/16 22:31:00 UTC
[jira] [Commented] (SAMZA-2074) Read configuration from coordinator
stream in checkpoint tool.
[ https://issues.apache.org/jira/browse/SAMZA-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744504#comment-16744504 ]
ASF GitHub Bot commented on SAMZA-2074:
---------------------------------------
GitHub user shanthoosh opened a pull request:
https://github.com/apache/samza/pull/886
SAMZA-2074: Read configuration from coordinator stream in checkpoint tool.
Currently, each run of a `CheckpointTool` requires the `TaskModel` from the `JobModel` for updating the checkpoints. `JobModel` generation involves reading the `SystemStreamMetadata`, `SystemStreamPartitionMetadata` of the input streams of the job. Post samza 1.0, this would require the entire configuration bag stored in coordinator stream.
As a followup to `SAMZA-2059`, this PR changes the `CheckpointTool` read the configuration from the coordinator stream and use it to generate `JobModel`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shanthoosh/samza read_config_from_coordinator_stream_for_checkpoint_tool
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/886.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #886
----
commit 910cfacac4278376b9c4ceb3c43407e19298a8b4
Author: Shanthoosh Venkataraman <sp...@...>
Date: 2019-01-15T18:04:31Z
Read configuration from coordinator stream in checkpoint tool.
----
> Read configuration from coordinator stream in checkpoint tool.
> --------------------------------------------------------------
>
> Key: SAMZA-2074
> URL: https://issues.apache.org/jira/browse/SAMZA-2074
> Project: Samza
> Issue Type: Improvement
> Reporter: Shanthoosh Venkataraman
> Assignee: Shanthoosh Venkataraman
> Priority: Major
>
> As a followup to SAMZA-2059, this JIRA tracks the effort required to make the Checkpoint tool work with samza 1.0. Essentially entails reading the configuration from the coordinator stream in the checkpoint tool.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)