You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Roger Hoover (JIRA)" <ji...@apache.org> on 2015/06/22 00:52:00 UTC
[jira] [Updated] (SAMZA-720) Bootstrap hangs
[ https://issues.apache.org/jira/browse/SAMZA-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roger Hoover updated SAMZA-720:
-------------------------------
Description:
To reproduce:
Create a job that reads from two topics with equal number of partitions > 1. Configure the job to bootstrap from one of the topics and set yarn.container.count > 1.
Observed outcome:
You'll see that the container completes bootstrapping for the partitions assigned to it's tasks but never finishes bootstrapping for the remaining partitions that are assigned to other containers.
Expected outcome:
When each task as finished bootstrapping the partitions it's responsible for, bootstrapping should be considered complete.
Debug logs available here: https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E
was:
To reproduce:
Created a job that reads from two topics with equal number of partitions > 1. Configure the job to bootstrap from one of the topics and set yarn.container.count > 1.
Observed outcome:
You'll see that the container completes bootstrapping for the partitions assigned to it's tasks but never finishes bootstrapping for the remaining partitions that are assigned to other containers.
Expected outcome:
When each task as finished bootstrapping the partitions it's responsible for, bootstrapping should be considered complete.
Debug logs available here: https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E
> Bootstrap hangs
> ----------------
>
> Key: SAMZA-720
> URL: https://issues.apache.org/jira/browse/SAMZA-720
> Project: Samza
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Roger Hoover
> Priority: Blocker
>
> To reproduce:
> Create a job that reads from two topics with equal number of partitions > 1. Configure the job to bootstrap from one of the topics and set yarn.container.count > 1.
> Observed outcome:
> You'll see that the container completes bootstrapping for the partitions assigned to it's tasks but never finishes bootstrapping for the remaining partitions that are assigned to other containers.
> Expected outcome:
> When each task as finished bootstrapping the partitions it's responsible for, bootstrapping should be considered complete.
> Debug logs available here: https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)