You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Harish Jaiprakash (JIRA)" <ji...@apache.org> on 2017/04/28 03:52:04 UTC
[jira] [Comment Edited] (TEZ-3701) UnorderedPartitionedKVWriter
does not wait for submitted tasks to finish before finalMerge.
[ https://issues.apache.org/jira/browse/TEZ-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988139#comment-15988139 ]
Harish Jaiprakash edited comment on TEZ-3701 at 4/28/17 3:51 AM:
-----------------------------------------------------------------
Found another issue, with use of SynchronousQueue. The executor throws rejected exception if we submit a task, when the number of running tasks has reached the maximum thread limit.
Should I close this jira as invalid and file another jira or just alter this jira and submit the fix?
was (Author: harishjp):
Found another issue, with use of SynchronousQueue. The executor throws rejected exception if we submit a task, when the number of running tasks has reached the maximum thread limit.
> UnorderedPartitionedKVWriter does not wait for submitted tasks to finish before finalMerge.
> -------------------------------------------------------------------------------------------
>
> Key: TEZ-3701
> URL: https://issues.apache.org/jira/browse/TEZ-3701
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Harish Jaiprakash
> Assignee: Harish Jaiprakash
> Priority: Blocker
>
> UnorderedPartitionedKVWriter add task to the executor, but does not wait for them to finish before starting the final merge. This can cause finalMerge to fail or write incorrect data.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)