You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2017/04/27 20:17:04 UTC
[jira] [Updated] (TEZ-3701) UnorderedPartitionedKVWriter does not
wait for submitted tasks to finish before finalMerge.
[ https://issues.apache.org/jira/browse/TEZ-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated TEZ-3701:
----------------------------
Priority: Blocker (was: Major)
Raising priority since any silent data corruption is catastrophically bad. [~harishjp] could you elaborate on what versions are affected? Was this a recently introduced bug or has this been a problem for some time?
> UnorderedPartitionedKVWriter does not wait for submitted tasks to finish before finalMerge.
> -------------------------------------------------------------------------------------------
>
> Key: TEZ-3701
> URL: https://issues.apache.org/jira/browse/TEZ-3701
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Harish Jaiprakash
> Assignee: Harish Jaiprakash
> Priority: Blocker
>
> UnorderedPartitionedKVWriter add task to the executor, but does not wait for them to finish before starting the final merge. This can cause finalMerge to fail or write incorrect data.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)