You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Nishant Dash (JIRA)" <ji...@apache.org> on 2018/05/29 18:13:00 UTC

[jira] [Commented] (TEZ-3391) MR split file validation should be done in the AM

    [ https://issues.apache.org/jira/browse/TEZ-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16493991#comment-16493991 ] 

Nishant Dash commented on TEZ-3391:
-----------------------------------

[~rohini] In regards to point 1 of moving the validation checks to AM, I was hoping if you could shed some more light on where or at which point/step could the checks be included?

> MR split file validation should be done in the AM
> -------------------------------------------------
>
>                 Key: TEZ-3391
>                 URL: https://issues.apache.org/jira/browse/TEZ-3391
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Priority: Major
>
>   We had a case  where Split metadata size exceeded 10000000. Instead of job failing from validation during initialization in AM like mapreduce, each of the tasks failed doing that validation during initialization.
>   



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)