You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Mark Bathori (Jira)" <ji...@apache.org> on 2023/02/07 10:02:00 UTC

[jira] [Assigned] (TEZ-4393) ShuffleScheduler.hasFailedAcrossNodes log message to have more context

     [ https://issues.apache.org/jira/browse/TEZ-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Bathori reassigned TEZ-4393:
---------------------------------

    Assignee:     (was: Mark Bathori)

> ShuffleScheduler.hasFailedAcrossNodes log message to have more context
> ----------------------------------------------------------------------
>
>                 Key: TEZ-4393
>                 URL: https://issues.apache.org/jira/browse/TEZ-4393
>             Project: Apache Tez
>          Issue Type: Wish
>            Reporter: László Bodor
>            Priority: Major
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> https://github.com/apache/tez/blob/fa74b95876e1074b5ba2eec6ddb0eea2699c9149/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/ShuffleScheduler.java#L920
> logs this:
> {code}
> 2022-02-10 10:06:49,537 [INFO] [Fetcher_O {Reducer_3} #18] |orderedgrouped.ShuffleScheduler|: srcAttempt=InputAttemptIdentifier [inputIdentifier=2268, attemptNumber=0, pathComponent=attempt_1642579940152_2265110_1_04_000567_0_10002, spillType=0, spillId=-1], numUniqueHosts=677, hostFailureThreshold=136, hostFailuresCount=0, hosts crossing threshold=0, reducerFetchIssues=false
> {code}
> the message doesn't contain anything about the purpose of this log line, it only puts reducerFetchIssues=failedAcrossNodes to the end



--
This message was sent by Atlassian Jira
(v8.20.10#820010)