You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2022/02/25 12:10:00 UTC
[jira] [Updated] (TEZ-4393) ShuffleScheduler.hasFailedAcrossNodes log message to have more context
[ https://issues.apache.org/jira/browse/TEZ-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
László Bodor updated TEZ-4393:
------------------------------
Description:
https://github.com/apache/tez/blob/master/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/ShuffleScheduler.java#L920
logs this:
{code}
2022-02-10 10:06:49,537 [INFO] [Fetcher_O {Reducer_3} #18] |orderedgrouped.ShuffleScheduler|: srcAttempt=InputAttemptIdentifier [inputIdentifier=2268, attemptNumber=0, pathComponent=attempt_1642579940152_2265110_1_04_000567_0_10002, spillType=0, spillId=-1], numUniqueHosts=677, hostFailureThreshold=136, hostFailuresCount=0, hosts crossing threshold=0, reducerFetchIssues=false
{code}
the message doesn't contain anything about the purpose of this log line, it only puts reducerFetchIssues=failedAcrossNodes to the end
> ShuffleScheduler.hasFailedAcrossNodes log message to have more context
> ----------------------------------------------------------------------
>
> Key: TEZ-4393
> URL: https://issues.apache.org/jira/browse/TEZ-4393
> Project: Apache Tez
> Issue Type: Wish
> Reporter: László Bodor
> Priority: Major
>
> https://github.com/apache/tez/blob/master/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/ShuffleScheduler.java#L920
> logs this:
> {code}
> 2022-02-10 10:06:49,537 [INFO] [Fetcher_O {Reducer_3} #18] |orderedgrouped.ShuffleScheduler|: srcAttempt=InputAttemptIdentifier [inputIdentifier=2268, attemptNumber=0, pathComponent=attempt_1642579940152_2265110_1_04_000567_0_10002, spillType=0, spillId=-1], numUniqueHosts=677, hostFailureThreshold=136, hostFailuresCount=0, hosts crossing threshold=0, reducerFetchIssues=false
> {code}
> the message doesn't contain anything about the purpose of this log line, it only puts reducerFetchIssues=failedAcrossNodes to the end
--
This message was sent by Atlassian Jira
(v8.20.1#820001)