You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Venkata krishnan Sowrirajan (Jira)" <ji...@apache.org> on 2021/08/16 16:46:00 UTC

[jira] [Resolved] (SPARK-36484) Handle Stale block fetch failure on the client side by not retrying the requests

     [ https://issues.apache.org/jira/browse/SPARK-36484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Venkata krishnan Sowrirajan resolved SPARK-36484.
-------------------------------------------------
    Resolution: Won't Fix

Thinking more about it, it doesn't seem to add much of value in terms of avoiding retrying the requests as the server anyway don't do any processing for these stale fetch requests. Since there isn't any reasonable perf improvement, deciding to close this out.

> Handle Stale block fetch failure on the client side by not retrying the requests
> --------------------------------------------------------------------------------
>
>                 Key: SPARK-36484
>                 URL: https://issues.apache.org/jira/browse/SPARK-36484
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core
>    Affects Versions: 3.2.0
>            Reporter: Venkata krishnan Sowrirajan
>            Priority: Minor
>
> Similar to SPARK-36378, we need to handle the stale block fetch failures on the client side, although without handling it there won't be any correctness issues. This would help in saving some server side bandwidth unnecessarily serving stale shuffle fetch requests.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org