[jira] [Commented] (HUDI-4342) Improve handling of 5xx in timeline server

["Sagar Sumit (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-4342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17603496#comment-17603496 ] 

Sagar Sumit commented on HUDI-4342:
-----------------------------------

There could be two kinds of 5xx errors: 500 and 503.

In case of 500 (internal service error), the right thing to do is to retry.

In case of 503 (slowdown), if rate limiter is not alowing the request through then we can retry with exponential backoff.

Either way, Hudi has an exponential backoff [retry mechanism|https://github.com/apache/hudi/blob/1b2179269efab4eb419fdcbc2a4fad717ee8b343/hudi-common/src/main/java/org/apache/hudi/common/table/view/RemoteHoodieTableFileSystemView.java#L181] to handle such scenarios. 

But it needs to be configured using [retry config|https://hudi.apache.org/docs/configurations#hoodiefilesystemoperationretryenable].

> Improve handling of 5xx in timeline server
> ------------------------------------------
>
>                 Key: HUDI-4342
>                 URL: https://issues.apache.org/jira/browse/HUDI-4342
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: timeline-server
>            Reporter: Ethan Guo
>            Assignee: Sagar Sumit
>            Priority: Critical
>             Fix For: 0.12.1
>
>
> https://github.com/apache/hudi/issues/5780



--
This message was sent by Atlassian Jira
(v8.20.10#820010)