You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "lrz (Jira)" <ji...@apache.org> on 2021/04/01 02:36:00 UTC

[jira] [Updated] (HUDI-1749) Clean/Compaction/Rollback command maybe never exit when operation fail

     [ https://issues.apache.org/jira/browse/HUDI-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

lrz updated HUDI-1749:
----------------------
    Fix Version/s: 0.9.0

> Clean/Compaction/Rollback command maybe never exit when operation fail
> ----------------------------------------------------------------------
>
>                 Key: HUDI-1749
>                 URL: https://issues.apache.org/jira/browse/HUDI-1749
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: lrz
>            Priority: Major
>             Fix For: 0.9.0
>
>
> There are two issues:
> 1) After Clean/Compaction/Rollback command finish, yarn application will always show fail because the command exit directly without waitting for sparkContext stop.
> 2)when Clean/Compaction/Rollback command failed because of some exception, the command will never exit because of sparkContext didn't stop. This is because sparkUI use jetty, and introduce non-daemon thread, and sparkContext.stop will stopUI to stop the non-daemon thread.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)