You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2022/09/19 15:22:00 UTC

[jira] [Updated] (HUDI-1369) Bootstrap datasource jobs from hanging via spark-submit

     [ https://issues.apache.org/jira/browse/HUDI-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raymond Xu updated HUDI-1369:
-----------------------------
    Sprint: 2022/09/05, 2022/09/19  (was: 2022/09/05)

> Bootstrap datasource jobs from hanging via spark-submit
> -------------------------------------------------------
>
>                 Key: HUDI-1369
>                 URL: https://issues.apache.org/jira/browse/HUDI-1369
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Wenning Ding
>            Assignee: Ethan Guo
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> MOR table creation via Hudi datasource hangs at the end of the spark-submit job.
> Looks like {{HoodieWriteClient}} at [https://github.com/apache/hudi/blob/release-0.6.0/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala#L255] not being closed which does not stop the timeline server at the end, and as a result the job hangs and never exits.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)