You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "taylor liao (Jira)" <ji...@apache.org> on 2021/05/27 08:21:00 UTC
[jira] [Updated] (HUDI-1937) When clustering fail, generating
unfinished replacecommit dataline.
[ https://issues.apache.org/jira/browse/HUDI-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
taylor liao updated HUDI-1937:
------------------------------
Description:
When clustering fail, generating unfinished replacecommit.
Restart job will generate delta commit. if the commit contain clustering group file, the task will fail.
"Not allowed to update the clustering file group %s
For pending clustering operations, we are not going to support update for now."
Need to ensure that the unfinished replacecommit file is deleted, or perform clustering first, and then generate delta commit.
was:
When clustering fail, generating unfinished replacecommit.
Restart job will generate delta commit. if the commit contain clustering group file, the task will fail.
"Not allowed to update the clustering file group %s
For pending clustering operations, we are not going to support update for now."
Need to ensure that the unfinished replacecommit file is deleted, or perform file merging first, and then generate delta commit.
> When clustering fail, generating unfinished replacecommit dataline.
> -------------------------------------------------------------------
>
> Key: HUDI-1937
> URL: https://issues.apache.org/jira/browse/HUDI-1937
> Project: Apache Hudi
> Issue Type: Bug
> Components: Spark Integration
> Reporter: taylor liao
> Priority: Critical
>
> When clustering fail, generating unfinished replacecommit.
> Restart job will generate delta commit. if the commit contain clustering group file, the task will fail.
> "Not allowed to update the clustering file group %s
> For pending clustering operations, we are not going to support update for now."
> Need to ensure that the unfinished replacecommit file is deleted, or perform clustering first, and then generate delta commit.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)