You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 08:23:02 UTC
[I] Throw error if deletion of invalid data file fails [hudi]
hudi-bot opened a new issue, #16086:
URL: https://github.com/apache/hudi/issues/16086
Currently we do not throw an exception if invalid data file deletion fails.
```
fileSystem.delete(new Path(partitionFilePair.getValue()), false)
```
The result of the delete call is not checked today. The PR adds a check for it and throws exception in case delete fails.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6517
- Type: Bug
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Throw error if deletion of invalid data file fails [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #16086:
URL: https://github.com/apache/hudi/issues/16086#issuecomment-3630169575
### Linked PR(s)
- https://github.com/apache/hudi/pull/9165
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Throw error if deletion of invalid data file fails [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #16086:
URL: https://github.com/apache/hudi/issues/16086#issuecomment-4795530404
This appears to be fixed in current master via [HUDI-9259](https://issues.apache.org/jira/browse/HUDI-9259) ([PR #13088](https://github.com/apache/hudi/pull/13088), commit `0a19452`).
In `HoodieTable.deleteInvalidFilesByPartitions` (`hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java`), the deletion result is now checked and an exception is thrown when the file cannot be deleted:
```java
boolean deletionSuccess = storage.deleteFile(pathToDelete);
if (!deletionSuccess && storage.exists(pathToDelete)) {
throw new HoodieIOException("Failed to delete invalid path during marker reconciliaton " + pathToDelete);
}
```
Closing as resolved — please reopen if you still see the original behavior on a recent build.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Throw error if deletion of invalid data file fails [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #16086: Throw error if deletion of invalid data file fails
URL: https://github.com/apache/hudi/issues/16086
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org