You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Mathieu Chataigner (JIRA)" <ji...@apache.org> on 2017/02/27 22:05:45 UTC
[jira] [Updated] (HADOOP-14128) ChecksumFs should override rename
with overwrite flag
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mathieu Chataigner updated HADOOP-14128:
----------------------------------------
Description:
When I call `FileContext.rename(src, dst, Options.Rename.OVERWRITE)` on a `LocalFs` (which extends `ChecksumFs`), it does not update crc files.
Every subsequent read on moved files will result in failures due to crc missmatch.
One solution is to override `rename(src, dst, overwrite)` the same way it's done with `rename(src, dst)` and moving crc files accordingly.
was:
When I call FileContext.rename(src, dst, Options.Rename.OVERWRITE) on a LocalFs (which extends ChecksumFs), it does not update crc files.
Every subsequent read on moved files will result in failures due to crc missmatch.
One solution is to override rename(src, dst, overwrite) the same way it's done with rename(src, dst) and moving crc files accordingly.
> ChecksumFs should override rename with overwrite flag
> -----------------------------------------------------
>
> Key: HADOOP-14128
> URL: https://issues.apache.org/jira/browse/HADOOP-14128
> Project: Hadoop Common
> Issue Type: Bug
> Components: common, fs
> Reporter: Mathieu Chataigner
>
> When I call `FileContext.rename(src, dst, Options.Rename.OVERWRITE)` on a `LocalFs` (which extends `ChecksumFs`), it does not update crc files.
> Every subsequent read on moved files will result in failures due to crc missmatch.
> One solution is to override `rename(src, dst, overwrite)` the same way it's done with `rename(src, dst)` and moving crc files accordingly.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org