You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2023/07/12 14:03:00 UTC
[jira] [Commented] (HDDS-2935) Support for getFileChecksum in OzoneFS
[ https://issues.apache.org/jira/browse/HDDS-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742439#comment-17742439 ]
Wei-Chiu Chuang commented on HDDS-2935:
---------------------------------------
Resolve it because HDDS-5996 implemented getFileChecksum()
However, Ozone's getFileChecksum() is not designed to inter-operate with s3a. It is able to check across HDFS and Ozone today but not between S3A and Ozone. (Might also work across GCS and Ozone because the checksum are similar)
> Support for getFileChecksum in OzoneFS
> --------------------------------------
>
> Key: HDDS-2935
> URL: https://issues.apache.org/jira/browse/HDDS-2935
> Project: Apache Ozone
> Issue Type: New Feature
> Reporter: Srinivasu Majeti
> Priority: Major
>
> Support for getFileChecksum() and any other way to help distcp to avoid the copy of duplicate files even when the length is the same that of remote storage (cloud copy to s3). Checksum calculations of local ozone files should be better similar to whatever s3 is already doing/returning.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org