You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Pratyush Bhatt (Jira)" <ji...@apache.org> on 2023/12/21 09:28:00 UTC
[jira] [Comment Edited] (HDDS-9930) Deleted file reappears after HSync
[ https://issues.apache.org/jira/browse/HDDS-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799325#comment-17799325 ]
Pratyush Bhatt edited comment on HDDS-9930 at 12/21/23 9:27 AM:
----------------------------------------------------------------
Same scenario in HDFS, the hsync that happens after deleting the file, throws:
{code:java}
2023-12-21 09:21:20,650|INFO|Thread-46|machine.py:205 - run()||GUID=f4628eb7-edd1-44c1-8b40-c14b63b4be29|checkDataLoss(org.hw.openfiles.TestOpenFile): File does not exist: /tmp/folder_1703150407/File_0.txt (inode 65820) Holder DFSClient_NONMAPREDUCE_-2133772079_1 does not have any open files. {code}
cc: [~smeng] [~weichiu]
was (Author: JIRAUSER286694):
Same scenario in HDFS, the hsync that happens after deleting the file, throws:
{code:java}
2023-12-21 09:21:20,650|INFO|Thread-46|machine.py:205 - run()||GUID=f4628eb7-edd1-44c1-8b40-c14b63b4be29|checkDataLoss(org.hw.openfiles.TestOpenFile): File does not exist: /tmp/folder_1703150407/File_0.txt (inode 65820) Holder DFSClient_NONMAPREDUCE_-2133772079_1 does not have any open files. {code}
> Deleted file reappears after HSync
> ----------------------------------
>
> Key: HDDS-9930
> URL: https://issues.apache.org/jira/browse/HDDS-9930
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Ozone Manager
> Reporter: Pratyush Bhatt
> Assignee: Siyao Meng
> Priority: Critical
>
> Scenario:
> Open multiple FSO files in Ozone, write data and do Hsync. In middle Remove some file with -skipTrash.
> Before deleting File_98.txt and File_99.txt
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -du -s -h ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/* | grep File_9
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_9.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_90.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_91.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_92.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_93.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_94.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_95.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_96.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_97.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt
> [root@ccycloud-1 ~]# {code}
> Removing both 98 and 99th file
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -rm -r -skipTrash ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt
> Deleted ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt
> [root@ccycloud-1 ~]# ozone fs -rm -r -skipTrash ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> Deleted ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> [root@ccycloud-1 ~]# {code}
> File gets removed:
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -du -s -h ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/* | grep File_9
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_9.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_90.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_91.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_92.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_93.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_94.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_95.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_96.txt
> 766 K 2.2 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_97.txt
> [root@ccycloud-1 ~]#
> [root@ccycloud-1 ~]# {code}
> After the next Hsync call in test, Both file reappears with the exact length as if they were not deleted previously.
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -du -s -h ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/* | grep File_9
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_9.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_90.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_91.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_92.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_93.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_94.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_95.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_96.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_97.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> 771 K 2.3 M ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org