[jira] [Assigned] (IOTDB-352) [Distributed] Recognize and skip duplicated files in a snapshot

["Tian Jiang (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IOTDB-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tian Jiang reassigned IOTDB-352:
--------------------------------

    Assignee: Tian Jiang

> [Distributed] Recognize and skip duplicated files in a snapshot
> ---------------------------------------------------------------
>
>                 Key: IOTDB-352
>                 URL: https://issues.apache.org/jira/browse/IOTDB-352
>             Project: Apache IoTDB
>          Issue Type: Improvement
>            Reporter: Tian Jiang
>            Assignee: Tian Jiang
>            Priority: Major
>              Labels: distributed
>         Attachments: The solution to data deduplication across replicasV1.docx
>
>
> By the naming of TsFiles in IoTDB, the files with the same data may have different names on different nodes. When such files are sent through snapshots, the receiver is unable to tell whether the file already exists locally or not, so it will blindly load the file as an unsequential one (if it does overlap any existing files), which will waste a lot of system resources.
> How can we figure out if we already have one file or not?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)